c24dae395b
* Refactor skill turn harness, fix session serialization, and resolve E2E test failures * Ignore symlinks during workspace copying and enforce sandbox boundaries in playbooks * Refactor interaction loop to use clean async generator-based Event flow * Introduce dedicated async generator test and improve autonomous tester instructions * Enforce strict sandbox awareness and Step 8 policy import gates * Track and display conversation context size next to turn headers * Streamline token usage display to only appear in turn step headers * Refactor token usage tracking to show actual active context size * Implement progress tracking block and human recovery in test harness * docs: document and categorize repository skills and tools * docs: add maintenance instructions for updating FACTORIES.md tables * docs: add missing data-catalog-policy-tag factory in FACTORIES.md * docs: add missing networking stage sub-factories in FACTORIES.md * docs: add systematic commands for discovering module/stage factories in FACTORIES.md * docs: add missing vpcs factories in 0-org-setup and 2-project-factory stages
39 lines
1.4 KiB
YAML
39 lines
1.4 KiB
YAML
# Copyright 2026 Google LLC
|
|
#
|
|
# Licensed under the Apache License, Version 2.0 (the "License");
|
|
# you may not use this file except in compliance with the License.
|
|
# You may obtain a copy of the License at
|
|
#
|
|
# https://www.apache.org/licenses/LICENSE-2.0
|
|
#
|
|
# Unless required by applicable law or agreed to in writing, software
|
|
# distributed under the License is distributed on an "AS IS" BASIS,
|
|
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
|
|
# See the License for the specific language governing permissions and
|
|
# limitations under the License.
|
|
|
|
# yaml-language-server: $schema=../../playbooks/playbook.schema.json
|
|
name: "Tool Call Test Autonomous"
|
|
timeout: 120
|
|
tmpdir:
|
|
link_paths:
|
|
- tools/skill-turn-harness/test/fixtures/mock-tool-use-skill
|
|
persona:
|
|
initial_user_input: "Hi, please activate the tool-test-skill and create the file as instructed."
|
|
context: |
|
|
You are a user asking the agent to create a file.
|
|
Wait for the agent to confirm the file has been created.
|
|
If the agent asks any questions or says there is an error, repeat your request to create the file.
|
|
max_turns: 5
|
|
success_criteria:
|
|
llm_checks:
|
|
- "The agent confirmed the file was created."
|
|
tool_calls_contain:
|
|
edit_file:
|
|
- "output.txt"
|
|
files_exist:
|
|
- "output.txt"
|
|
files_contain:
|
|
output.txt:
|
|
- "Hello World"
|