Aiwg auto-test-execution
Automatically execute tests when code-generating agents modify source files, enforcing the execute-before-return pattern
install
source · Clone the upstream repo
git clone https://github.com/jmagly/aiwg
Claude Code · Install into ~/.claude/skills/
T=$(mktemp -d) && git clone --depth=1 https://github.com/jmagly/aiwg "$T" && mkdir -p ~/.claude/skills && cp -r "$T/.agents/skills/auto-test-execution" ~/.claude/skills/jmagly-aiwg-auto-test-execution && rm -rf "$T"
manifest:
.agents/skills/auto-test-execution/SKILL.mdsource content
auto-test-execution
Automatically execute tests when code-generating agents write to source files, enforcing the execute-before-return pattern.
Triggers
Primary phrases matched automatically from skill description. No additional alternate expressions defined.
Purpose
This skill enforces the MetaGPT executable feedback pattern: code-generating agents must execute tests before returning results to the user. It activates automatically when agents modify source code files.
Behavior
When triggered, this skill:
-
Detect modified files:
- Track which source files the agent has written to
- Identify the relevant test framework
-
Find related tests:
- Look for test files matching the modified source
- Convention:
->src/foo/bar.tstest/unit/foo/bar.test.ts - If no tests exist, prompt agent to generate them
-
Execute tests:
- Run the project's test command focused on relevant tests
- Capture results: passed, failed, errors
-
Handle results:
- All pass: Allow agent to return results
- Failures: Trigger debug-and-retry loop (max 3 attempts)
- Persistent failures: Escalate with debug memory context
-
Update debug memory:
- Record session in
.aiwg/ralph/debug-memory/sessions/ - Extract patterns for future reference
- Record session in
Activation Conditions
activation: always_active_for: - software-implementer - debugger - test-engineer triggered_by: - file_write: patterns: - "src/**/*.ts" - "src/**/*.js" - "src/**/*.py" - "**/*.go" - "**/*.rs" skip_when: - test_files_only: true - documentation_only: true - configuration_only: true
Integration
This skill uses:
: Detect test framework and configurationproject-awareness- Debug memory at
for pattern learning.aiwg/ralph/debug-memory/
References
- @$AIWG_ROOT/agentic/code/frameworks/sdlc-complete/rules/executable-feedback.md - Feedback rules
- @$AIWG_ROOT/agentic/code/addons/ralph/docs/executable-feedback-guide.md - Guide
- @$AIWG_ROOT/agentic/code/addons/ralph/schemas/debug-memory.yaml - Memory schema
- @.aiwg/research/findings/REF-013-metagpt.md - Research foundation