Aiwg auto-test-execution

Automatically execute tests when code-generating agents modify source files, enforcing the execute-before-return pattern

install
source · Clone the upstream repo
git clone https://github.com/jmagly/aiwg
Claude Code · Install into ~/.claude/skills/
T=$(mktemp -d) && git clone --depth=1 https://github.com/jmagly/aiwg "$T" && mkdir -p ~/.claude/skills && cp -r "$T/.agents/skills/auto-test-execution" ~/.claude/skills/jmagly-aiwg-auto-test-execution && rm -rf "$T"
manifest: .agents/skills/auto-test-execution/SKILL.md
source content

auto-test-execution

Automatically execute tests when code-generating agents write to source files, enforcing the execute-before-return pattern.

Triggers

Primary phrases matched automatically from skill description. No additional alternate expressions defined.

Purpose

This skill enforces the MetaGPT executable feedback pattern: code-generating agents must execute tests before returning results to the user. It activates automatically when agents modify source code files.

Behavior

When triggered, this skill:

  1. Detect modified files:

    • Track which source files the agent has written to
    • Identify the relevant test framework
  2. Find related tests:

    • Look for test files matching the modified source
    • Convention:
      src/foo/bar.ts
      ->
      test/unit/foo/bar.test.ts
    • If no tests exist, prompt agent to generate them
  3. Execute tests:

    • Run the project's test command focused on relevant tests
    • Capture results: passed, failed, errors
  4. Handle results:

    • All pass: Allow agent to return results
    • Failures: Trigger debug-and-retry loop (max 3 attempts)
    • Persistent failures: Escalate with debug memory context
  5. Update debug memory:

    • Record session in
      .aiwg/ralph/debug-memory/sessions/
    • Extract patterns for future reference

Activation Conditions

activation:
  always_active_for:
    - software-implementer
    - debugger
    - test-engineer

  triggered_by:
    - file_write:
        patterns:
          - "src/**/*.ts"
          - "src/**/*.js"
          - "src/**/*.py"
          - "**/*.go"
          - "**/*.rs"

  skip_when:
    - test_files_only: true
    - documentation_only: true
    - configuration_only: true

Integration

This skill uses:

  • project-awareness
    : Detect test framework and configuration
  • Debug memory at
    .aiwg/ralph/debug-memory/
    for pattern learning

References

  • @$AIWG_ROOT/agentic/code/frameworks/sdlc-complete/rules/executable-feedback.md - Feedback rules
  • @$AIWG_ROOT/agentic/code/addons/ralph/docs/executable-feedback-guide.md - Guide
  • @$AIWG_ROOT/agentic/code/addons/ralph/schemas/debug-memory.yaml - Memory schema
  • @.aiwg/research/findings/REF-013-metagpt.md - Research foundation