OpenSkillIndex← back to search
claude-code

Aiwg quality-assess

Perform GRADE quality assessment on a research source

install
source · Clone the upstream repo
git clone https://github.com/jmagly/aiwg
Claude Code · Install into ~/.claude/skills/
T=$(mktemp -d) && git clone --depth=1 https://github.com/jmagly/aiwg "$T" && mkdir -p ~/.claude/skills && cp -r "$T/.agents/skills/quality-assess" ~/.claude/skills/jmagly-aiwg-quality-assess && rm -rf "$T"
manifest: .agents/skills/quality-assess/SKILL.md
source content

Quality Assess Command

Perform a GRADE evidence quality assessment on a research source or finding.

Instructions

When invoked, perform systematic GRADE assessment:

  1. Load Source

    • Accept REF-XXX identifier or file path
    • Load frontmatter metadata
    • Determine source type and baseline quality

  2. Apply GRADE Framework

    • Evaluate 5 downgrade factors (bias, inconsistency, indirectness, imprecision, publication bias)
    • Evaluate 3 upgrade factors (large effect, dose-response, confounding)
    • Calculate final GRADE level

  3. Generate Assessment

    • Fill assessment template per @.aiwg/research/docs/grade-assessment-guide.md
    • Include hedging language recommendations
    • Include applicability notes for AIWG context

  4. Save Assessment

    • Save to 
      .aiwg/research/quality-assessments/{ref-id}-assessment.yaml
    • Update frontmatter in source document if --update-frontmatter

  5. Report

    • Display GRADE level with confidence statement
    • Show allowed vs forbidden hedging language
    • Flag any existing citations that violate the assessed quality level

Arguments

  • [ref-id or file-path]
    - Source to assess (required)
  • --output [yaml|markdown]
    - Output format (default: yaml)
  • --update-frontmatter
    - Update source document frontmatter with assessment
  • --check-citations
    - Also check existing citations of this source for GRADE compliance

References

  • @.aiwg/research/docs/grade-assessment-guide.md - GRADE methodology
  • @$AIWG_ROOT/agentic/code/frameworks/sdlc-complete/agents/quality-assessor.md - Quality Assessor agent
  • @$AIWG_ROOT/agentic/code/frameworks/sdlc-complete/schemas/research/quality-dimensions.yaml - Quality schema
  • @$AIWG_ROOT/agentic/code/frameworks/sdlc-complete/rules/citation-policy.md - Hedging language rules