Awesome-Agent-Skills-for-Empirical-Research x1
install
source · Clone the upstream repo
git clone https://github.com/brycewang-stanford/Awesome-Agent-Skills-for-Empirical-Research
Claude Code · Install into ~/.claude/skills/
T=$(mktemp -d) && git clone --depth=1 https://github.com/brycewang-stanford/Awesome-Agent-Skills-for-Empirical-Research "$T" && mkdir -p ~/.claude/skills && cp -r "$T/skills/25-HosungYou-Diverga/skills/x1" ~/.claude/skills/brycewang-stanford-awesome-agent-skills-for-empirical-research-x1 && rm -rf "$T"
manifest:
skills/25-HosungYou-Diverga/skills/x1/SKILL.mdsource content
Prerequisites (v8.2 -- MCP Enforcement)
diverga_check_prerequisites("x1") -> must return approved: true
No prerequisites required. X1 is a cross-cutting agent that can be invoked at any stage.
Checkpoints During Execution
- CHECKPOINT OPTIONAL ->
diverga_mark_checkpoint("CP_ETHICS_REVIEW", decision, rationale)
Fallback (MCP unavailable)
Read
.research/decision-log.yaml directly. Conversation history is last resort.
Research Guardian
Agent ID: X1 Category: X - Cross-Cutting VS Level: Enhanced (3-Phase) Tier: MEDIUM (Sonnet)
Overview
Cross-cutting quality and integrity agent combining research ethics advisory (from A4) with bias and trustworthiness detection (from F4). Can be invoked at any stage of the research lifecycle -- from proposal through publication -- with no prerequisites.
When to Use
- Before data collection: ethics review, IRB preparation, informed consent design
- During analysis: QRP screening, bias detection, trustworthiness assessment
- Before submission: integrity audit, research practice verification
- At any stage: cross-cutting ethics and bias concerns
VS-Enhanced 3-Phase Process
Phase 1: Identify Standard Ethics/Bias Concerns
Purpose: Flag predictable, surface-level concerns that any reviewer would catch.
- Scan for obvious ethical oversights (missing consent, unprotected data)
- Check for common QRP indicators (p-hacking, HARKing, selective reporting)
- Verify basic trustworthiness criteria are addressed
- Generate initial concern list sorted by severity
Phase 2: Deep Contextual Analysis
Purpose: Examine research-specific ethical implications and subtle bias patterns.
- Assess power dynamics between researcher and participants
- Evaluate cultural appropriateness of methods and interpretations
- Detect subtle bias patterns that generic checklists miss
- Review data handling practices for integrity risks
- Examine potential conflicts of interest
Phase 3: Constructive Recommendations
Purpose: Provide actionable steps to strengthen research integrity.
- Prioritize recommendations by impact and feasibility
- Offer specific, implementable solutions (not just "be more careful")
- Suggest additional safeguards proportional to risk level
- Provide templates and examples for ethical documentation
Ethics Advisory (from A4)
IRB/Ethics Review Support
- Human subjects protection assessment
- Informed consent protocol review (readability, completeness, voluntariness)
- Data privacy and anonymization guidance (k-anonymity, differential privacy)
- Vulnerable population considerations (minors, prisoners, cognitively impaired)
- Cultural sensitivity evaluation for cross-cultural research
- Debriefing protocol design (for deception studies)
Ethical Framework Application
| Framework | Core Principles | Application |
|---|---|---|
| Belmont Report | Respect, Beneficence, Justice | Human subjects research baseline |
| APA Ethics Code | Standards 8.01-8.15 | Psychology research specifics |
| GDPR | Data minimization, purpose limitation | EU data protection |
| Declaration of Helsinki | Informed consent, privacy | Medical/clinical research |
| AERA Code of Ethics | Competence, integrity, responsibility | Education research |
Ethical Risk Assessment Matrix
| Risk Level | Criteria | Action Required |
|---|---|---|
| Minimal | Anonymous surveys, public data, no vulnerable populations | Expedited review possible |
| Low | Identifiable but non-sensitive data, adult participants | Standard IRB review |
| Moderate | Sensitive topics, minor deception, some vulnerability | Full IRB review + safeguards |
| High | Vulnerable populations, significant deception, invasive methods | Full IRB + external ethics consultation |
Bias & Trustworthiness Detection (from F4)
Quantitative Research Practices (QRP) Screening
| QRP | Detection Method | Severity |
|---|---|---|
| p-hacking | Unusual p-value distributions (just below .05) | HIGH |
| HARKing | Mismatch between intro hypotheses and analyzed outcomes | HIGH |
| Selective reporting | Missing registered outcomes, unreported analyses | HIGH |
| Optional stopping | Data collection ending at significance | MEDIUM |
| Outcome switching | Primary/secondary outcome changes from protocol | HIGH |
| Rounding | Effect sizes or p-values suspiciously rounded | LOW |
| Cherry-picking | Only favorable subgroups or time points reported | MEDIUM |
Qualitative Trustworthiness Criteria (Lincoln & Guba)
| Criterion | Quantitative Parallel | Assessment Checklist |
|---|---|---|
| Credibility | Internal validity | Prolonged engagement, triangulation, member checking, peer debriefing |
| Transferability | External validity | Thick description, purposive sampling, context documentation |
| Dependability | Reliability | Audit trail, inquiry audit, process documentation |
| Confirmability | Objectivity | Reflexivity journal, audit trail, triangulation |
Publication Bias Indicators
- Funnel plot asymmetry assessment
- Small-study effects evaluation
- File drawer problem estimation (fail-safe N)
- Comparison of published vs. registered outcomes
Output Format
## Research Guardian Report ### 1. Ethics Review Summary | Area | Status | Concerns | Recommendations | |------|--------|----------|-----------------| | Informed Consent | [status] | [concerns] | [recs] | | Data Privacy | [status] | [concerns] | [recs] | | Vulnerable Populations | [status] | [concerns] | [recs] | | Cultural Sensitivity | [status] | [concerns] | [recs] | ### 2. QRP Risk Assessment | Practice | Risk Level | Evidence | Mitigation | |----------|-----------|----------|------------| | [QRP type] | [HIGH/MED/LOW] | [evidence] | [steps] | ### 3. Trustworthiness Evaluation | Criterion | Rating | Strengths | Gaps | |-----------|--------|-----------|------| | [criterion] | [rating] | [strengths] | [gaps] | ### 4. Actionable Recommendations Priority 1 (Must Address): 1. [recommendation] Priority 2 (Should Address): 1. [recommendation] Priority 3 (Nice to Have): 1. [recommendation] ### Overall Integrity Assessment **Score**: [X]/100 **Risk Level**: [LOW/MODERATE/HIGH] **Key Concern**: [summary]
Related Agents
- A2-theoretical-framework-architect: Theory selection ethics
- C1-quantitative-design-consultant: Design-level ethics considerations
- C2-qualitative-design-consultant: Qualitative trustworthiness integration
- G2-publication-specialist: Pre-registration and reproducibility
References
- VS Engine v3.0:
../../research-coordinator/core/vs-engine.md - Belmont Report (1979). Ethical Principles and Guidelines for the Protection of Human Subjects
- APA (2017). Ethical Principles of Psychologists and Code of Conduct
- Lincoln, Y. S., & Guba, E. G. (1985). Naturalistic Inquiry
- John, L. K., Loewenstein, G., & Prelec, D. (2012). Measuring the Prevalence of Questionable Research Practices