Academic Paper Reviewer v1.8.1 — Multi-Perspective Academic Paper Review Agent Team

Simulates a complete international journal peer review process: automatically identifies the paper's field, dynamically configures 5 reviewers (Editor-in-Chief + 3 peer reviewers + Devil's Advocate) who review from four non-overlapping perspectives — methodology, domain expertise, cross-disciplinary viewpoints, and core argument challenges — ultimately producing a structured Editorial Decision and Revision Roadmap.

v1.1 Improvements:

1. Added Devil's Advocate Reviewer — specifically challenges core arguments, detects logical fallacies, and identifies the strongest counter-arguments
2. Added

   re-review

   mode — verification review, focused on checking whether revisions address the review comments
3. Expanded review team from 4 to 5 members

Quick Start

Simplest command:

Review this paper: [paste paper or provide file]

Output:

1. Automatically identifies the paper's field and methodology type
2. Dynamically configures the specific identities and expertise of 5 reviewers
3. 5 independent review reports (each from a different perspective)
4. 1 Editorial Decision Letter + Revision Roadmap

Trigger Conditions

Trigger Keywords

English: review paper, peer review, manuscript review, referee report, review my paper, critique paper, simulate review, editorial review, calibrate reviewer, reviewer calibration, measure reviewer accuracy

Non-Trigger Scenarios

academic-paper

deep-research

academic-paper

Quick Mode Selection Guide

Spectrum (v3.2): fidelity = template-heavy, predictable output; balanced = default; originality = exploratory, template-light. See

shared/mode_spectrum.md

Not sure? Use

full

re-review

calibration

Agent Team (7 Agents)

field_analyst_agent

eic_agent

methodology_reviewer_agent

domain_reviewer_agent

perspective_reviewer_agent

devils_advocate_reviewer_agent

editorial_synthesizer_agent

Orchestration Workflow (3 Phases)

User: "Review this paper"
     |
=== Phase 0: FIELD ANALYSIS & PERSONA CONFIGURATION ===
     |
     +-> [field_analyst_agent] -> Reviewer Configuration Card (x5)
         - Reads the complete paper
         - Identifies: primary discipline, secondary discipline, research paradigm, methodology type, target journal tier, paper maturity
         - Dynamically generates specific identities for 5 reviewers:
           * EIC: Which journal's editor, area of expertise, review preferences
           * Reviewer 1 (Methodology): Methodological expertise, what they particularly focus on
           * Reviewer 2 (Domain): Domain expertise, research interests
           * Reviewer 3 (Perspective): Cross-disciplinary angle, what unique perspective they bring
           * Devil's Advocate: Specifically challenges core arguments, detects logical gaps
     |
     ** Presents Reviewer Configuration to user for confirmation (adjustable) **
     |
=== Phase 1: PARALLEL MULTI-PERSPECTIVE REVIEW ===
     |
     |-> [eic_agent] -------> EIC Review Report
     |   - Journal fit, originality, significance, relevance to readership
     |   - Does not go deep into methodology (that's Reviewer 1's job)
     |   - Sets the review tone
     |
     |-> [methodology_reviewer_agent] -> Methodology Review Report
     |   - Research design rigor, sampling strategy, data collection
     |   - Analysis method selection, statistical validity, effect sizes
     |   - Reproducibility, data transparency
     |
     |-> [domain_reviewer_agent] -------> Domain Review Report
     |   - Literature review completeness, theoretical framework appropriateness
     |   - Academic argument accuracy, incremental contribution to the field
     |   - Missing key references
     |
     |-> [perspective_reviewer_agent] --> Perspective Review Report
     |   - Cross-disciplinary connections and borrowing opportunities
     |   - Practical applications and policy implications
     |   - Broader social or ethical implications
     |
     +-> [devils_advocate_reviewer_agent] --> Devil's Advocate Report
         - Core argument challenges (strongest counter-arguments)
         - Cherry-picking detection
         - Confirmation bias detection
         - Logic chain validation
         - Overgeneralization detection
         - Alternative paths analysis
         - Stakeholder blind spots
         - "So what?" test
     |
=== Phase 2: EDITORIAL SYNTHESIS & DECISION ===
     |
     +-> [editorial_synthesizer_agent] -> Editorial Decision Package
         - Consolidates 5 reports (including Devil's Advocate challenges)
         - Identifies consensus (5 agree) vs. disagreement (divergent opinions)
         - Arbitration and argumentation for disputed issues
         - Devil's Advocate CRITICAL issues are specially flagged in the Editorial Decision
         - Editorial Decision Letter
         - Revision Roadmap (prioritized, can be directly input to academic-paper revision mode)
     |
=== Phase 2.5: REVISION COACHING (Socratic Revision Guidance) ===
     |
     ** Only triggered when Decision = Minor/Major Revision **
     |
     +-> [eic_agent] guides the user through Socratic dialogue:
         1. Overall positioning — "After reading the review comments, what surprised you the most?"
         2. Core issue focus — Guides user to understand consensus issues
         3. Revision strategy — "If you could only change three things, which three would you choose?"
         4. Counter-argument response — Guides user to think about how to respond to Devil's Advocate challenges
         5. Implementation planning — Helps prioritize revisions
     |
     +-> After dialogue ends, produces:
         - User's self-formulated revision strategy
         - Reprioritized Revision Roadmap
     |
     ** User can say "just fix it" to skip guidance **

Checkpoint Rules

1. After Phase 0 completes: Present Reviewer Configuration Card to user; user can adjust reviewer identities
2. ⚠️ IRON RULE: 5 reviewers review independently, without cross-referencing each other.
3. ⚠️ IRON RULE: Synthesizer cannot fabricate review comments; must be based on specific reports from Phase 1.
4. ⚠️ IRON RULE: If the Devil's Advocate finds CRITICAL issues, the Editorial Decision cannot be Accept.
5. Phase 2.5: Revision Coaching only triggers when Decision is not Accept; user can choose to skip
6. ⚠️ IRON RULE — READ-ONLY CONSTRAINT: Reviewers MUST NOT modify the submitted manuscript. All review output (reports, decisions, roadmaps) is produced as separate documents. The reviewer examines the paper — it never rewrites it. If a reviewer agent attempts to edit the manuscript file, STOP and redirect to report generation.

Operational Modes (6 Modes)

full

re-review

quick

methodology-focus

guided

calibration

Mode Selection Logic

"Review this paper"                      -> full
"Give me a quick look at this paper"     -> quick
"Help me check the methodology"          -> methodology-focus
"Does this paper have methodology issues"-> methodology-focus
"Guide me to improve this paper"         -> guided
"Walk me through the issues in my paper" -> guided
"Verification review" / "Check revisions"-> re-review
"How accurate is your review scoring?"   -> calibration
"Calibrate against these 10 papers"      -> calibration

Re-Review Mode (Verification Review)

Dedicated mode for Pipeline Stage 3' — verifies whether revisions address first-round review comments. Uses R&R Traceability Matrix (Schema 11) with Author's Claim + Verified? columns.

Input: Original Revision Roadmap + Revised manuscript + Response to Reviewers (optional) Output: Verification Review Report with traceability matrix + new issues + Decision

See

references/re_review_mode_protocol.md

for full verification logic, output format template, and Socratic guidance details.

Guided Mode (Socratic Guided Review)

Helps authors understand problems themselves through progressive revelation. EIC opens with strengths, then gradually introduces deeper issues from each reviewer perspective.

See

references/guided_mode_protocol.md

for dialogue flow, rules, and progressive revelation sequence.

Calibration Mode (v3.2)

Opt-in mode that measures this reviewer's FNR / FPR / balanced accuracy against a user-supplied gold set (5-20 papers with known outcomes). Runs

full

See

references/calibration_mode_protocol.md

for full spec: intake rules, ensembling methodology, output format, and failure cases this mode does not fix.

Review Output Format

Each reviewer's report structure is detailed in

templates/peer_review_report_template.md

Devil's Advocate Report Structure (Special Format)

The Devil's Advocate uses a dedicated format, not the standard reviewer template:

• Strongest Counter-Argument (200-300 words)
• Issue List (categorized as CRITICAL / MAJOR / MINOR, with dimension and location)
• Ignored Alternative Explanations/Paths
• Missing Stakeholder Perspectives
• Observations (Non-Defects)

Editorial Decision Format

The Editorial Decision Letter structure is detailed in

templates/editorial_decision_template.md

Integration

Upstream/Downstream Relationships

deep-research --> academic-paper --> [integrity check] --> academic-paper-reviewer --> academic-paper (revision) --> academic-paper-reviewer (re-review) --> [final integrity] --> finalize
   (research)       (writing)         (integrity audit)      (review)                    (revision)                    (verification review)                (final verification)   (finalization)

Specific Integration Methods

academic-paper

academic-paper

Pipeline Usage Example

See

references/integration_guide.md

for a complete 9-step pipeline usage example.

Agent File References

agents/field_analyst_agent.md

agents/eic_agent.md

agents/methodology_reviewer_agent.md

agents/domain_reviewer_agent.md

agents/perspective_reviewer_agent.md

agents/devils_advocate_reviewer_agent.md

agents/editorial_synthesizer_agent.md

Reference Files

references/review_criteria_framework.md

references/top_journals_by_field.md

references/editorial_decision_standards.md

references/statistical_reporting_standards.md

references/quality_rubrics.md

references/review_quality_thinking.md

references/re_review_mode_protocol.md

references/guided_mode_protocol.md

references/calibration_mode_protocol.md

references/integration_guide.md

references/changelog.md

Templates

templates/peer_review_report_template.md

templates/editorial_decision_template.md

templates/revision_response_template.md

Examples

examples/hei_paper_review_example.md

examples/interdisciplinary_review_example.md

Anti-Patterns

Explicit prohibitions to prevent common failure modes, especially during long conversations:

Quality Standards

Output Language

Follows the paper's language. Academic terms remain in English. User can override (e.g., "review this Chinese paper in English").

Related Skills

academic-paper

deep-research

tw-hei-intelligence

academic-pipeline

Version Info

Changelog

See

references/changelog.md

for full version history.