OpenSkillIndex← back to search
claude-code

OpenJudge bib-verify

install
source · Clone the upstream repo
git clone https://github.com/agentscope-ai/OpenJudge
Claude Code · Install into ~/.claude/skills/
T=$(mktemp -d) && git clone --depth=1 https://github.com/agentscope-ai/OpenJudge "$T" && mkdir -p ~/.claude/skills && cp -r "$T/skills/bib-verify" ~/.claude/skills/agentscope-ai-openjudge-bib-verify && rm -rf "$T"
manifest: skills/bib-verify/SKILL.md
source content

BibTeX Verification Skill

Check every entry in a 

.bib
file against real academic databases using the OpenJudge 
PaperReviewPipeline
in BibTeX-only mode:

  1. Parse — extract all entries from the 
    .bib
    file
  2. Lookup — query CrossRef, arXiv, and DBLP for each reference
  3. Match — compare title, authors, year, and DOI
  4. Report — flag each entry as 
    verified
    , 
    suspect
    , or 
    not_found

Prerequisites

pip install py-openjudge litellm

Gather from user before running

InfoRequired?Notes
BibTeX file pathYes
.bib
file to verify
CrossRef emailNoImproves CrossRef API rate limits

Quick start

# Verify a standalone .bib file
python -m cookbooks.paper_review --bib_only references.bib

# With CrossRef email for better rate limits
python -m cookbooks.paper_review --bib_only references.bib --email your@email.com

# Save report to a custom path
python -m cookbooks.paper_review --bib_only references.bib \
  --email your@email.com --output bib_report.md

Relevant options

FlagDefaultDescription
--bib_only
—Path to 
.bib
file (required for standalone verification)
--email
—CrossRef mailto — improves rate limits, recommended
--output
autoOutput 
.md
report path
--language
en
Report language: 
en
or 
zh

Interpreting results

Each reference entry is assigned one of three statuses:

StatusMeaning
verified
Found in CrossRef / arXiv / DBLP with matching fields
suspect
Title or authors do not match any real paper — likely hallucinated or mis-cited
not_found
No match in any database — treat as fabricated

Field-level details are shown for 

suspect
entries:

  • title_match
    — whether the title matches a real paper
  • author_match
    — whether the author list matches
  • year_match
    — whether the publication year is correct
  • doi_match
    — whether the DOI resolves to the right paper

Additional resources