Awesome-Agent-Skills-for-Empirical-Research database-comparison-guide
Compare major academic databases and when to use each for research
install
source · Clone the upstream repo
git clone https://github.com/brycewang-stanford/Awesome-Agent-Skills-for-Empirical-Research
Claude Code · Install into ~/.claude/skills/
T=$(mktemp -d) && git clone --depth=1 https://github.com/brycewang-stanford/Awesome-Agent-Skills-for-Empirical-Research "$T" && mkdir -p ~/.claude/skills && cp -r "$T/skills/43-wentorai-research-plugins/skills/literature/search/database-comparison-guide" ~/.claude/skills/brycewang-stanford-awesome-agent-skills-for-empirical-research-database-comparis && rm -rf "$T"
manifest:
skills/43-wentorai-research-plugins/skills/literature/search/database-comparison-guide/SKILL.mdsource content
Database Comparison Guide
A comprehensive reference for choosing and querying the right academic database for your research domain, including coverage details, advanced operators, and cross-database strategies.
Overview of Major Academic Databases
| Database | Coverage | Disciplines | Access Model | Unique Strength |
|---|---|---|---|---|
| Web of Science | 1900-present, 21,000+ journals | Multidisciplinary | Subscription | Citation indexing, Journal Impact Factor |
| Scopus | 1970-present, 27,000+ journals | Multidisciplinary | Subscription | Largest abstract/citation DB, CiteScore |
| PubMed | 1946-present, 35M+ records | Biomedical, life sciences | Free | MeSH controlled vocabulary, clinical filters |
| IEEE Xplore | 1872-present, 6M+ docs | Engineering, CS | Subscription | Conference proceedings, standards |
| Google Scholar | Broad, undisclosed | All fields | Free | Widest coverage, full-text indexing |
| JSTOR | Historical archives | Humanities, social sciences | Subscription | Historical journal runs, primary sources |
| arXiv | 1991-present, 2.4M+ papers | Physics, CS, Math, Bio | Free | Preprints, no peer-review delay |
| SSRN | 1994-present | Social sciences, law | Free | Working papers, early-stage research |
Field-Specific Database Selection
STEM Fields
For physics, computer science, and mathematics, combine arXiv preprints with Web of Science indexed journals:
# arXiv API query for recent ML papers curl "http://export.arxiv.org/api/query?search_query=cat:cs.LG+AND+ti:transformer&start=0&max_results=25&sortBy=submittedDate&sortOrder=descending"
For biomedical research, PubMed with MeSH terms provides the most precise retrieval:
# PubMed E-utilities search with MeSH curl "https://eutils.ncbi.nlm.nih.gov/entrez/eutils/esearch.fcgi?db=pubmed&term=%22machine+learning%22[MeSH]+AND+%22drug+discovery%22[MeSH]&retmax=50&sort=date"
Social Sciences and Humanities
- Economics/Business: Scopus + SSRN + RePEc (for working papers)
- Psychology: PsycINFO (APA) + PubMed
- Law: Westlaw + SSRN + HeinOnline
- History/Literature: JSTOR + Project MUSE + MLA International Bibliography
Advanced Search Operators by Database
Web of Science
TS=("deep learning" AND "drug discovery") AND PY=(2020-2025) # TS = Topic (title + abstract + keywords) # PY = Publication Year # Use NEAR/x for proximity: TS=("climate" NEAR/3 "adaptation")
Scopus
TITLE-ABS-KEY("deep learning" AND "drug discovery") AND PUBYEAR > 2019 # Additional operators: # AUTHLASTNAME(smith) AND AUTHFIRST(j*) # AFFIL("MIT" OR "Massachusetts Institute of Technology") # REF("seminal paper title")
PubMed
"deep learning"[Title/Abstract] AND "drug discovery"[Title/Abstract] AND ("2020/01/01"[Date - Publication] : "2025/12/31"[Date - Publication]) # Use filters: Clinical Trial[pt], Review[pt], Free Full Text[Filter]
Cross-Database Search Strategy
A robust literature search should query multiple databases to maximize recall:
- Define your research question using PICO (Population, Intervention, Comparison, Outcome) or PCC (Population, Concept, Context) frameworks.
- Identify controlled vocabulary for each database (MeSH for PubMed, Emtree for Embase, Thesaurus for PsycINFO).
- Build search strings combining controlled vocabulary with free-text synonyms using Boolean operators.
- Execute searches across at least 2-3 databases relevant to your field.
- Deduplicate results using reference managers (Zotero, EndNote) or tools like Covidence.
- Document your search with database, date, exact query string, and result count for reproducibility.
Practical Tips
- Scopus vs. Web of Science: Scopus has broader coverage (especially post-2000 and non-English journals); WoS has deeper historical archives and the Journal Impact Factor.
- Google Scholar finds the most results but lacks advanced filtering. Use it for snowball searches and finding grey literature, not as your primary systematic search tool.
- API access: PubMed (E-utilities), OpenAlex, and Crossref all offer free APIs for programmatic searching. Scopus and WoS require institutional API keys.
- Alert services: Set up saved search alerts on PubMed, Scopus, and Google Scholar to stay current in fast-moving fields.