Awesome-Agent-Skills-for-Empirical-Research scraping-skills
6 web scraping & data collection skills. Trigger: collecting web data, finding datasets, API access for research. Design: ethical scraping methods with rate limiting and data quality checks.
install
source · Clone the upstream repo
git clone https://github.com/brycewang-stanford/Awesome-Agent-Skills-for-Empirical-Research
Claude Code · Install into ~/.claude/skills/
T=$(mktemp -d) && git clone --depth=1 https://github.com/brycewang-stanford/Awesome-Agent-Skills-for-Empirical-Research "$T" && mkdir -p ~/.claude/skills && cp -r "$T/skills/43-wentorai-research-plugins/skills/tools/scraping" ~/.claude/skills/brycewang-stanford-awesome-agent-skills-for-empirical-research-scraping-skills && rm -rf "$T"
manifest:
skills/43-wentorai-research-plugins/skills/tools/scraping/SKILL.mdsource content
Web Scraping & Data Collection — 6 Skills
Select the skill matching the user's need, then
read| Skill | Description |
|---|---|
| academic-web-scraping | Ethical web scraping and API-based data collection for research |
| dataset-finder-guide | Search and download research datasets from Kaggle, HuggingFace, and repos |
| easy-spider-guide | Guide to EasySpider for visual no-code web data collection |
| google-scholar-scraper | Ethical Google Scholar data collection techniques and best practices |
| repository-harvesting-guide | Harvest metadata from open repositories using OAI-PMH protocol |
| web-scraping-ethics-guide | Scrape web data ethically and legally for research purposes |