install
source · Clone the upstream repo
git clone https://github.com/tsaol/awesome-claude
Claude Code · Install into ~/.claude/skills/
T=$(mktemp -d) && git clone --depth=1 https://github.com/tsaol/awesome-claude "$T" && mkdir -p ~/.claude/skills && cp -r "$T/skills/aggregated-search" ~/.claude/skills/tsaol-awesome-claude-aggregated-search && rm -rf "$T"
manifest:
skills/aggregated-search/SKILL.mdsource content
Aggregated Search Skill
Multi-source content aggregation for hot topics research. Supports 15+ data sources.
Usage
/aggregated-search <keyword> [options]
Options:
- Search all sources (default)--sources=all
- Specific sources--sources=github,hn,reddit
- Max results per source (default: 50)--limit=50
- Content age limit in days (default: 7)--days=7
- Language: en, zh, all (default: all)--lang=en
- Enable query expansion (auto-generate related terms)--expand
Examples:
/aggregated-search "agentic AI" /aggregated-search "LLM agents" --sources=github,hn,arxiv /aggregated-search "大模型" --sources=chinese --lang=zh /aggregated-search "RAG" --limit=100 --days=30
Supported Sources (15+)
Code & Projects
| Source | File | API | Free |
|---|---|---|---|
| GitHub | github.md | gh api | ✅ |
| Papers With Code | papers-with-code.md | REST | ✅ |
Tech Communities
| Source | File | API | Free |
|---|---|---|---|
| Hacker News | hackernews.md | Algolia | ✅ |
| reddit.md | JSON | ✅ | |
| DEV.to | devto.md | REST | ✅ |
| Product Hunt | producthunt.md | GraphQL | ✅ |
Academic
| Source | File | API | Free |
|---|---|---|---|
| ArXiv | arxiv.md | XML | ✅ |
| Semantic Scholar | semantic-scholar.md | REST | ✅ |
| Papers With Code | papers-with-code.md | REST | ✅ |
News & Media
| Source | File | API | Free |
|---|---|---|---|
| Tech News (Multi) | tech-news.md | WebFetch | ✅ |
| Medium | medium.md | WebFetch | ✅ |
Chinese Sources (中文源)
| Source | File | API | Free |
|---|---|---|---|
| 36氪/少数派/掘金/知乎/机器之心 | chinese-tech.md | Mixed | ✅ |
Social Media
| Source | File | API | Free |
|---|---|---|---|
| Twitter/X | twitter.md | Nitter | ✅ |
| YouTube | youtube.md | WebFetch | ✅ |
Meta Search (Recommended)
| Source | File | API | Free |
|---|---|---|---|
| Tavily | tavily.md | REST | 1000/mo |
Source Groups
Use these shortcuts for common combinations:
| Group | Sources |
|---|---|
| github, papers-with-code |
| hn, reddit, devto |
| arxiv, semantic-scholar, papers-with-code |
| tavily, tech-news, medium |
| 36kr, sspai, juejin, zhihu, jiqizhixin |
| twitter, youtube, producthunt |
| All sources |
Workflow
Step 0: Query Expansion (if --expand)
If
--expand is enabled, generate related terms before searching:
Original: "agentic commerce" ↓ Expanded (max 5): - agentic commerce (original) - AI shopping agent - conversational commerce - e-commerce AI assistant - 智能购物
Use the prompt in
sources/query-expansion.md to generate max 4 related terms (5 total).
Step 1: Parse Input
Extract keyword, sources, limit, days, language from user input.
Step 2: Parallel Search
CRITICAL: Search all sources in parallel using multiple tool calls in a single message.
For each source:
- Read source instruction from
sources/{source}.md - Execute API call or WebFetch
- Parse results
Step 3: Aggregate & Deduplicate
- Merge all results
- Deduplicate by URL and title similarity (>80% = duplicate)
- Sort by: relevance score, date, engagement
- Tag with source name
Step 4: Output
Generate
raw/aggregated.md:
# Aggregated Search: {keyword} **Sources:** {count} sources searched **Results:** {total} unique items **Generated:** {timestamp} --- ## Summary (via Tavily AI) > AI-generated summary of the topic... ## GitHub ({count}) | # | Repository | Stars | Description | |---|------------|-------|-------------| ## Hacker News ({count}) | # | Title | Points | Comments | |---|-------|--------|----------| ## Academic Papers ({count}) | # | Title | Year | Citations | |---|-------|------|-----------| ## News & Blogs ({count}) | # | Title | Source | Date | |---|-------|--------|------| ## Chinese Sources ({count}) | # | 标题 | 来源 | 日期 | |---|------|------|------| --- ## Statistics - Total sources: {sources_count} - Total results: {total_count} - Unique results: {unique_count} - Date range: {earliest} to {latest}
Environment Variables
# Required for full functionality export TAVILY_API_KEY="your-key" # Tavily search # Optional export YOUTUBE_API_KEY="your-key" # YouTube API export TWITTER_BEARER_TOKEN="your-key" # Twitter API (paid) export PRODUCTHUNT_TOKEN="your-key" # Product Hunt API
Integration
Works with ai-writing hottrend pipeline:
/aggregated-search "topic" ↓ raw/aggregated.md ↓ hottrend-draft agent ↓ output/v1_draft.md