OpenSkillIndex← back to search
claude-codeautomation

Vibecosystem firecrawl-scrape

Scrape web pages and extract content via Firecrawl MCP

install
source · Clone the upstream repo
git clone https://github.com/vibeeval/vibecosystem
Claude Code · Install into ~/.claude/skills/
T=$(mktemp -d) && git clone --depth=1 https://github.com/vibeeval/vibecosystem "$T" && mkdir -p ~/.claude/skills && cp -r "$T/skills/firecrawl-scrape" ~/.claude/skills/vibeeval-vibecosystem-firecrawl-scrape && rm -rf "$T"
manifest: skills/firecrawl-scrape/SKILL.md
tags
#web-scraping#data-extraction#content-gathering#firecrawl#mcp#url-parsing
source content

Firecrawl Scrape Skill

When to Use

  • Scrape content from any URL
  • Extract structured data from web pages
  • Search the web and get content

Instructions

uv run python -m runtime.harness scripts/mcp/firecrawl_scrape.py \
    --url "https://example.com" \
    --format "markdown"

Parameters

  • --url
    : URL to scrape
  • --format
    : Output format - 
    markdown
    , 
    html
    , 
    text
    (default: markdown)
  • --search
    : (alternative) Search query instead of direct URL

Examples

# Scrape a page
uv run python -m runtime.harness scripts/mcp/firecrawl_scrape.py \
    --url "https://docs.python.org/3/library/asyncio.html"

# Search and scrape
uv run python -m runtime.harness scripts/mcp/firecrawl_scrape.py \
    --search "Python asyncio best practices 2024"

MCP Server Required

Requires 

firecrawl
server in mcp_config.json with FIRECRAWL_API_KEY.