Competitive Research with Bright Data

This skill provides enterprise consulting-grade methodologies for conducting comprehensive company research, competitive analysis, and market intelligence using Bright Data's professional search and web scraping tools.

Skill Capabilities

This skill supports:

• Company Research - Deep dives into company background, business model, financials, strategy, and market position
• Competitive Analysis - Multi-company comparisons across products, pricing, positioning, and capabilities
• Market Intelligence - Industry landscape analysis, market sizing, trends, and dynamics
• Product Comparison - Feature-by-feature analysis of competing products or services
• Strategic Analysis - SWOT, Porter's Five Forces, positioning, and strategic recommendations
• Custom Reports - Tailored deliverables matching specific client needs and formats

Available Tools

Search Tools

search_engine - Search Google, Bing, or Yandex for company information

• Use Google for general company research and recent news
• Use Bing for cross-validation and Microsoft ecosystem content
• Use Yandex for companies with Eastern European operations
• Supports pagination with cursor for deep research

search_engine_batch - Run up to 10 searches simultaneously

• Use for multi-company research to gather parallel information
• Use for comprehensive single-company research across topics
• More efficient than sequential searches
• Returns JSON for Google, Markdown for Bing/Yandex

Scraping Tools

scrape_as_markdown - Extract complete content from a single webpage

• Returns clean Markdown format
• Use for company websites, press releases, reports, articles
• Handles bot detection and CAPTCHAs automatically

scrape_batch - Scrape up to 10 URLs simultaneously

• Use for systematic company website extraction
• Use for parallel competitor website analysis
• More efficient than sequential scraping

Workflow

1. Clarify the Research Objective

Always start by understanding the specific request. Ask clarifying questions before diving into research:

Questions to Ask:

• What is the primary purpose of this research? (Investment decision, competitive positioning, market entry, product development, etc.)
• Which companies/products should be analyzed?
• What specific aspects are most important? (Pricing, features, market share, strategy, financials, etc.)
• Who is the audience for this report? (Executive team, sales, product, investors, etc.)
• What format should the deliverable take? (Full report, executive summary, comparison matrix, presentation deck, etc.)
• Are there any specific questions that must be answered?
• What is the scope? (Comprehensive deep-dive vs. quick overview)
• Any time constraints or priorities?

Adapt the approach based on responses - The research methodology and report format should match the stated objective.

2. Plan the Research Approach

Based on the clarified objective, determine:

Information Needed:

• Company background and overview
• Financial data (revenue, funding, growth)
• Product/service details
• Pricing and business model
• Market position and share
• Recent news and developments
• Customer sentiment
• Strategic direction

Search Strategy:

• Identify key search queries for each information area
• Determine if batch searching would be efficient
• Select appropriate search engine(s)

Scraping Strategy:

• Identify target URLs (company sites, reports, articles)
• Determine if batch scraping would be efficient
• Prioritize official company sources

Framework Selection:

• Choose appropriate analytical frameworks (see

  references/consulting-frameworks.md

  )
• Determine report structure (see

  references/report-templates.md

  )

3. Execute Research Systematically

Phase A: Initial Search and Discovery

Start with broad searches to identify sources and get overview:

Company overview and background
Recent news and announcements
Product/service offerings
Competitive landscape

Use batch searches when researching multiple topics simultaneously - More efficient than sequential searches.

Phase B: Deep Dive Information Gathering

Based on initial findings, conduct targeted searches and scraping:

• Search for specific data points identified as important
• Scrape key company website pages (About, Products, Newsroom, Investors)
• Scrape relevant articles, reports, and announcements
• Cross-reference facts across multiple sources

Use batch scraping for related URLs - Scrape competitor websites or multiple company pages together.

Phase C: Competitive/Comparative Research (if applicable)

For competitive analysis:

• Research all competitors using parallel search batches
• Scrape all competitor websites systematically
• Gather same data points for each competitor
• Create comparison tables as research progresses

See

references/research-methodology.md

for detailed search query examples and best practices.

4. Analyze and Synthesize

Apply Analytical Frameworks:

Depending on the research objective, apply relevant frameworks from

references/consulting-frameworks.md

:

• Strategic Analysis - Porter's Five Forces, SWOT, Value Chain
• Competitive Positioning - Strategic groups, positioning matrix
• Market Analysis - TAM/SAM/SOM, customer segmentation
• Financial Analysis - Unit economics, growth metrics
• Product Analysis - Feature comparison, technology assessment

Generate Insights:

• Go beyond raw data to interpretation
• Identify patterns and implications
• Draw evidence-based conclusions
• Make strategic recommendations when requested

Quality Assurance:

• Verify key facts across multiple sources
• Flag conflicting information
• Note data gaps clearly
• Assess recency of information
• Prioritize primary sources

5. Create the Report

Select Appropriate Report Structure:

Choose from templates in

references/report-templates.md

based on the request:

• Company Profile Report - For single-company deep dives
• Competitive Analysis Report - For multi-company comparisons
• Market Entry Analysis - For new market assessment
• Product Comparison Report - For product/service evaluation
• Industry Analysis Report - For sector-level intelligence
• Quick Comparison Matrix - For rapid comparative analysis
• Presentation Deck - For client-facing presentations

Report Quality Standards:

• Executive Summary - Lead with key findings and recommendations
• Clear Structure - Use headings and sections from templates
• Data Presentation - Tables for comparisons, bullets for lists, prose for analysis
• Source Attribution - Cite sources for key claims
• Professional Tone - Enterprise consulting quality
• Actionable Insights - Provide clear implications and recommendations
• Completeness - Address all clarifying questions answered at the start

Format Flexibility:

• Adapt templates to specific needs
• Combine elements from multiple templates if needed
• Match the format to the stated audience and purpose

Best Practices

Research Excellence

1. Triangulate Information - Verify key facts from 2-3 independent sources
2. Prioritize Primary Sources - Company websites, SEC filings, official reports
3. Check Recency - Note publication dates, prefer recent data
4. Flag Gaps - Clearly state when information is unavailable
5. Maintain Objectivity - Seek disconfirming evidence, not just supporting
6. Provide Context - Explain what numbers mean in industry context

Efficiency

1. Batch Operations - Use batch search and scrape tools when researching multiple items
2. Start Broad - Get overview first, then drill down into specifics
3. Organize As You Go - Build comparison tables during research, not after
4. Time-Box Research - Know when enough data is enough
5. Template-Based - Start with report structure, fill in findings

Professional Quality

1. Clear Methodology - Explain how research was conducted
2. Evidence-Based - Support claims with data and sources
3. Balanced Analysis - Present strengths and weaknesses fairly
4. Strategic Framing - Connect findings to business implications
5. Executive-Ready - Make reports actionable for decision-makers

Common Use Cases

Single Company Deep Dive

1. Clarify: What aspects to focus on, audience, format
2. Research: Batch search across company topics, scrape company website
3. Analyze: Apply SWOT or relevant framework
4. Report: Use Company Profile Report template

Head-to-Head Competitive Analysis

1. Clarify: Which companies, key comparison dimensions, decision being made
2. Research: Parallel batch searches for all companies, scrape all company sites
3. Analyze: Create comparison matrices, positioning map
4. Report: Use Competitive Analysis Report template

Market Landscape Analysis

1. Clarify: Market definition, level of detail needed, strategic questions
2. Research: Industry trends, major players, market dynamics
3. Analyze: Porter's Five Forces, strategic group mapping
4. Report: Use Industry Analysis Report or Market Entry Analysis template

Product/Service Comparison

1. Clarify: Products being compared, evaluation criteria, use cases
2. Research: Product pages, documentation, reviews for all products
3. Analyze: Feature matrices, use case fit analysis
4. Report: Use Product Comparison Report template

References

• consulting-frameworks.md - Strategic analysis frameworks (Porter's Five Forces, SWOT, Business Model Canvas, competitive positioning, market sizing, financial analysis)
• report-templates.md - Proven report structures for different deliverable types (company profiles, competitive analysis, market entry, product comparison, quick matrices)
• research-methodology.md - Detailed search strategies, query examples, scraping best practices, source prioritization, and quality assurance processes

Load these references as needed based on the specific research objective and analytical requirements.