Content Performance Explainer

Overview

This skill transforms raw content performance data into clear, actionable explanations of why content is succeeding or failing. It moves beyond descriptive analytics ("CVR dropped 12%") to diagnostic and prescriptive analysis ("CVR dropped because the new title lost the primary keyword, reducing search-driven traffic quality by 18% — here's the fix").

Most teams drown in dashboards but starve for insight. This skill bridges the gap between data and decision-making for content teams, brand managers, and e-commerce leaders.

When to Use

• Explaining a sudden change (positive or negative) in content performance metrics.
• Conducting periodic content performance reviews (weekly, monthly, quarterly).
• Justifying content investment or optimization spend with clear ROI narratives.
• Diagnosing why a content update didn't produce expected results.
• Comparing performance across SKUs, categories, or time periods.
• Preparing executive-facing content performance reports.
• Post-mortem analysis after A/B test results.

Required Inputs

performance_data

content_versions

time_period

channel

category_benchmarks

{ "avg_ctr": 0.045, "avg_cvr": 0.12, "avg_aov": 24.50 }

competitive_data

external_factors

search_data

advertising_data

Methodology

Step 1 — Funnel Decomposition

Break content performance into a sequential funnel, isolating where changes occur:

Search Impressions → Clicks (CTR)
    → Detail Page Views → Add-to-Cart (ATC Rate)
        → Purchase (CVR) → Revenue
            → Repeat Purchase → LTV

Stage-by-Stage Diagnostic:

Step 2 — Change Attribution Analysis

When performance shifts, identify the most likely cause using the Attribution Hierarchy:

1. Content Changes (highest attribution certainty): Did any content element change during the period? Compare versions side-by-side.
2. Competitive Changes: Did key competitors change pricing, launch new products, or update content?
3. Algorithmic Changes: Did search rankings shift without content changes? Possible algorithm update.
4. Market/Seasonal: Is there a known seasonal pattern, category trend, or macroeconomic factor?
5. Advertising Changes: Did ad spend, bid strategy, or campaign structure change?
6. External Events: PR events, social media virality, influencer mentions, recalls, news coverage.

Apply the Counterfactual Test: "If this factor had NOT changed, would performance have remained stable?" The factor with the strongest counterfactual is the primary driver.

Step 3 — Content Element Impact Scoring

Score each content element's contribution to overall performance:

Step 4 — Performance Narrative Construction

Build a clear, stakeholder-ready explanation using the Situation → Analysis → Recommendation (SAR) framework:

Situation: State the performance change in business terms.

• "SKU X revenue declined 22% month-over-month ($45K → $35K), driven primarily by a 15% CVR drop."

Analysis: Explain the root cause with supporting evidence.

• "The CVR decline coincides with a title change on March 5 that removed the primary keyword 'organic protein powder.' Search impression share dropped 30%, and remaining traffic was less purchase-intent aligned. Competitor Y also launched a new SKU at $2 lower price point, capturing 8% of our branded search impressions."

Recommendation: Provide specific, prioritized actions.

• "Priority 1: Restore primary keyword to title (expected +20% impression recovery in 7-14 days). Priority 2: Add competitive comparison in A+ content to defend against competitor Y's price positioning."

Step 5 — Benchmark Contextualization

Frame performance within appropriate context:

1. Category Benchmarks: Compare against category averages — an 8% CVR might be excellent in electronics but poor in grocery.
2. Historical Trend: Is this a new decline or continuation of a long-term trend?
3. Seasonality Adjustment: Remove seasonal effects to see underlying performance.
4. Portfolio Context: How does this SKU perform relative to the brand's other SKUs?
5. Market Growth/Decline: Is the entire category growing or contracting?

Step 6 — Predictive Outlook & Action Prioritization

Project future performance under different scenarios:

Prioritize recommendations using the Impact × Speed Matrix:

Output Specification

output:
  executive_summary: string           # 2-3 sentence performance narrative
  performance_change:
    metric: string                     # Primary KPI analyzed
    current_value: float
    previous_value: float
    change_pct: float
    direction: string                  # "improved" | "declined" | "stable"
  funnel_analysis:
    impressions: { value: float, change: float, health: string }
    ctr: { value: float, change: float, health: string }
    cvr: { value: float, change: float, health: string }
    revenue: { value: float, change: float, health: string }
  root_cause_analysis:
    primary_driver: string
    contributing_factors: list[string]
    confidence: float                  # 0-100 confidence in attribution
    evidence: list[string]
  content_element_scores: dict         # Element → impact assessment
  benchmark_comparison:
    vs_category: string                # "above" | "at" | "below"
    vs_historical: string
    percentile: float                  # Category performance percentile
  recommendations:
    - priority: int
      action: string
      expected_impact: string
      timeline: string
      effort: string                   # "low" | "medium" | "high"
  projected_scenarios: dict

Analysis Framework

Content Performance Health Score: Aggregate metric combining multiple dimensions:

Health Score: 0-100. Traffic light system: Green (≥ 75), Yellow (50-74), Red (< 50).

Examples

Scenario: Organic granola bar on Amazon. Revenue dropped 35% in 4 weeks.

Executive Summary: "Revenue declined 35% ($28K → $18K) over 4 weeks, primarily driven by a 40% drop in search impressions after losing page-1 organic rank for 'organic granola bars.' Root cause: a title edit on Feb 1 replaced the primary keyword with a brand sub-line. Secondary factor: a key competitor launched a Subscribe & Save offer, improving their conversion and organic rank. Restoring the keyword to the title is the highest-priority fix, with expected recovery within 10-14 days."

Funnel Breakdown:

• Impressions: -40% (search rank dropped from #3 to #18)
• CTR: +5% (fewer but more brand-aware impressions)
• CVR: -8% (competitor's S&S offer pulled comparison shoppers)
• Net Revenue Impact: -35%

Recommendation Priority Stack:

1. Restore "organic granola bars" to title position 1-3. (Impact: High, Speed: Fast, Effort: Low)
2. Enable Subscribe & Save at 5% discount. (Impact: High, Speed: Medium, Effort: Medium)
3. Update A+ comparison chart to address competitor's value proposition. (Impact: Medium, Speed: Medium, Effort: Medium)

Guidelines

• Always separate correlation from causation — a content change and a performance shift occurring simultaneously doesn't prove causation without controlling for other variables.
• Present findings with appropriate confidence levels — don't overstate certainty when multiple factors coincide.
• Tailor the depth and language of the explanation to the audience (executive = high-level SAR; content team = detailed funnel with element-level recommendations).
• Include "what's working" alongside "what's broken" — reinforce winning content patterns to prevent accidental regression.
• Acknowledge data limitations — Amazon's attribution window, delayed reporting, and aggregated metrics all introduce uncertainty.
• Compare against the right benchmark — a luxury skincare brand should not benchmark against mass-market grocery.

Validation Checklist

• Funnel is decomposed stage-by-stage with metrics for each stage.
• Content changes during the analysis period are identified and version-compared.
• Non-content factors (competitive, seasonal, advertising) are assessed and accounted for.
• Root cause attribution uses the counterfactual test and is stated with confidence level.
• Performance is contextualized against category benchmarks, historical trends, and seasonality.
• Recommendations are specific, prioritized by impact × speed, and include expected effect sizes.
• Projected scenarios (do nothing / quick fix / full optimization) are provided.
• Executive summary follows the SAR framework and is stakeholder-ready.
• Content element impact scores are calculated for each PDP component.
• Analysis distinguishes between correlation and causation with appropriate caveats.