Marketing Experiment Autopsy
Reconstructs an experiment from hypothesis through outcome and converts evidence into bounded next-test decisions.
Assets tagged with marketing.
Reconstructs an experiment from hypothesis through outcome and converts evidence into bounded next-test decisions.
When the user wants to plan, design, or implement an A/B test or experiment, or build a growth experimentation program. Also use when the user mentions "A/B test," "split test," "experiment," "test this change," "variant copy," "multivariate test," "hypothesis," "should I test this," "which version is better," "test two versions," "statistical significance," "how long should I run this test," "growth experiments," "experiment velocity," "experiment backlog," "ICE score," "experimentation program," or "experiment playbook." Use this whenever someone is comparing two approaches and wants to measure which performs better, or when they want to build a systematic experimentation practice. For tracking implementation, see analytics-tracking. For page-level conversion optimization, see page-cro.
Diagnose where and why a conversion funnel leaks, using the user's own web analytics exports, CRM stage data, or product signup and activation events. Defines stages and exact conversion formulas, chooses cohort or period measurement, cuts by segment, checks sample size before calling a difference real, ranks stages by recoverable loss rather than worst rate, gathers qualitative evidence, and ends with a scored hypothesis backlog. Use when someone asks why conversion dropped, where the funnel leaks, why signups do not activate, why leads stall between stages, for a drop-off analysis, or which funnel step to fix first. Do not use for writing landing page copy (use the landing-page-copy prompt), for designing or sizing a specific A/B test (use ab-test-setup), for building a metric hierarchy (use kpi-tree), or for retention curves after purchase (use analyze-cohort-retention).
Diagnose where and why a conversion funnel leaks, using the user's own web analytics exports, CRM stage data, or product signup and activation events. Defines stages and exact conversion formulas, chooses cohort or period measurement, cuts by segment, checks sample size before calling a difference real, ranks stages by recoverable loss rather than worst rate, gathers qualitative evidence, and ends with a scored hypothesis backlog. Use when someone asks why conversion dropped, where the funnel leaks, why signups do not activate, why leads stall between stages, for a drop-off analysis, or which funnel step to fix first. Do not use for writing landing page copy (use the landing-page-copy prompt), for designing or sizing a specific A/B test (use ab-test-setup), for building a metric hierarchy (use kpi-tree), or for retention curves after purchase (use analyze-cohort-retention).
Develop evidence-backed ideal customer profiles (ICPs), segment priorities, buyer and user profiles, positioning, unique value propositions (UVPs), messaging pillars, proof maps, and validation plans. Use when asked to identify or refine target customers, compare market segments, define primary or secondary ICPs and anti-ICPs, synthesize customer discovery or market evidence, articulate differentiation, assess positioning or messaging, write value-proposition statements, or prepare a decision-ready go-to-market, product, sales, or founder strategy.
Develop evidence-backed ideal customer profiles (ICPs), segment priorities, buyer and user profiles, positioning, unique value propositions (UVPs), messaging pillars, proof maps, and validation plans. Use when asked to identify or refine target customers, compare market segments, define primary or secondary ICPs and anti-ICPs, synthesize customer discovery or market evidence, articulate differentiation, assess positioning or messaging, write value-proposition statements, or prepare a decision-ready go-to-market, product, sales, or founder strategy.
Creates briefs and outputs for campaign assets across copy, landing pages, email, social, and ads.
Build and allocate a marketing budget from the user's own targets and conversion data. Compares top-down methods (percent of revenue as a stated heuristic only; a pipeline back-solve from revenue target to deals, opportunities, and leads by channel) with a bottom-up build by program; allocates on marginal rather than average CAC; separates fixed from variable costs; holds a test reserve; phases by quarter; models base, cut 20%, and add 20% scenarios; and sets a tracking cadence. Use when someone asks how much to spend on marketing, how to split budget across channels, how many leads a revenue target needs, or what to cut if the budget drops. Do not use for a one-page campaign plan (use campaign-plan-one-pager), the company operating budget (use build-operating-budget), or proving channel incrementality (use measure-marketing-incrementality).
Build and allocate a marketing budget from the user's own targets and conversion data. Compares top-down methods (percent of revenue as a stated heuristic only; a pipeline back-solve from revenue target to deals, opportunities, and leads by channel) with a bottom-up build by program; allocates on marginal rather than average CAC; separates fixed from variable costs; holds a test reserve; phases by quarter; models base, cut 20%, and add 20% scenarios; and sets a tracking cadence. Use when someone asks how much to spend on marketing, how to split budget across channels, how many leads a revenue target needs, or what to cut if the budget drops. Do not use for a one-page campaign plan (use campaign-plan-one-pager), the company operating budget (use build-operating-budget), or proving channel incrementality (use measure-marketing-incrementality).
Measure what marketing actually causes rather than what it gets credit for. Explains attribution models (last-touch, first-touch, position-based, data-driven) and their biases; designs and sizes incrementality tests (randomized holdouts, ghost ads, conversion lift studies, geo-lift and matched markets, on/off switchbacks); outlines a lightweight marketing mix model; reconciles self-reported attribution; and writes a per-channel measurement plan with pre-registered decision rules. Use when someone asks whether a channel really works, why platform ROAS disagrees with revenue, how to run a holdout or geo test, or which attribution model to trust. Do not use for page or product A/B tests (use ab-test-setup), funnel drop-off diagnosis (use diagnose-conversion-funnel), or setting budget levels (use plan-marketing-budget).
Measure what marketing actually causes rather than what it gets credit for. Explains attribution models (last-touch, first-touch, position-based, data-driven) and their biases; designs and sizes incrementality tests (randomized holdouts, ghost ads, conversion lift studies, geo-lift and matched markets, on/off switchbacks); outlines a lightweight marketing mix model; reconciles self-reported attribution; and writes a per-channel measurement plan with pre-registered decision rules. Use when someone asks whether a channel really works, why platform ROAS disagrees with revenue, how to run a holdout or geo test, or which attribution model to trust. Do not use for page or product A/B tests (use ab-test-setup), funnel drop-off diagnosis (use diagnose-conversion-funnel), or setting budget levels (use plan-marketing-budget).
When the user wants to create SEO-driven pages at scale using templates and data. Also use when the user mentions "programmatic SEO," "template pages," "pages at scale," "directory pages," "location pages," "[keyword] + [city] pages," "comparison pages," "integration pages," "building many pages for SEO," "pSEO," "generate 100 pages," "data-driven pages," or "templated landing pages." Use this whenever someone wants to create many similar pages targeting different keywords or locations. For auditing existing SEO issues, see seo-audit. For content strategy planning, see content-strategy.
Design a customer referral or advocacy program that pays for itself. Tests fit first (is word of mouth already happening, per NPS and referral-source evidence), identifies who refers and why beyond cash, chooses the reward structure (single or double-sided; cash, credit, or product; tiered), models economics against alternative CAC with payback and fraud controls, flags tax and legal points for counsel, sets the moments to ask and the tracking, and launches as a test with a holdout. Use when someone asks to start or fix a referral, refer-a-friend, or customer advocacy program, what referral reward to offer, or whether referrals are worth it. Do not use for partner or reseller commissions, sales compensation (use design-sales-compensation), measuring paid channels (use measure-marketing-incrementality), or offer and pricing design (use develop-offers).
Design a customer referral or advocacy program that pays for itself. Tests fit first (is word of mouth already happening, per NPS and referral-source evidence), identifies who refers and why beyond cash, chooses the reward structure (single or double-sided; cash, credit, or product; tiered), models economics against alternative CAC with payback and fraud controls, flags tax and legal points for counsel, sets the moments to ask and the tracking, and launches as a test with a holdout. Use when someone asks to start or fix a referral, refer-a-friend, or customer advocacy program, what referral reward to offer, or whether referrals are worth it. Do not use for partner or reseller commissions, sales compensation (use design-sales-compensation), measuring paid channels (use measure-marketing-incrementality), or offer and pricing design (use develop-offers).
When the user wants to create, optimize, or analyze a referral program, affiliate program, or word-of-mouth strategy. Also use when the user mentions 'referral,' 'affiliate,' 'ambassador,' 'word of mouth,' 'viral loop,' 'refer a friend,' 'partner program,' 'referral incentive,' 'how to get referrals,' 'customers referring customers,' or 'affiliate payout.' Use this whenever someone wants existing users or partners to bring in new customers. For launch-specific virality, see launch-strategy.
When the user wants help with revenue operations, lead lifecycle management, or marketing-to-sales handoff processes. Also use when the user mentions 'RevOps,' 'revenue operations,' 'lead scoring,' 'lead routing,' 'MQL,' 'SQL,' 'pipeline stages,' 'deal desk,' 'CRM automation,' 'marketing-to-sales handoff,' 'data hygiene,' 'leads aren't getting to sales,' 'pipeline management,' 'lead qualification,' or 'when should marketing hand off to sales.' Use this for anything involving the systems and processes that connect marketing to revenue. For cold outreach emails, see cold-email. For email drip campaigns, see email-sequence. For pricing decisions, see pricing-strategy.
When the user wants to create sales collateral, pitch decks, one-pagers, objection handling docs, or demo scripts. Also use when the user mentions 'sales deck,' 'pitch deck,' 'one-pager,' 'leave-behind,' 'objection handling,' 'deal-specific ROI analysis,' 'demo script,' 'talk track,' 'sales playbook,' 'proposal template,' 'buyer persona card,' 'help my sales team,' 'sales materials,' or 'what should I give my sales reps.' Use this for any document or asset that helps a sales team close deals. For competitor comparison pages and battle cards, see competitor-alternatives. For marketing website copy, see copywriting. For cold outreach emails, see cold-email.
When the user wants to add, fix, or optimize schema markup and structured data on their site. Also use when the user mentions "schema markup," "structured data," "JSON-LD," "rich snippets," "schema.org," "FAQ schema," "product schema," "review schema," "breadcrumb schema," "Google rich results," "knowledge panel," "star ratings in search," or "add structured data." Use this whenever someone wants their pages to show enhanced results in Google. For broader SEO issues, see seo-audit. For AI search optimization, see ai-seo.
When the user wants to audit, review, or diagnose SEO issues on their site. Also use when the user mentions "SEO audit," "technical SEO," "why am I not ranking," "SEO issues," "on-page SEO," "meta tags review," "SEO health check," "my traffic dropped," "lost rankings," "not showing up in Google," "site isn't ranking," "Google update hit me," "page speed," "core web vitals," "crawl errors," or "indexing issues." Use this even if the user just says something vague like "my SEO is bad" or "help with SEO" — start with an audit. For building pages at scale to target keywords, see programmatic-seo. For adding structured data, see schema-markup. For AI search optimization, see ai-seo.
When the user wants to optimize signup, registration, account creation, or trial activation flows. Also use when the user mentions "signup conversions," "registration friction," "signup form optimization," "free trial signup," "reduce signup dropoff," "account creation flow," "people aren't signing up," "signup abandonment," "trial conversion rate," "nobody completes registration," "too many steps to sign up," or "simplify our signup." Use this whenever the user has a signup or registration flow that isn't performing. For post-signup onboarding, see onboarding-cro. For lead capture forms (not account creation), see form-cro.
When the user wants to plan, map, or restructure their website's page hierarchy, navigation, URL structure, or internal linking. Also use when the user mentions "sitemap," "site map," "visual sitemap," "site structure," "page hierarchy," "information architecture," "IA," "navigation design," "URL structure," "breadcrumbs," "internal linking strategy," "website planning," "what pages do I need," "how should I organize my site," or "site navigation." Use this whenever someone is planning what pages a website should have and how they connect. NOT for XML sitemaps (that's technical SEO — see seo-audit). For SEO audits, see seo-audit. For structured data, see schema-markup.
When the user wants help creating, scheduling, or optimizing social media content for LinkedIn, Twitter/X, Instagram, TikTok, Facebook, or other platforms. Also use when the user mentions 'LinkedIn post,' 'Twitter thread,' 'social media,' 'content calendar,' 'social scheduling,' 'engagement,' 'viral content,' 'what should I post,' 'repurpose this content,' 'tweet ideas,' 'LinkedIn carousel,' 'social media strategy,' 'grow my following,' 'TikTok video,' 'Reels,' 'Shorts,' 'video script,' 'video hook,' 'short-form video,' or 'create a reel.' Use this for social media content creation, repurposing, scheduling, and short-form video scripting. For broader content strategy, see content-strategy. For paid video ads, see ad-creative.
When the user wants to create, generate, or produce video content using AI tools or programmatic frameworks. Also use when the user mentions 'video production,' 'AI video,' 'Remotion,' 'Hyperframes,' 'HeyGen,' 'Synthesia,' 'Veo,' 'Runway,' 'Kling,' 'Pika,' 'video generation,' 'AI avatar,' 'talking head video,' 'programmatic video,' 'video template,' 'explainer video,' 'product demo video,' 'video pipeline,' or 'make me a video.' Use this for video creation, generation, and production workflows. For video content strategy and what to post, see social-content. For paid video ad creative, see ad-creative.
Import/audit reference for robertbstillwell/marketing-skills; source policy is link-only.