The Measurement Dark Matter of ChatGPT Ads
A reported conversion, an observed site action, and a verified customer are different facts. Nine public ChatGPT Ads case records show why that distinction matters.
Loading
Hi VioletResearch
Research and operating notes on ecosystem growth, go-to-market execution, and growth engineering for crypto/Web3, AI and developer tools, and consumer fintech.
A reported conversion, an observed site action, and a verified customer are different facts. Nine public ChatGPT Ads case records show why that distinction matters.
Meta's Q2 2026 ad revenue rose $12.8 billion year over year. Its impression, price, and Advantage+ figures still cannot isolate a Muse contribution.
Meta's Reels ad page pairs a 2023 purchase survey with an undated 15-test creative analysis. Their populations, outcomes, and limits are different.
Violet compared Blackbird's four public restaurant states, reconstructed the reward economy behind 128.5 million FLY, and explains why counts aren't contribution.
Violet traced Courtyard's conflicting public GMV labels and funding-page dates, reconstructed its drop-to-habit arc, and argues repeat transacting—not GMV—is the metric.
Violet audited Hivemapper's public supply and pricing claims, found three arithmetic conflicts, and derived what a week of global road coverage is worth.
A ~1% CTR is one reported comparison, not a verdict. What the widely cited $1,200 ChatGPT Ads experiment measured—and how to instrument a test properly.
Full aggregate tables from Violet's RAID reanalysis: detector accuracy under 11 attacks, per-document flip rates, per-domain false positives, methods.
Measured on 480,000 generations: paraphrasing makes one detector 5.4pp more accurate and another 17.0pp worse. Evasion is a detector lottery, not a strategy.
One pooled 5% setting, eight writing domains of truth: measured per-domain detector false-positive rates range 0.96% to 20.4%.
Measured on 480,000 generations: one symbol substitution flips 93.7% of a detector's per-document verdicts. Aggregate accuracy hides the collapse.
A decision-first framework for choosing growth metrics without mistaking publishing, rankings, or TVL for attention, adoption, or customer value.
A practical operating system for translating meaningful product changes into clear explanations, useful distribution, measurable action, and market learning.
A practical system for deciding which public surfaces a consumer-crypto product should maintain, repair, consolidate, or deliberately decline.
Why synonym shuffling cannot guarantee clean provenance—plus RAID measurements of 11 attacks collapsing AI detectors, and Violet's integrity protocol.
Turn social and market signals into an ecosystem-growth, go-to-market, or technical engagement built around the work your team needs.
Explore engagements