Media measurement

One number is a guess. A range is an answer.

MMM Studio measures what your media actually did, then reports the range the data supports — not the midpoint that reads best in a deck. When a method can’t answer, it says which one would.

0:00

The film is an illustration, and the figures in it are examples. Every figure on the rest of this page is from a real fit.

Read the film instead
  1. 1. Your data

    Bring one spreadsheet: what you spent each week, and what you sold. So what did $50M of advertising actually do?

  2. 2. The check

    First it checks whether your data can answer that. Good to model, with two caveats.

  3. 3. The fit

    Then it tries 4,000 plausible answers per channel, in four separate runs. The runs agree. Where the answers pile up is your range.

  4. 4. One number

    Most reports boil that down to one number per channel. One number is a guess.

  5. 5. The range

    A range is an answer. Break-even is $1 back for every $1 spent. Only Paid Search clears it from end to end.

  6. 6. The decision

    So you get the one move your data supports. And a straight answer on what it can't call.

  7. 7. The refusal

    And when your data can't answer at all? Here, two Search channels always ran together. Nothing can split the credit. So the numbers come off the screen. Removed, not greyed out. And it tells you what would fix it.

  8. 8. The point

    One number is a guess. A range is an answer.

Two real runs

Same product. Same screen. Two honest answers.

On the left, a fit you can act on. On the right, one you can't — and the screen says so instead of dressing it up.

national_demo · 208wGood to model
Return on investment, by channel

Ordered from the channel your data pins down best to the one it pins down least. Each bar is the range the data supports, with a 90% chance the return is inside it; the notch is the middle estimate. Watch the bars widen down the list.

TV — Broadcast
$1.60
0.56 – 3.25
Out of Home
$0.84
0.24 – 2.13
01.0 break-even34

What it will say

No channel here paid for itself across its whole range. That is a finding, and it is the one the chart above supports.

What it won’t say

Which of the rest did best. Their ranges overlap and cross break-even. Any ranking would be ours, not your data’s.

hard_case · fit withheldDon't model yet
Return on investment, by channel

The return column has been removed, not greyed out.

The four searches did not quite agree.Chain convergence (R-hat)should be 1.011.23
It did not look long enough.Bulk effective sample sizeshould be 40013.04
The edges of the ranges are not settled.Tail effective sample sizeshould be 40016.41
Some of your channels ran too closely together to be told apart.Variance inflation (post-transform)should be 55,171
The answer wobbles — one week of spend moves the whole result.Design conditioningshould be 30216.32

Why you are seeing this

These are the checks the fit failed, named rather than scored. This is the screen that decides whether a measurement tool is trustworthy, and it is the one nobody demos.

Not one method

The right method for the question you're asking.

A mix model answers some questions well and others not at all. Rather than stretch one method over everything, we gate honestly and tell you which method your question needs.

Live now
What did my media do?
Bayesian mix model

What each channel added, what it returned and how long its effect lasted, each with its range. Runs on two years or more of weekly spend and sales data.

Live now
Is my media getting less effective?
Year-by-year returns

Each channel's return fitted year by year, with its range, instead of one number for the whole window. It needs most of a year of spend in each year. When your data falls short of that, it says so and reports the average.

Needs a test
Would spending more actually work?
Geo holdout experiment

Past data can't prove this on its own. It takes a test: your ads run in some regions and are held back in others. We design it and feed the result back into the model.

Needs price data
How much of this was price, not media?
Price and promotion elasticity

Without weekly price and promotion data, media gets the credit for their effect and every channel looks better than it is.

In plain English

The questions it answers — and the ones it hands back.

Did TV pay for itself?Can we separate Search from Social?What happens if I cut Out of Home by 30%?Where is the next pound best spent?Which channel is best? — we won't rank these
How long does TV keep working after a burst?Am I saturating Paid Social?Will this work next quarter? — needs a testWhat would tighten these intervals?Can I hit last year's revenue on 10% less?

The house rule

A number appears only if the model computed it.

It applies to our own screens as much as to your media. No score out of 100, no “7 of 9 checks passed”, no “high confidence” label on a sentence nothing measured.

Shown twice
how well the model predicts

A model always looks good on the weeks it learned from. So that score never appears alone: it comes with the score on weeks the model was never shown.

No score
whether your data is ready

You get a verdict — good to model, model with caveats, or don’t model yet — with each problem named. A score is something you chase. A named problem is something you fix.

As found
when your data disagrees with us

Sometimes your data leaves a channel less certain than our starting assumption did. You see that exactly as it came out, never rounded to “no change”.

Removed
when the model can't settle

If the model can’t settle on an answer for a channel, its number comes off the screen. A greyed-out number still tells you roughly how big it is, and that is the one thing nobody knows.

Show me the statistics behind these

Shown twice. r² on the weeks the model learned from: 0.901. No weeks were held back on this fit, so there is no second figure to show.

No score. Readiness returns one of three verdicts and the findings behind it. There is no figure to quote, which is the point.

As found. Lowest contraction on the first run: 0.898, on Out of Home. Below zero means the range after the fit is wider than the one assumed before it. It is never clamped to zero.

Removed. No withheld fit in this installation to quote.

How each of these is computed

Brand manager

A go/no-go you can defend in the meeting.

Verdicts in plain English, one recommended action, and the reason it's recommended written out. No statistics vocabulary required to use it, and none hidden from you either.

Analyst

Every figure traceable to the draw it came from.

Posterior densities, VIF, R̂, ESS, contraction, holdout backtests and response curves — exposed rather than summarised away. Every headline figure deep-links to its method chapter.

Agency lead

A plan that survives the client asking “how sure?”

Scenario compare, an efficiency frontier, and a one-page readout that carries its own caveats — so the difficult question is answered on the page before it's asked out loud.

Find out whether your data can answer the question.

Readiness runs before any model does, and it’s free. If the answer is “not yet”, you’ll get the list of what to fix rather than an invoice.