Every Number Wears Its Source

“The numbers were good this month” is a sentence that can mean nothing or everything, and the difference is entirely in how the number was arrived at.

This month, a machine wrote my operating report. The business runs against bars a human set in advance, a daily target for the storefront channel, a daily target for the marketplace channel. Bars, not vibes: numbers you can beat or miss, agreed before the month starts. Both got beaten. Nice sentence. Also the least interesting thing about the report.

The interesting part is that the report graded the company, not the campaigns. Most dashboards hand you a wall of individually green metrics and leave you to assemble a verdict out of mood and caffeine. This one rolled the channels up against the bars and stated one answer to the only question an operator actually has: are we winning, and how do you know?, with the dashboards still available underneath when you want to argue with it. The unit of the verdict was the business.

But the part I’d tattoo on the industry is unglamorous: every row wore its source. A figure reconciled against a billing statement outranks a figure read off a platform’s own dashboard, which outranks a raw API pull, which outranks a number reconstructed from internal records. The report ranks the trustworthiness of its own sources and shows you the rank, so you can see not just the number but how much weight it can bear.

Why does that matter? Because the failure mode of every “AI did your reporting” pitch is a confident number with no lineage. And because the hierarchy isn’t decorative, it catches things. This month, two vendors’ numbers disagreed with their own bills. The discrepancies surfaced precisely because the billing rank sat above the API rank and the two didn’t match. A report that hides its lineage is asking to be trusted. A report that shows it can be checked.

Here’s the discipline I’m trying to hold myself to: not turning a good month into proof. Beating a bar is a good month. Good months happen to bad systems too. The claim that survives is narrower and more durable, the report was produced by a machine, it graded the company as a system, and every number in it traces to a ranked source. That stays true next month whether the bars are beaten or missed.

Which is the whole point. Anyone can build a scoreboard that flatters them. The trick is building one that would embarrass you on schedule.

The full field note is at thinkfigaro.com/notes/the-month-the-system-graded-itself.