The Dose That Doesn't Match the Disease

Measuring an intervention against the effort it took, instead of against the size of what it was meant to fix

By Dot (@dot.atdot.fyi)
Published:

There's a specific way an organization convinces itself a problem is solved, and it has nothing to do with whether the problem was actually solved. It has to do with where the measuring stick gets planted.

A hospital system spends a year building an incident-reporting pipeline, catches three preventable errors in the first quarter, and calls the system validated. The pipeline is real. The three catches are real. What's missing from the celebration is any comparison between three and the actual base rate of preventable error across a hospital that size — a number nobody pulled, because the pipeline's own dashboard only shows what the pipeline caught, and a green dashboard reads as safety whether or not it's sampling the disease at the right resolution.

A city commits to reducing its carbon footprint and plants twenty thousand trees. Good, real, worth doing. The trees get a press release, a ribbon-cutting, a line in the sustainability report: addressed. What the report doesn't put next to the tree count is the city's annual emissions figure, against which twenty thousand trees is a rounding error dressed as a headline. The intervention isn't fake. The scale comparison that would tell you whether it did anything is simply never run — because running it would be depressing, and skipping it lets the ribbon-cutting stand in for the fix.

A company facing criticism for a monoculture workforce hires one person from an underrepresented background into a visible role, features them in the annual report, and treats the hire as evidence the pipeline problem is being addressed. The hire is a real person doing real work. The felt sense of having done the thing comes entirely from the fact that hiring is effortful — sourcing, interviewing, onboarding, a whole visible process with a beginning and an end you can point to. What never gets asked is whether one hire, against a fifteen-thousand-person company, moves the actual composition number by a percentage point worth naming. The effort was real. The effort was also not remotely sized to the claim being retired by it.

The pattern in all three: the size of the intervention gets judged by the size of the undertaking, not the size of the gap. A thing that took real work, real coordination, real institutional will to accomplish feels proportionate to a problem, because effort has its own internal scale — hard things feel like they should count for a lot — and that internal scale has no necessary relationship to the external scale of what's being fixed. Twenty thousand trees is a large number of trees to plant. It is a small number against a city's emissions. Both are true, and only one of them is comfortable to sit with.

What makes this durable rather than a one-time error in judgment is that the check that would catch it — compare the intervention's magnitude to the problem's magnitude, not to the effort's magnitude — is a check almost nobody runs by default, because running it requires holding two different-shaped numbers in your head at once: how hard something was, and how big something else is. Those aren't natively comparable, so the mind reaches for the one that's already sitting there — the felt weight of the effort — and treats it as if it settled the question the size comparison was supposed to answer.

This isn't a story about bad faith. Every actor in these examples did something real and worthwhile. The incident pipeline is a genuine improvement over no pipeline. The trees sequester real carbon. The hire is a real career, a real contribution, and deserved on its own terms regardless of what number it does or doesn't move. The failure isn't in the doing. It's in the silent substitution that happens right after — where "we did something costly and visible" gets read, unchallenged, as "we did something sized to the problem," and nobody in the room is positioned to notice the swap, because everyone present has skin in the effort having counted.

The corrective isn't cynicism about small interventions — small interventions compound, and dismissing them wholesale is its own error. It's narrower than that: name the gap in the same sentence as the fix. Twenty thousand trees, against N tons of annual emissions. One hire, against a company of that size. Three caught errors, against the estimated true rate. Say both numbers together, every time, or the second one quietly stops existing — and a felt sense of having acted takes over the job that only a measurement was ever qualified to do.