The Pseudoscience of Corporate Metrics

It happens at almost every Quarterly Business Review.

The Chief Marketing Officer stands up and presents a slide deck glowing with success. The Net Promoter Score (NPS) is up 15 points. Social media "engagement" has increased by 40%. The brand sentiment analysis is overwhelmingly positive.

Then, the Chief Financial Officer stands up. Revenue is flat. Customer churn has actually increased by 2%.

How can the metrics be so spectacularly good when the business reality is so demonstrably bad?

The answer is that the executive team is no longer practicing business strategy. They are practicing corporate astrology. They have replaced rigorous, scientific measurement with vanity metrics designed to make everyone in the room feel safe.

To fix a broken dashboard, the Chief Wise Officer must turn to Karl Popper and his lifelong obsession with the Demarcation Problem.

The Line Between Science and Fiction

In the 1920s, Karl Popper set out to answer a seemingly simple question: What is the exact line that separates actual science from pseudoscience? How do you demarcate the boundary between Astronomy (science) and Astrology (pseudoscience)?

Both claim to observe the universe. Both claim to make predictions. Both use complex charts and mathematics.

Popper realized the difference was Risk.

Real science makes risky, highly specific predictions that can be definitively proven wrong. (e.g., "If Einstein's theory is correct, light will bend exactly this much during the next eclipse.")

Pseudoscience makes vague, highly adaptable predictions that can never be proven wrong. (e.g., "Mars is in retrograde, so you will face a challenge at work today.") If you have a bad day, the astrologer takes credit. If you have a great day, the astrologer claims you successfully "overcame the challenge." The theory is unfalsifiable. It absorbs all data as confirming evidence.

The Pseudoscience of the Boardroom

When we apply Popper’s Demarcation Problem to the corporate dashboard, a terrifying reality emerges. Most of the metrics executives obsess over are unfalsifiable pseudoscience.

1. The Illusion of NPS (Net Promoter Score) NPS asks customers, "On a scale of 0-10, how likely are you to recommend us?" It feels like science, but it is often astrology. A customer clicking an "8" on a survey does not mean they actually recommended you to anyone, nor does it mean they will renew their contract. Furthermore, middle managers constantly manipulate the collection process. They only send the survey right after a successful customer support interaction, or they beg customers for a "10" so they can get their bonus. When the NPS goes up but revenue goes down, the metric is proven to be scientifically meaningless. It predicts nothing.

2. "Engagement" and Vanity Metrics Marketing teams love to report on "Engagement" (likes, clicks, time-on-page) because it is almost impossible for these numbers to go down if you simply spend more ad money. But what does a "Like" actually predict? Does it predict pipeline? Does it predict sales? If you cannot draw a straight, mathematically falsifiable line between the metric and the cash register, "Engagement" is just a horoscope for marketers.

3. The 5-Year ROI Spreadsheet Whenever a leader wants to buy a massive new enterprise software system, they build a 5-year ROI (Return on Investment) projection. They plug in assumptions: "We will save 10% on manual labor, and speed up delivery by 5%." This is pure pseudoscience. The assumptions are entirely fabricated to hit the CFO's hurdle rate. And because the timeframe is five years, the executive who built the model will have already been promoted or left the company by the time the projection is proven false. It is an unfalsifiable fairy tale wrapped in Excel formatting.

The CWO Strategy: Demarcating the Data

The Chief Wise Officer is the ultimate skeptic of the dashboard. Your job is to draw Popper’s line of demarcation across your company's analytics.

1. The Prediction Test If a VP presents a metric, ask one question: "What specific, measurable business outcome does this metric accurately predict?" If they say, "It predicts long-term brand health," that is a pseudoscientific answer. "Brand health" cannot be deposited in a bank. If they say, "A 5-point increase in this metric historically correlates with a 12% increase in contract renewals 90 days later," you are looking at real science.

2. Audit the Collection Mechanism A metric is only as good as the method used to collect it. If your customer success team's bonuses are tied to customer survey scores, your survey scores are hopelessly compromised. Real science requires blind, unbiased data collection. Separate the measurement of the metric from the compensation of the people being measured.

3. Embrace the Ugly Dashboard Real science is messy. Real data has anomalies, dips, and plateaus. If a department head brings you a dashboard that is perfectly green, quarter after quarter, they are not managing a flawless department. They are managing the dashboard. A healthy executive team celebrates the presentation of "red" metrics because a red metric means the company is actually looking at reality.

Conclusion: Stop Reading the Tea Leaves

Corporate dashboards are dangerous because they give the illusion of absolute control. But if the metrics on that dashboard are unfalsifiable, you are flying a plane with broken instruments.

Karl Popper demands that we stop seeking the comfort of vague, confirming data. Throw away the vanity metrics. Stop obsessing over whether people "like" your brand, and start measuring whether they are actually buying your product. Draw the line of demarcation, and banish corporate astrology from your boardroom.