BLOG

Complex questions tempt infinite slicing. Start by defining the core contrast that actually answers the decision question. If extra categories blur the picture, collapse them thoughtfully (with a note explaining how). You’ll reveal the signal that stakeholders can act on. Then, and only then, add nuance back selectively: re-expand categories where stakes are high, where […]

Evidence is contrast. Every “yes” needs its “no,” every success its failure, every win its baseline of total attempts. Rates require denominators, and patterns require counter-patterns. Drop the “other half” and the tallest bars will always seduce you into over-reading. Keeping both sides also surfaces asymmetries that matter for action: maybe the success rate barely

Data doesn’t make decisions… people do. Flip the order. First: What decision will this inform right now? Next: What specific outcome would make us choose A over B? Then: What evidence would change our mind the other way? When you anchor analysis to a fork in the road, you automatically narrow the variables, shrink the

One-Tailed On Purpose  Sometimes the direction doesn’t matter… distance does. How far from “what we’d expect” are we? That’s the question. Deviation is the story. In a noisy world, clarity is leverage. Measure the gap. Then decide what to do about the gap. Expected ≠ Equal Your baseline isn’t always “all is equal”. Sometimes the

Systems create outcomes on purpose… or by default. Cutoffs, criteria, calendars: quiet levers. Think you’re being neutral? You’re probably cementing the status quo. Start with the base rate. Compare observed to expected. If the mismatch is systematic, adjust the rules. Band by age. Rotate gates. Audit selections. Build ladders, not just leaderboards. Fair doesn’t mean

Cryptic labels waste cognition. Human labels return it. “Group A” is fog. “Early-season cohort” is a map. Same data, different friction. Communication is part of the method, not an afterthought. If you want people to reason well, lower the decoding cost. Name variables so a beginner can argue with them. Because argument is learning. And

Ever run the right test on the wrong categories? It looks rigorous. It isn’t. Buckets are arguments in disguise. Lumpy bins make lumpy answers. Before you analyze, ask: what does each label assume? Do my groups mirror reality… or convenience? Align categories to the mechanism you care about. Then press “go.” Clean categories create clean

What if success starts with a calendar… not capability? A line in the sand. Older on one side. Younger on the other. Tiny advantages masquerading as talent. Are we measuring skill… or timing? Data can tell you. Compare what you saw to what you’d expect if timing didn’t matter. When those don’t match, the story

Significance is a siren. Residuals are a flashlight. Big picture: “something differs.” Cell by cell: “this is where.” Overrepresented. Underrepresented. That’s the texture of truth. Don’t stop at the headline. Trace the imbalance to its cause. What rule, habit, or policy would produce exactly this pattern? Change that… not everything. Precision beats drama. Want better

One-sentence test choice  Write the test you’ll use in one sentence that a smart non-statistician would accept. If you can’t, you’re not ready to analyze. Direction audit  State your directional hypothesis on paper. Circle the observation that would make you retract it. If you can’t find one, you don’t have a hypothesis… you have a preference. Ambiguity