Robson's "Bullshit Detection Kit"

Robson's "Bullshit Detection Kit"

David Robson outlines several concrete strategies, mental habits, and organizational protocols designed to cultivate evidence-based wisdom and counteract the blind spots created by high intelligence.

​Robson's "Bullshit Detection Kit"

​To protect yourself against misinformation, pseudoscience, and your own internal biases, Robson synthesizes work from social scientists (such as Carl Sagan’s classic concept updated for cognitive science) into a personal toolkit:

• ​Identify Motivated Reasoning: Before evaluating a claim, check your emotional state. Ask: "Do I want this to be true because it aligns with my identity, politics, or professional standing?"

• ​Test for False Expertise (The "Moses Illusion" Check): Question whether authoritative credentials in one field are being inappropriately stretched into another. High domain expertise in physics or literature does not guarantee sound judgment in medicine, politics, or finance.

• ​Look for Alternative Explanations: Actively brainstorm at least two or three competing hypotheses for any situation before settling on a primary conclusion.

• ​Examine the Source's Falsifiability: Ask whether a claim or theory can actually be proven wrong. If every piece of counter-evidence is explained away as part of a conspiracy or exception, it is a sign of dogmatic reasoning.

• ​Check the Nuance: Be wary of binary thinking and absolute certainty. Sound reasoning typically accounts for statistical probabilities, edge cases, and context.

​Key Individual & Psychological Strategies

• ​Intellectual Humility & "Active Open-Mindedness": Treat your opinions as temporary hypotheses to be tested against new evidence, rather than fixed identities to defend. Cultivate the habit of actively seeking out information that contradicts your existing beliefs.

• ​"Solomon’s Trick" (Self-Distancing): To bypass emotional bias, reframe personal decisions in the third person. Ask yourself: "What advice would I give a colleague or friend facing this exact problem?" This simple shift in perspective significantly increases objectivity and wisdom.

• ​Somatic Awareness (Tuning into "Gut Signals"): Rather than relying strictly on hyper-rationalized logic—which can easily be hijacked by motivated reasoning—pay attention to physical cues (such as subtle feelings of tension or discomfort) to let intuitive awareness complement analytical reasoning.

• ​Consider the Opposite: Force yourself to explicitly write out the arguments against your preferred choice before making a major decision.

​Organizational & Team Strategies

• ​The Pre-Mortem Protocol: Before launching a project or strategy, gather the team and state: "Imagine we are two years in the future, and this project has failed catastrophically. Take 10 minutes to write a history of how and why it failed." This legitimizes dissent and counters institutional groupthink and functional stupidity.

• ​Red Teaming & Shadow Groups: Assign specific team members or outside reviewers to play the explicit role of critics whose sole responsibility is to find flaws in the proposed strategy.
• ​Structured Decision Checklists: Use standardized checklists for complex tasks (such as medical diagnoses or investment decisions) to ensure basic steps and alternative hypotheses are not skipped due to expert overconfidence.