My falling-out with the rationalist community

Original Article ↗ Hacker News Discussion ↗

Critiques of the Bay Area–centric “rationalist” and effective altruist milieu center on claims that a movement built around overcoming bias and reasoning from first principles often incubates fringe or cult-like offshoots, from AI doomsday scenarios to groups like the Zizians. Commenters argue over whether these are rare aberrations in an otherwise self-correcting, intellectually diverse community, or predictable outcomes of a subculture that prizes abstract reasoning, identity around being “less wrong,” and high-decoupling argument styles while underweighting emotion, social context, and its own susceptibility to motivated reasoning.

Overall reaction to the article

  • Many see the post as emotionally charged, culture-war–tinged, and light on concrete engagement with actual rationalist writing or practice.
  • Others think it captures something real about “word games,” cosplay-intellectualism, and motivated reasoning in the community.
  • Several readers felt the ending was abrupt; some argue the “break” was the realization that rationalist argumentation felt like a pointless game.

Bias, cult dynamics, and “wacky offshoots”

  • Critics say rationalist/EA spaces incubate extreme or cult-like offshoots (Zizians, Leverage Research, some AI/x‑risk beliefs), not just ordinary bias.
  • Some argue there is a philosophical throughline from mainstream rationalist ideas to these offshoots; others say the offshoots are fringe misfires among many mostly normal participants.
  • Debate over whether a higher concentration of “5% lunatics” in such communities is itself damning.

Defenses of the rationalist community

  • Supporters emphasize:
    • Aspirational focus on questioning beliefs, Bayesian reasoning, empiricism, and internal criticism.
    • Ideological diversity on many axes (politics, relationships, AI views).
    • The intent not to build an identity or dogma around being “rational.”
  • They argue critics overgeneralize from outliers, commit outgroup-homogeneity errors, and misuse examples like Roko’s Basilisk.

Cult / religion comparisons

  • Detractors say rationalism functions like a secular religion: in‑group identity, certainty of being “less wrong,” special jargon, charismatic founders, and schisms.
  • Some note that defenses of “fundamental axioms of reasoning” can sound indistinguishable from religious or scientology-style apologetics.
  • Others counter that basic math/probability (e.g., Bayes’ rule) being undeniably true doesn’t make the project cultish.

Limits of rationality and first-principles thinking

  • Several argue that aggressive first-principles reasoning, detached from tradition and lived constraints, easily snowballs into bizarre ethics (e.g., extreme population ethics, shrimp welfare).
  • Others stress that real-world truth-finding is empirical, approximate, and messy; “provable” certainty is mostly confined to math.
  • There is discussion about underweighting emotions, social context, and human limitations versus the ideal of detached reasoning.

Power, demographics, and social dynamics

  • Some highlight that many rationalists are young, highly online, educated white men, which shapes blind spots (e.g., around race, gender).
  • Concerns raised about overlap with EA, tech wealth, and the potential for concentrated resources plus moral certainty to be dangerous.
  • A few note that falling for cult-like movements is common and that recognizing one’s own susceptibility is important.