What does Alan Kay think about LLMs?

Overall stance on LLMs and “trustability”

  • Central concern: LLMs are not “trustable” for running commands or teaching, because they don’t reason, only correlate and generate plausible text.
  • Trust is linked to auditability: people want verifiable chains of reasoning, explainable decision paths, and reproducible results.
  • Current LLMs can’t show how they derived an answer beyond vague token attributions, so they’re seen as unsuitable for critical tasks.

Message passing, late binding, and system design

  • Large subthread revisits classic ideas: true message passing, late binding, and live, image-based systems (e.g., Smalltalk-style environments).
  • Debate over whether modern systems (HTTP, microservices, browsers) embody these ideas well or are “bastardizations”.
  • Some argue message passing significantly improves security and scalability; others note microservice messiness and need for stronger typing.
  • There’s disagreement on whether Alan’s guidance is too vague or actually quite concrete when you look at his systems and research programs.

LLMs in programming and education

  • Power users report LLMs as very useful but frequently wrong, especially in less popular languages or niche libraries.
  • “Obvious” errors (invented APIs) are easy for experts to catch; subtle ones (deprecated, insecure, or inefficient patterns) are dangerous for learners.
  • Concern that students will “cheat” through CS curricula with LLMs, further exposing how dated some teaching already is.
  • Some like that traditional programming is literal and debuggable; they fear opaque AI layers undermine this transparency.

Epistemology: correlation, superstition, and BS

  • Strong theme: LLMs exemplify “reasoning by correlation,” likened to superstition and BS generation, especially when they rationalize wrong answers fluently.
  • Counterpoint: correlation-based empiricism can still be testable and useful; superstition arises when people misread or overinterpret correlations.
  • Several comments note humans are also unreliable, biased, and prone to BS, so comparisons must be against actual human experts, not an ideal.

Societal and economic concerns

  • Worry that LLMs will be used to “strip mine society” more efficiently, increasing extraction, surveillance, and large-scale manipulation.
  • Others argue this dynamic predates LLMs and applies to most major technologies; LLMs are just a new lever.
  • Additional fear: a future internet flooded with semi-plausible nonsense, eroding trust in digital information and possibly even literacy norms.