Humanity isn't ready for the coming intelligence explosion

Perceived (In)Accuracy of AI “Experts”

• Many argue recent high-profile predictions (e.g., rapid loss of most white‑collar jobs) were exaggerated or walked back, questioning who counts as an “expert.”
• Others counter that some forecasters (e.g., “AI 2027” style timelines) have been surprisingly close on acceleration, nationalization pressure, and agentic tools.
• Some say there are effectively no experts yet: timelines are short, experience is limited, and incentives (funding, hype, regulation) distort forecasts.

Pace and Nature of AI Progress

• One camp sees progress as extremely fast in absolute terms: stronger models, agents, coding tools, and benchmark gains.
• Another camp emphasizes slower-than-hype “unsupervised utility,” persistent hallucinations, weak long‑horizon planning, and benchmark gaming.
• Several comments highlight that user learning (prompting skills) is often mistaken for model improvement.

Automation of Coding and White‑Collar Work

• Strong claims: many programmers “no longer write code,” AI can implement anything describable, and 50% of entry‑level white‑collar jobs may be at risk within a few years.
• Pushback: serious engineers still write substantial code, AI output needs heavy review, and cargo‑cult devs have always “not really coded.”
• Some report personal 10–100x productivity gains; others say AI is mostly a better search tool.
• Disagreement on whether non‑coders are catching up or falling further behind.

Recursive Self‑Improvement (RSI) & Superintelligence

• Doomers: closed‑loop RSI could trigger an “intelligence explosion”; AI might invent better algorithms, hardware, and coordination, outstripping humans.
• Skeptics: training costs, compute limits, need for physical experiments, and current agent brittleness make fast RSI “sci‑fi” and likely decades away, if ever.
• Some argue Fermi’s paradox weakly constrains AI‑takeover scenarios; others say space’s vastness makes it non‑informative.

Governance, Regulation, and Power

• Debate over whether AI labs are sincerely warning about risk or strategically hyping danger to shape regulation and secure moats or state-like power.
• Suggestions include US–China agreements, international forums, and treating AI labs as future co‑governors akin to big banks.
• Many doubt current governments can coordinate meaningfully, given geopolitics and incentives.

Societal & Economic Risks

• Widespread concern about job displacement, a permanent underclass, and AI‑driven “enshittification” of products and media.
• Some see AI mainly as another powerful but bounded technology; others view it as a qualitatively new “intelligence substrate” that existing institutions are not ready for.