When AI Builds Itself: Our progress toward recursive self-improvement
Anthropic’s claim that its AI systems are moving toward “recursive self‑improvement” — exemplified by large gains in AI‑assisted code output and partially autonomous coding agents — is met with equal parts curiosity and skepticism. Commenters question the reliability of lines‑of‑code productivity metrics, point to Anthropic’s own buggy tools and outages, and see the timing as IPO‑oriented hype rather than proof of imminent AGI. Many also worry that calls to “pause” frontier AI double as a bid for regulatory capture, arguing that open, democratized AI and hardware limits may matter more than self‑reported advances in self‑improving models.
Perceived Motives and IPO Context
- Many see the piece as timed marketing ahead of Anthropic’s IPO: “warming up for that IPO,” “puff piece,” “self‑hyping.”
- Some think the call for an AI slowdown is partly about shifting from expensive training to more profitable inference and raising entry barriers (“cartel,” “regulatory capture”).
- Others argue Anthropic’s leadership is at least partly sincere about risks, but still trapped in a race dynamic.
Recursive Self‑Improvement (RSI) Claims
- Several readers feel the title overpromises: the article mostly describes AI‑assisted coding, not genuine RSI.
- Distinction is drawn between:
- Harnesses/agents that write more code and refactor.
- True RSI where models design new architectures, training runs, and meaningfully improve capabilities.
- Some argue current transformer‑based systems may never support “full foom” RSI; others think current auto‑research workflows are early evidence.
Productivity Metrics and Lines of Code
- Anthropic’s “8× more code shipped” metric is widely criticized.
- Points raised: AI code is often verbose, boilerplate-heavy, and may inflate LOC without real value.
- Several note that high‑quality work often corresponds to fewer lines; “negative LOC” is cited as ideal.
- Some suggest commits or validated features would be better metrics than LOC.
Code Quality and AI Slop
- Multiple anecdotes of huge AI-generated PRs (tens of thousands of LOC, hundreds of files) that are unreviewable and often low-quality.
- Others report real, large gains in personal productivity and better test coverage when using AI carefully with human oversight.
- Consensus: AI can be powerful but easily produces bad abstractions, fragile complexity, and requires disciplined review.
Claude Code and Infrastructure Complaints
- Heavy criticism of Claude Code’s engineering: high RAM/CPU usage, flickering TUI, React/”small game engine” architecture for a terminal app.
- Frequent mention of outages, throttling, inconsistent metering, and weak support channels; some say this undermines claims of engineering excellence.
- A minority report acceptable reliability and suspect some complaints are exaggerated.
Regulation, Pause, and Safety
- Some welcome Anthropic’s talk of coordinated slowdowns as buying “breathing room.”
- Many others see it as self-serving: big labs asking to freeze the frontier once they have a lead, while smaller/open players are constrained.
- Comparisons made to nuclear arms control and to industries that say “use responsibly” while lobbying against strict rules.
Economic and Social Impacts
- Debate over whether AI will:
- Massively concentrate power and capital in those who control frontier models.
- Or democratize capability by giving individuals huge leverage.
- Skeptics expect accelerated inequality and limited benefit for non-owners; enthusiasts foresee radical productivity gains and new forms of work.