Google Books Is Indexing AI-Generated Garbage
Shadow libraries and preservation
- Shadow libraries (e.g., Anna’s Archive, LibGen) are praised as critical cultural infrastructure, preserving books that are otherwise inaccessible or effectively lost.
- Some argue they will resist AI pollution because access is curated by a small set of librarians, not open upload.
- Others counter that if your goal is “everything,” you’ll inevitably ingest AI garbage too; these libraries already contain low-quality scans and OCR errors.
- There’s concern that shutting these down would be culturally catastrophic, likened to a modern Library of Alexandria loss.
Curation, gatekeeping, and business angles
- Several suggest Google could protect tools like Ngram by limiting to known/non-vanity publishers.
- This revives debate over “gatekeeping”: some distinguish harmful exclusion from necessary quality control.
- Others see a future business niche in human-verified, AI-free content, while critics dislike framing AI’s harms as “opportunities.”
AI training on AI output (“model collapse”)
- Multiple terms discussed: model collapse, MAD (Model Autophagy Disorder), “Habsburg AI,” “Malkovich effect,” “inbred AIs,” and Kessler-syndrome analogies.
- Concern: as AI-generated text floods the web and gets reused as training data, quality degrades in a positive feedback loop.
- Some suggest giving models real-world interaction and active learning to mitigate this; others note current systems can’t truly do that and updates remain externally mediated.
Value and verification of pre-2021 data
- Pre-LLM text is likened to “low-background steel”: increasingly valuable as uncontaminated training data.
- Skeptics ask how non-AI provenance can actually be verified, pointing out that timestamps and dates can be faked and web indices often trust page metadata.
- Trusted archives (Internet Archive, newspaper archives, large crawls) are proposed as partial solutions, but there’s worry these are controlled by a few large actors.
Quality, trust, and AI language fingerprints
- Many report rising distrust of post-LLM online content; more vetting is required.
- People note recurring LLM phrasings (“it’s worth noting…”, “complex and multifaceted…”) as current shibboleths for AI text, though these can and do evolve.
- Some see future “human-only” subcultures and media islands as a necessary response.
Debate over whether LLMs are truly “AI”
- One camp views LLMs as sophisticated lossy compressors / autocomplete systems lacking real understanding, creativity, or initiative.
- Another argues that compression is fundamentally tied to intelligence and that querying a vast latent space of human text is already a meaningful kind of “artificial intelligence,” just not omniscient or autonomous.
- There’s disagreement on definitions: some reserve “AI” for systems with agency or general intelligence; others accept current LLMs as AI but not AGI.
Archiving, Google, and coping strategies
- Commenters highlight data hoarding and personal archiving (PDFs, local text) as increasingly important as online content degrades or disappears.
- Some suspect Google Books persists less for public service than as a training-data asset, and they doubt Google will transparently filter AI books.
- Donations to independent archives are suggested as a concrete response.