AI: Markets for Lemons, and the Great Logging Off (2022)

Detectability of AI Content

• Some argue current LLM and image outputs are still easy to spot due to “GPT-isms,” overly polite tone, and generic structure.
• Others counter that this mainly reflects the default ChatGPT style; with adjusted prompts, errors, and style transfer, AI text can become indistinguishable from average users.
• Several note selection bias: people see the bad fakes and overestimate their own detection skill.
• A minority says they now assume everything is “likely fake unless proven genuine.”

Scale and Effects of Bots / “Dead Internet”

• Many believe large platforms (Twitter/X, Reddit, Facebook) are already heavily saturated with bots and AI “slop,” especially in comments and low-quality viral content.
• Some mention “lurker/creator” ratios: even if much is bot-made, there are still huge human audiences passively consuming it.
• A few are mostly insulated by only interacting with known accounts or smaller communities.
• Concern that spammy AI content can still be profitable at thin margins and that bad content can prime users to trust “good” fake or manipulative content.

From Open Seas to Fragmented Silos

• Multiple commenters describe moving off big “open sea” networks (FB, Twitter, Reddit) toward smaller silos like Discord, forums, and HN.
• Reasons: algorithmic junk, low signal-to-noise, brigading, and obvious bots.
• Some see this as a reversion to pre–mega-platform internet: many smaller communities with clearer culture, curation, and intent.

AI Companions and Social Consequences

• Strong concern about LLM-based “best friend”/romantic companion apps as predatory toward lonely people, potentially causing “genetic dead-ends” as users satisfice with bots instead of human relationships.
• Others think this effect is overstated, noting many people have always been voluntarily asexual or socially isolated.
• Some say real human relationships have become optional and often more costly and less “fun” than purely digital ones; they would gladly bond with robots if/when they become engaging enough.

Attention, Enshittification, and “Logging Off” Limits

• Several see AI as accelerating an already-existing attention economy problem driven by advertising, status, and engagement metrics.
• Some hope AI will be the moment the internet “jumps the shark” and pushes people back to offline life or more grounded communities (including religious ones), though others counter with declining overall church participation.
• Others argue a true “Great Logging Off” is impossible because core services (banking, government, news, healthcare) are now irreversibly online.

Economics, Governance, and Defenses

• Debate on whether AI costs will fall enough to flood everything, versus rise once VC subsidies end.
• Noted early disruption in translators, illustrators, subtitlers, customer support, and bureaucratic form review.
• Some expect new defensive tools (better spam filters, LLM wrappers that block jailbreak-style prompts), but details remain unclear.
• Concerns that verification schemes (“real humans only”) often demand sensitive personal data and recreate power imbalances.
• Discussion of Meta’s incentives: if open models fuel spam that degrades social products, its AI strategy may need to change, but motives are seen as mixed and unclear.