Tell NYT, Atlantic, USA Today to keep Wayback Machine

Original Article ↗ Hacker News Discussion ↗

Business incentives vs. public access

  • Many argue that blocking the Wayback Machine is short‑sighted: archival access builds credibility, citations, and long‑term influence, even if it doesn’t generate direct revenue.
  • Others note that news orgs see archives as monetizable back catalogs (sold to libraries, etc.) and want control, including the ability to silently update or retract pieces.
  • Some commenters say they’ll simply stop reading outlets that block archives, but others respond that these outlets still shape public discourse and thus need to be preserved.

Paywalls, traffic, and conversion

  • Debate over whether archival access undermines subscriptions:
    • One view: reading via archives bypasses ads, tracking, and paywalls, so it “steals” pageviews.
    • Counterpoint: easy sharing plus occasional bypasses leads some readers to eventually subscribe; if links are unreadable, attention shifts to accessible competitors.
  • Per‑article micropayments are raised as a theoretical solution, but prior attempts are cited as commercial failures.

Archiving, truth, and revision history

  • Strong concern about historical record: libraries have long preserved newspapers on microfiche; blocking web archiving is seen as accelerating a “digital dark age.”
  • Archiving is valued for tracking corrections and stealth edits; without it, publishers can rewrite history.
  • Some propose compromises: delayed release (e.g., 30‑day or 1‑year embargo), or rate‑limited archive access.

Robots.txt, IA policy, and AI scraping

  • Confusion and disagreement over whether the Internet Archive honors robots.txt:
    • Some say it respects it; others link to IA statements and personal experience claiming it is increasingly ignored, at least in some cases.
  • One argument: publishers fear that if IA mirrors their content, AI scrapers can bypass their anti‑scraping measures via the archive.
  • Others respond that LLM companies already ignore robots.txt and can scrape directly, so blocking IA mainly harms human access, not AI training.

Media trust, independence, and alternatives

  • Skepticism toward legacy outlets (NYT, Atlantic, USA Today) is common; some see them as ad‑driven, biased, or “pro‑war,” and prefer wire services, primary sources, or independent journalists.
  • Others defend subscriber‑funded, less ad‑dependent outlets as generally higher quality than ad‑only sites.
  • Alternative tools and futures: archive.today, distributed or cryptographically verifiable archives, and patronage/foundation‑style funding for serious journalism.