Banning open weight models would be a disaster

Awareness and Process

  • Several commenters only learned of the NTIA/DoC open‑weights RFC after the comment deadline, and felt it had little media or HN visibility.
  • Some attribute this to dense legal language, news-cycle overload, and public apathy; others suspect that “boring” framing hid a major policy shift.

Free Speech, Law, and Constitutionality

  • One camp argues model weights are expressive like source code and so bans would violate the First Amendment, citing 1990s encryption precedents.
  • Others counter that weights are machine‑generated numbers, not human-authored “speech,” so protection is less clear.
  • Legal discussion notes that even if weights are speech, content‑neutral restrictions (e.g., on parameter size) might survive “intermediate scrutiny,” whereas content-based “safety standards” (e.g., blocking hate/disinformation) likely would not.
  • There is skepticism that the current Supreme Court will reliably protect rights when money and power are at stake.

Safety, Misuse, and Comparisons (Nukes vs. Encryption)

  • Supporters of restrictions liken frontier models to nuclear tech: huge “blast radius,” potential for disinformation, deepfakes, and scalable scams.
  • Opponents say this is overstated: current LLMs are more like lossy Wikipedia and autocomplete; harms are real but not existential.
  • Encryption analogy: many see open weights as the new crypto wars; others argue AI uniquely undermines trust and thus is not comparable.

Regulatory Capture and Power Centralization

  • Strong concern that bans would entrench large US labs and cloud providers, giving them monopolies and surveillance leverage.
  • “Please regulate us” statements from big labs are widely viewed as self‑serving, aiming at regulatory capture rather than genuine caution.
  • Some warn closed models enable unaccountable manipulation, since users cannot inspect or control the systems shaping information.

Practicality and Geopolitics

  • Many argue bans are unenforceable: weights fit on hard drives, can be torrented and mirrored abroad; US would need China-style controls or even extreme measures (e.g., tracking GPUs, attacking “rogue” data centers).
  • Others note US/EU control talent, TSMC/Nvidia pipelines, data, and institutions, so restrictions could still significantly slow open research.
  • There is debate whether global coordination is realistic; some expect non‑Western countries to ignore bans and gain advantage.

Copyright, Training Data, and Fair Use

  • Disagreement over whether model weights are derivative works of training data or even copyrightable at all.
  • Some argue open models built on copyrighted corpora are likely fair use; others emphasize that copyright and derivative-work doctrine are already stretched and contentious.