AI firms mustn’t govern themselves, say ex-members of OpenAI’s board

Original Article ↗ Hacker News Discussion ↗

AI Hype, Market, and Real Utility

  • Several commenters see current AI investment as a bubble, with most startups overfunded and overhyped; Nvidia is viewed as the main clear beneficiary.
  • Others argue there are real “sticky” use cases and that markets will eventually correct toward better products, though total addressable markets are likely overstated.

Who Should Govern AI

  • Strong pushback against pure self-governance by AI firms; many argue no company should regulate itself, citing general corporate behavior.
  • Disagreement over whether boards are enough, or whether governments must ultimately oversee.
  • Some propose hybrid or industry-body models (e.g., FINRA-style self-regulation under state authority, professional orders, ratings boards) as a template.

Regulation: Competence, Capture, and Scope

  • Widespread worry that governments lack technical understanding and are vulnerable to lobbying and regulatory capture, entrenching big incumbents and freezing out smaller entrants.
  • Others counter that this article explicitly warns about capture and that modern states routinely regulate complex tech via expert agencies.
  • The EU AI Act and GDPR are debated: some say companies adapt and move on; others claim such rules shift investment away from Europe and burden smaller players.
  • A recurring view: existing laws (privacy, consumer protection, IP, torts) cover most harms, so AI-specific regulation risks being mostly theater or protectionism.

AGI, Existential Risk, and Sentience

  • Many treat AGI/x‑risk talk as marketing or sensationalism; they doubt LLMs can “scale to AGI” and see more mundane economic and energy concerns as central.
  • Others argue that if AGI is plausible, current labs resemble privatized Manhattan Projects and need strong external control.
  • There is debate over whether sentient or sapient AI will ever exist, and if so, whether “AI slavery” would become an ethical issue.

Concrete Harms and What to Regulate

  • Suggested targets: life-or-death decisions, AI-assisted bio/chemical weapons, autonomous weapons, large-scale propaganda and deepfakes, and privacy abuses.
  • Some note that regulation will likely exempt national security and military uses, so state-backed development continues regardless.

Intellectual Property, Commons, and Open Models

  • Many are more worried about cultural enclosure than AGI: large firms scraping “all of culture,” training proprietary models, then paywalling outputs.
  • Proposed remedies include: requiring model release if trained on public/unlicensed data; limiting exclusive ownership rights over models built on public corpora.
  • Others argue there’s weak legal basis for treating training as copyright infringement and that some “AI safety” narratives help justify enclosure.

Trust in Current Actors

  • Skepticism toward both tech CEOs and governments is pervasive; some see former OpenAI board members as power-seeking or incompetent in the Altman episode.
  • Others, having reconsidered that episode, think the board may have been right about risk even if execution was poor.
  • Overall mood: high distrust of all power centers, concern about regulatory capture, and no clear consensus on a workable, trustworthy governance regime.