I sensed anxiety and frustration at NeurIPS 24
Academic and Job Market Cycles
- Several compare AI/ML now to past booms in physics, “big data,” and crowdsourcing: hot fields can cool within a PhD timescale.
- Commenters expect a classic boom–bust or “cobweb” cycle: demand surges, training ramps up, then oversupply and correction.
- Others note this is common across degrees (including humanities) and not unique to AI; some emphasize that the world “owes you nothing.”
Nature of the Current AI Moment
- Distinction drawn between classic “AI winters” (funding and interest collapse) and today’s situation: rapid technological progress, but capital and hype concentrated on LLMs.
- Some foresee a correction as down rounds hit AI startups and ZIRP-era hiring unwinds, but doubt a full “winter” given LLM usefulness.
- Elite overproduction is raised: far more high-end AI talent than truly elite positions, especially as big labs dominate data and compute.
Conference and Research Culture
- Large conferences like NeurIPS are described as anxiety‑charged, job‑market‑driven, and hype‑oriented; smaller (~200‑person) meetings are seen as more scientific.
- NeurIPS is viewed as academically focused, while industry venues (e.g., KDD‑type) are more product‑oriented, often devolving into sales pitches.
Industry vs Academic Expectations
- Earlier “free lunch” industry research roles (high pay, near‑academic freedom) are seen as largely gone; product impact and standardization now dominate evaluations.
- Some argue PhDs should have expected this; others say advisors and programs implicitly oversold industry research freedom, which feels like a betrayal.
- Debate over whether one should do a PhD without academic aspirations; counterpoint: many industry research roles have required or strongly favored PhDs.
Research Directions and Compute Inequality
- Strong concern about “railroading” onto LLMs and massive models: other ML approaches and low‑TRL work are underfunded and hard to publish.
- Compute arms race noted: reviewers often demand experiments requiring A100/H100‑scale resources, effectively privileging industry labs and narrowing research diversity.
- Some attendees report most NeurIPS work felt niche or impractical; practically useful areas (tabular DL, RAG+LLMs, time‑series foundation models) were overcrowded.
Value of a PhD and Coping with Change
- A number of voices say the enduring value of a PhD is training in scientific method, communication, and problem‑solving, not any specific “hot” technique.
- Others worry that when undergrads/masters can do similar applied work, the marginal career value of the PhD “oomph” shrinks.
- Comparisons are made to robotics and self‑driving: as hype recedes, talent diaspora into adjacent fields may eventually boost innovation there.
Democratization, Capital, and Policy Ideas
- Many feel “Big Capital” now owns the field; promises of AI democratization are called a joke.
- A proposal to legally mandate open data and unpatentable AI tech is criticized as politically unrealistic and legally fraught due to data ownership and provenance.
Meta: Writing Style and Community Tone
- A surprisingly large subthread fixates on the article’s all‑lowercase style, which many find distracting or unprofessional; others dismiss this as trivial.
- Some comments reflect frustration with perceived entitlement; others push back, urging more compassion for students caught by rapid structural change.