DeepSeek could represent Nvidia CEO Jensen Huang's worst nightmare
Claims that Chinese AI model DeepSeek could threaten Nvidia’s dominance have triggered debate over how much its efficiency gains really matter for the GPU giant. Commenters argue that while DeepSeek shows cutting-edge models can be trained far more cheaply and may reduce the need for ever-larger Nvidia training clusters, overall demand for AI compute and Nvidia’s CUDA-based ecosystem remain strong. The conversation also highlights geopolitical angles, questions about overhyped market reactions, and a broader shift from brute-force scaling toward smarter algorithms and systems-level optimization.
Market reaction and perceived irrationality
- Several comments note there was little reaction to DeepSeek-V3 or R1 themselves, but a sharp reaction once a consumer-facing app appeared, seen as evidence of shallow, narrative-driven markets.
- Some argue this “signals money on the table” for those who paid attention to the underlying tech earlier; others say timing lags are normal (e.g., COVID).
Jevons paradox, efficiency, and Nvidia’s valuation
- Jevons paradox is heavily debated:
- One camp: greater efficiency in model training/inference will increase total compute use (and thus GPU demand).
- Another camp: Jevons applies to compute in general, not to Nvidia’s profits or growth specifically; high margins and growth expectations are what got repriced.
- Some stress that even modest downward revisions in long-term growth assumptions can justify large market-cap drops.
Is DeepSeek bad or good for Nvidia?
- Bearish arguments:
- More efficient training means fewer GPUs needed to hit a given capability; hyperscalers may slow new cluster purchases and rely on existing capacity.
- Long term, breakthroughs could move more workloads to cheaper or non-GPU hardware; Nvidia’s “training monopoly” may soften.
- Bullish/neutral arguments:
- R1-style “thinking” models increase inference compute per query.
- Lower training cost democratizes model-building, inducing many more models and thus more total compute.
- Nvidia’s moat (CUDA, NVLink, Mellanox/Infiniband ecosystem) is seen as extremely strong; “Nvidia sells clusters and a full stack, not just chips.”
Costs, hardware, and sanctions
- DeepSeek-V3 training is widely cited as ~2.8M H800 GPU hours ≈ $5–6M at $2/hr, but multiple comments emphasize this excludes capex, experimentation, RL steps, data generation, and staff.
- Back-of-envelope estimates put a 2,048‑H800 cluster into the ~$100–200M range including infrastructure; the “$6M model” narrative is viewed as technically narrow but still notable for showing efficiency.
- Export controls to China are discussed: DeepSeek was likely trained on Nvidia cards acquired before/around sanctions; this undercuts the idea that restrictions would block Chinese AI progress.
Democratization and new opportunities
- Many see DeepSeek as enabling smaller or mid-stage companies to train competitive domain-specific models instead of paying incumbents’ API “rent.”
- Some foresee more on-prem deployments (for legal/privacy reasons), family or small-org “AI stations,” and induced demand for mid-range hardware.
Skills, education, and systems knowledge
- A strong thread argues DeepSeek’s success highlights the value of deep systems knowledge (OS, compilers, Mellanox/InfiniBand tuning, scheduling, concurrency) over “glue-code ML.”
- US CS programs are criticized for weakening OS/architecture requirements, contrasted with stronger systems pipelines in places like Israel and India.
- Concrete resources for leveling up: classic OS/systems courses (e.g., UIUC CS241, Berkeley CS162, MIT 6.1810), then HPC, then ML.
Media hype, bubble concerns, and future direction
- Several participants are uneasy with media exaggeration around DeepSeek and the sudden explosion of “instant experts” (e.g., on Jevons paradox).
- Some think this is a rational correction of an “obvious bubble”; others think markets still underprice the broader productivity impact of current LLMs.
- There is disagreement on whether we are at “the end of brute-force scaling” or at the beginning of “test-time scaling” and algorithmic refinement that will still demand massive compute over time.