Corporate America Is Starting to Ration AI as Cost Skyrockets
Misuse of AI vs. Proper Automation
- Many see the core problem not as raw cost but as using LLMs for repeated tasks instead of building deterministic tools.
- Developers report teams dumping logs or reports into frontier models for hours to get mediocre results that a short Python script could replace.
- Some argue AI should mostly be used to help write and refine reusable scripts, CLI tools, and internal packages, not to “do the work” every time.
Cost, Token “Maxxing,” and Rationing
- Several describe a whiplash from management pushing “use AI for everything” and measuring token usage, to sudden rationing once cloud bills surged.
- Agents that run continuously and generate constant commits/PRs are seen as huge token sinks with questionable net value.
- There’s criticism that “agentic” architectures sometimes exist mainly to drive token consumption.
Productivity, Quality, and “Vibe Slop”
- Some report real 5–10x productivity gains when AI is used as “super-search/autocomplete” for debugging, small tools, and exploration, with humans verifying results.
- Others see entropy increasing: more low-quality PRs, heavier human review, and growing tech debt, making overall productivity at best a wash.
- LLMs are seen as strong for semantic comparison, intent understanding, and triage, but weak for large unsupervised code generation.
Hype, ROI, and Economic Reality
- Many say AI/LLMs are overhyped: few visible end-user products, unclear revenue gains, and lots of internal one-off tools whose value is hard to quantify.
- Some compare this to past automation promises that ran into inflexibility and bureaucratic overhead.
- Others argue LLMs are revolutionary but misapplied, and that benefits are mostly in raising the “ceiling” for top performers.
Future Costs and Infrastructure Risk
- One side predicts ~99% cost drops over a few years due to algorithmic and hardware advances; others call that unrealistic and note current prices are rising.
- There’s concern about deep dependence on external LLM APIs: outages, bans, war, or nationalization could cripple workflows.
- Several suggest treating AI as an optional accelerator, not a hard dependency for core business operations.