What to learn to be a graphics programmer

Original Article ↗ Hacker News Discussion ↗

Role and Scope of Graphics Programming

  • Graphics programming often serves artists and technical artists; the programmer enables their vision more than directly crafting visuals.
  • There are many “graphics” niches: real‑time game rendering, film/VFX tools, visualization, simulations, CAD, UI, etc., with different skills and constraints.
  • Technical Artists bridge art and code; they are widely described as highly valued but broadly defined.

Math, Theory, and Perception

  • Strong emphasis on linear algebra, trigonometry, coordinate geometry, and calculus (including integrals over spheres for physically based rendering).
  • Probability and statistics are highlighted for path tracing and denoising.
  • Color science, HDR, transfer functions, and human perception are described as hard but essential; terminology in graphics is seen as historically muddled.
  • Some argue learning transforms in graphics gives a good foundation for linear algebra; others say this does not translate much to modern ML work.

Tools, APIs, and Learning Paths

  • Common recommended path:
    • Learn math fundamentals.
    • Implement a software rasterizer and a ray tracer (e.g., “ray tracing in a weekend” style).
    • Move to APIs: OpenGL often suggested as a first low‑level API; Vulkan/WebGPU considered more complex.
    • Use higher‑level paths like WebGL, A‑Frame, Khan Academy ProcessingJS, or SDL if the goal is quick feedback.
  • Several curated resource lists, books, and tutorials are cited, especially for math and fundamentals.

Engines vs. Games

  • Strong recurring advice:
    • If you want to make games, use existing engines (Unreal, Unity, Godot, Bevy).
    • If you want to learn graphics/engines, build your own—but expect years of work, especially on tooling.
  • Many note the common trap of endlessly building engines instead of shipping games.

Career Prospects and Industry Conditions

  • Opinions diverge:
    • Some discourage entering graphics professionally: rapid tech churn, difficulty standing out, and especially poor working conditions in game studios (crunch, low pay, project‑based instability).
    • Others counter that graphics is intellectually rewarding, skills transfer well, and non‑game sectors (visualization, simulation, ML infra) can be good careers.
    • Several argue it’s valid to pursue graphics for curiosity and joy, independent of career payoff.

AI and the Future

  • Debate over AI:
    • Some see LLMs and image/video models as freeing, enabling faster engines, tools, and art; claims appear that AI can scaffold a full engine quickly.
    • Others are skeptical, emphasizing that mastery still requires deep understanding and that AI won’t shortcut craft or guarantee performance.