Leaving Meta and PyTorch

Reactions to the Departure and Career Move

  • Many see this as “end of an era” and express gratitude, saying PyTorch made modern ML accessible, hackable, and fun.
  • Commenters highlight how the blog post centers people, curiosity, and growth rather than status or impact metrics.
  • Interpretations of the move vary: some think it’s pure curiosity and desire for “something small,” others suspect burnout, politics, or simply financial independence enabling risk-taking.
  • Several note that his exit is possible because PyTorch is now mature and no longer depends on its original creator.

Why PyTorch Beat TensorFlow (and Earlier Tools)

  • TF1 criticized for static graphs, verbosity, opaque error messages, fragile tutorials, constant API churn, and poor debugging (e.g., no easy print of tensors).
  • TF2’s shift to eager mode and gradient tapes is described as a painful, breaking transition that alienated both old and new users.
  • PyTorch praised for dynamic graphs, pythonic design, similarity to NumPy, straightforward debugging, and a “just write differentiable code” feel.
  • Its nn.Module abstraction and strong, up-to-date docs/tutorials are seen as key to adoption by students and practitioners.
  • Historical influences like Lua Torch, Chainer, and Autograd are acknowledged, but PyTorch is viewed as the package that got usability, abstraction level, and ecosystem right.

JAX vs PyTorch

  • Some prefer JAX’s functional mental model (functions and gradients) and enforced purity via jit, especially for scientific computing.
  • Others note JAX’s reliance on heavy compile-time optimization, making performance more “magical,” and worry about Google’s tendency to deprecate projects.
  • PyTorch is seen as messier but dominant in industry, with massive inertia and ecosystem lock-in.

Meta, Resources, and “Big vs Small”

  • One thread speculates his departure implies nothing uniquely exciting inside Meta’s AI efforts; others strongly disagree, pointing to Meta’s compute and private data.
  • Several argue that truly “big” breakthroughs often come from well-funded small teams rather than giant orgs weighed down by politics and bureaucracy.
  • Meta’s AI work is described as still very strong (e.g., recommendation systems), even if public narrative has shifted to LLMs.

Open-Source Community and Leadership Style

  • Multiple insiders emphasize that PyTorch was deliberately run as a community project, with broad inclusion of external and internal contributors.
  • His leadership is praised for reducing the “bus factor,” attracting and empowering talent, and making PyTorch resilient enough that his departure is operationally a non-event—framed as a hallmark of successful open source.