Leaving Meta and PyTorch
Reactions to the Departure and Career Move
- Many see this as “end of an era” and express gratitude, saying PyTorch made modern ML accessible, hackable, and fun.
- Commenters highlight how the blog post centers people, curiosity, and growth rather than status or impact metrics.
- Interpretations of the move vary: some think it’s pure curiosity and desire for “something small,” others suspect burnout, politics, or simply financial independence enabling risk-taking.
- Several note that his exit is possible because PyTorch is now mature and no longer depends on its original creator.
Why PyTorch Beat TensorFlow (and Earlier Tools)
- TF1 criticized for static graphs, verbosity, opaque error messages, fragile tutorials, constant API churn, and poor debugging (e.g., no easy
printof tensors). - TF2’s shift to eager mode and gradient tapes is described as a painful, breaking transition that alienated both old and new users.
- PyTorch praised for dynamic graphs, pythonic design, similarity to NumPy, straightforward debugging, and a “just write differentiable code” feel.
- Its
nn.Moduleabstraction and strong, up-to-date docs/tutorials are seen as key to adoption by students and practitioners. - Historical influences like Lua Torch, Chainer, and Autograd are acknowledged, but PyTorch is viewed as the package that got usability, abstraction level, and ecosystem right.
JAX vs PyTorch
- Some prefer JAX’s functional mental model (functions and gradients) and enforced purity via
jit, especially for scientific computing. - Others note JAX’s reliance on heavy compile-time optimization, making performance more “magical,” and worry about Google’s tendency to deprecate projects.
- PyTorch is seen as messier but dominant in industry, with massive inertia and ecosystem lock-in.
Meta, Resources, and “Big vs Small”
- One thread speculates his departure implies nothing uniquely exciting inside Meta’s AI efforts; others strongly disagree, pointing to Meta’s compute and private data.
- Several argue that truly “big” breakthroughs often come from well-funded small teams rather than giant orgs weighed down by politics and bureaucracy.
- Meta’s AI work is described as still very strong (e.g., recommendation systems), even if public narrative has shifted to LLMs.
Open-Source Community and Leadership Style
- Multiple insiders emphasize that PyTorch was deliberately run as a community project, with broad inclusion of external and internal contributors.
- His leadership is praised for reducing the “bus factor,” attracting and empowering talent, and making PyTorch resilient enough that his departure is operationally a non-event—framed as a hallmark of successful open source.