Ilya Sutskever: “If you learn all of these, you’ll know 90% of what matters”
Authenticity and Possible Product Tie‑in
- Multiple commenters question whether the list is genuinely from the cited researcher or just “someone’s bookmarks.”
- Some evidence is cited (interviews, social posts, an ex-employee’s onboarding notes), but others note there is no direct, explicit confirmation that this exact list is authentic.
- A few see it as subtle marketing for a VC‑backed browser; others push back, saying the content looks legitimate and useful.
- Overall status: plausible but unverified; several people explicitly flag that it may not be the actual list.
Scope and Content of the List
- Despite being described as ~30 “papers,” it includes a full CNN course, a ~500‑page Kolmogorov complexity book, and other long texts.
- Core topics include classic deep learning, RNNs/LSTMs, attention/transformers, and some foundational theory (e.g., Kolmogorov complexity).
- One commenter notes a specific chapter range in the Kolmogorov book as especially recommended.
Relevance, Coverage, and Obsolescence
- Some argue the list omits major modern areas: reinforcement learning, diffusion models, graph neural networks, low‑bit networks, and LLM‑era engineering (in‑context learning, RAG, tools, multimodality).
- The claim that this covers “90% of what matters today” is viewed as bold and “very opinionated.”
- Several note the list is years old and may be dated relative to current LLM practice.
- Others suggest the missing topics might reasonably be the remaining “10%.”
Effort Required and Intended Audience
- Commenters stress that “reading” ≠ “learning”: true understanding would take substantial time.
- Estimates range from a year of full‑time effort to several years part‑time, depending on prior math/CS background.
- For someone with no relevant background, some suggest 5+ years of full‑time study to reach the level assumed.
- Many emphasize that the list was reportedly tailored for a highly experienced engineer, not for beginners.
Learning Strategies, Constraints, and Tools
- Discussion on prerequisites: calculus, linear algebra, statistics, algorithms, and some learning theory are recommended.
- Strategies: follow bibliographies forward and backward, look for survey papers, build a “narrative arc” across seminal works.
- Several stress having a concrete project or goal; otherwise the material is likely to be forgotten and used only for “armchair” commentary.
- Some suggest using modern language models as tutors: read, then ask questions when stuck.
Time, Life Responsibilities, and Trade‑offs
- A long subthread debates the feasibility of “locking yourself in a hotel for a week” to study.
- One side argues that most professionals could carve out such time if they truly prioritize it; others counter that family, health, and financial constraints make this unrealistic for many.
- There is reflection on prioritization, ambition, and the tension between career advancement and other life responsibilities.
Practical Handling and Community Resources
- Commenters share backups and alternative mirrors (simple HTML lists, wget one‑liners), and note the original site sometimes behaves oddly.
- One person printed the combined PDFs as a spiral‑bound volume (~360 pages, including one extra paper).
- Another created a public reference manager group and reports basic stats: items span from the early 1990s to 2020, and include a mix of papers, preprints, a course, a dissertation, a book, and blog posts.
- Some ask how to filter out AI/LLM content from the site entirely; suggestions include browser extensions and ML‑based classifiers, with the aside that simple regex filters might cover most cases.