Show HN: AI climbing coach – visualize how to climb any route based on your body

Technical approach & capabilities

  • System builds a 3D avatar of the climber from the first second of video and runs an end‑to‑end biomechanics model from video frames.
  • It infers camera parameters and, apparently, some monocular depth to reason about the wall, though accuracy on complex 3D cliffs is limited.
  • Path planning up the wall and generation of movement/kinematics are integrated into the same pipeline.
  • Works best on indoor bouldering with clear, spaced holds and good lighting; outdoor and natural walls are possible but less reliable.
  • Hold identification and wall understanding are implicitly learned rather than explicitly modeled; exact mechanisms are not fully described.

Open source, costs, and maturity

  • Author plans to open source code, training pipeline, and model, but notes heavy compute and data requirements for high‑quality results.
  • Current system is an early research preview: works well on some examples, fails on many; demo clips are cherry‑picked.
  • Licensing constraints around certain body models (e.g., SMPL‑family) were raised; commercial use may be restricted.

Use cases and perceived value

  • Suggested uses: beginner coaching, visual beta suggestions, comparing your attempts to an “optimal” avatar, movement analysis, gym features (ghost climber overlays), and possible support for route setters.
  • Some see parallels to golf swing or tape analysis in other sports.

Limitations & skepticism

  • Many climbers doubt it can handle micro‑details: hold texture, polish, tiny orientation changes, dual textures, and subtle friction differences.
  • Concerns that it ignores climber‑specific strength, flexibility, and injury constraints, so suggested beta may be physically unattainable.
  • Questions about how it knows which holds are “on,” where the top is, and how it infers 3D positions of unused holds; these remain unclear.
  • Some view route grading or safety‑critical advice as unreliable without texture/depth and worry about trusting AI in dangerous contexts.

Climbing culture reactions

  • Strong split: some are excited and eager to try it; many say it removes a core joy of climbing—solving the puzzle themselves and sharing beta with partners.
  • Others argue structured feedback and expert‑like beta can drastically speed learning, especially for newer climbers.
  • Broader debate appears about AI’s role in creative tasks like route setting and whether algorithmic routes could or should replace human craft.