Apple introduces spatial video capture on iPhone 15 Pro

Apple’s new “spatial video” feature on the iPhone 15 Pro records stereoscopic footage using two rear cameras, intended for immersive playback on the upcoming Vision Pro headset. Commenters debate how convincing the 3D effect can be given the small distance between lenses, whether LiDAR or AI is used to enhance depth, and if 1080p at 30 fps is sufficient for high-resolution VR displays. Others note that the videos are encoded in a published MV-HEVC format and already convertible for non-Apple headsets, but question whether this will become a mainstream medium or follow the niche trajectory of features like Live Photos.

Depth perception with closely spaced lenses

  • Several comments question whether ~1–2 cm separation between iPhone cameras yields meaningful 3D.
  • Others report the effect is perceptible but subtle, especially compared to wider 6–7 cm human eye spacing.
  • Some argue Apple may algorithmically “exaggerate” stereo (increasing disparity and inpainting gaps) to mimic wider baselines.

LiDAR and depth reconstruction

  • Unclear whether LiDAR is actually used for spatial video; Apple’s article doesn’t say.
  • Some suggest LiDAR could help build depth maps, improve stereo from a small baseline, or provide limited view-dependent parallax.
  • Others note phone-class LiDAR is range-limited, noisy in daylight, and may be more useful for calibration than dense per-frame depth.

Format, openness, and non‑Apple playback

  • Spatial videos are just MV‑HEVC stereo with a published profile, so any platform can implement playback.
  • Tools already exist to extract side‑by‑side/top‑bottom formats for headsets like Quest and Pico; aspect ratios can be awkward.
  • Some wish Apple would directly support conversions and open standards for broader VR use.

Stereo vs 6DoF

  • Consensus: recordings are stereo, not full 6‑degree‑of‑freedom.
  • Thread discusses theoretical 6DoF via depth maps and inpainting, but acknowledges occlusion limits and the need for heavy computation.

Resolution, frame rate, and perceived quality

  • 1080p30 SDR feels underwhelming to some given Vision Pro’s high apparent pixel density and expectation set by 4K60 phone video.
  • Others argue 30 fps is fine (movies are 24 fps) and headset field‑of‑view plus resampling may make 1080p “good enough,” though interpolation and scaling losses are debated.

Hardware layout and iPhone 15 Pro exclusivity

  • A key reason cited for limiting capture to iPhone 15 Pro is the new alignment of wide and ultrawide lenses along a single axis.
  • Debate centers on whether 14 Pro could have supported it via cropping/rotation; some argue it’s technically possible but would degrade UX and effective resolution.

Use cases, ecosystem, and longevity

  • Some see spatial video as an emotional, memory‑focused feature akin to Live Photos, which a subset of users value highly.
  • Others fear it will be another niche Apple‑only format that quietly fades.
  • Storage bloat is noted as a potential business incentive.
  • Third‑party low‑cost headsets (e.g., phone‑based “Cardboard‑style” devices) are positioning themselves as ways to view such content without buying Vision Pro.