Turning a MacBook into a touchscreen with $1 of hardware (2018)
A 2018 hobby project that turns a MacBook into a makeshift touchscreen using its camera, a mirror, and computer vision rekindles debate over touch input on laptops. Commenters admire the ingenuity but are split on whether touchscreens belong on MacBooks at all, citing ergonomic issues (“gorilla arm”), fingerprints, and UI trade‑offs versus the convenience and intuitiveness many users—especially younger ones—now expect. The thread also touches on technical limits of camera‑based touch detection, such as lighting conditions and skin‑tone sensitivity, and on Apple’s long‑rumored move toward official touchscreen Macs.
Overall reaction to the hack
- Many commenters find the project “brilliant” and “super neat,” especially as a low-cost, clever computer-vision application.
- People appreciate the reuse of existing hardware (camera + mirror) instead of adding costly, failure-prone touch layers.
- Several are reminded of earlier DIY interaction hacks (e.g., Wii Remote whiteboards).
Technical limits of the camera-based approach
- Multiple comments question robustness under varied lighting: outdoor use, glare, backlighting, and shadows may break detection.
- Prior similar work reported problems with:
- Highly variable lighting.
- Darker skin tones being harder to detect with simple color filtering.
- Spurious touches from reflections and shadows.
- Some suggest more robust techniques like background subtraction or IR/visible-light combinations.
- Concerns raised about using “skin color” filtering, which is both technically brittle and potentially exclusionary.
Touchscreen MacBooks: appeal vs. rejection
- A large subset explicitly does not want touchscreen MacBooks:
- Worries about fingerprints and smudges.
- Belief that vertical touch is ergonomically poor (“gorilla arm”).
- Fear of compromised UI density and “touch target tax” if macOS is redesigned for touch.
- Preference for Apple’s high-quality trackpads and keyboard shortcuts.
- Others strongly want touch:
- Say every other device they own is touch, so non-touch laptops now feel “ancient.”
- Find touch great for casual scrolling, tapping buttons, and occasional interactions, especially when not already on the mouse.
- Some report that after brief exposure, they instinctively try to touch non-touch screens.
Form factor, ergonomics, and product strategy
- Debate over laptop touch ergonomics:
- Critics stress fatigue from reaching over keyboard and accidental touches.
- Supporters say it’s fine for occasional use and especially good when screens can fold flat or into “easel”/tablet-like modes.
- Some argue Apple avoided touch to protect iPad sales and maintain product separation.
- Steve Jobs’ historical anti-touchscreen-laptop and anti-stylus remarks are cited, with others noting Apple later embraced Pencil and iPad keyboard cases.
Input methods and macOS UX
- Extensive side discussion on macOS keyboard navigation and window management:
- Some call it “flawless,” others “third class” and heavily reliant on pointer devices.
- Several share shortcuts, hidden settings, and third-party tools (e.g., window tilers) to improve the experience.
- Consensus that good trackpads make touch less necessary, but opinions vary sharply on what “good” keyboard and window UX means.