Want to spot a deepfake? Look for the stars in their eyes

Scope and Method: Eye Reflections as a Deepfake Tell

• The method relies on the physical constraint that both eyes should show consistent catchlights/“stars,” analyzed with galaxy-shape metrics (e.g., Gini coefficient) applied to eye reflections.
• Some readers find the sample differences between real and fake images subtle; they say the provided figures don’t convincingly demonstrate robust discrimination.
• Others note the detection algorithm itself seems error‑prone in the examples (missing real reflections, hallucinating others).

Limitations, False Positives, and Real-World Photography

• Many professional portraits and even casual smartphone photos are heavily processed: added catchlights, retouching, computational photography pipelines.
• Techniques like cross‑polarized lighting can remove reflections from eyes altogether.
• Result: the method may often be detecting “heavily edited” rather than “AI‑generated,” and risks both false positives and negatives.
• It’s unclear how well the method works beyond specific generators (e.g., StyleGAN) or on face‑swap style deepfakes.

Arms Race: Fixing Eyes vs Detecting Eyes

• One camp argues any consistent visual cue that humans/computers can exploit can be patched:
  • Post‑processing pipelines that detect faces/eyes and “fix” reflections.
  • Training with discriminators that penalize inconsistent eye reflections.
  • Specialized fine‑tuning modules (similar to those already used for hands/fingers).
• Others counter that:
  • Learning correct long‑range correlations and subtle physics‑like regularities is hard and may require much better models, data, and compute.
  • Commercial image‑gen use cases don’t usually justify that cost; undetectable forensics‑grade fakes are still labor‑intensive.

Do Models “Understand” Physics?

• Several comments stress current image models mostly memorize statistical regularities, not physical laws; consistent eye reflections are just another correlation they may or may not learn.
• Debate continues over whether scaling and better architectures will yield something akin to “naive physics” vs an ever‑growing bag of superficial hacks.

Broader Deepfake Detection and Polarized AI Views

• An expert in face generation lists many more reliable tells: hair, ears, necks, backgrounds, skin texture, glasses, and phase artifacts.
• Many see deepfake detection as an inevitable arms race akin to spam/SEO, likely requiring AI to detect AI, with no guaranteed long‑term “trick.”
• Meta‑discussion notes polarization:
  • One pole assumes AI will trivially fix every flaw.
  • The other dismisses AI outputs as permanent garbage.
  • Several commenters place themselves in the middle: AI is useful but limited, and overconfident claims on either side are misleading.