I used Claude Code to get a second opinion on my MRI

Limits of LLMs for Medical Imaging

  • Many commenters strongly argue current general-purpose LLMs are not reliable for image-based diagnosis, especially complex 3D modalities like MRI.
  • Radiology and MRI researchers note frontier models are not trained or validated for subtle medical image interpretation and tend to hallucinate plausible-sounding findings.
  • Several references to work showing “mirage reasoning”: models confidently describe and reason about images that were never actually provided.
  • Practitioners report benchmarking frontier models on real medical image datasets (e.g., otoscopy, pathology slides) and finding poor calibration and high-confidence errors.

Radiology & Imaging Nuance

  • MRI details: common “2D” slice protocols with gaps vs true 3D isotropic scans; tradeoffs between resolution, speed, and motion artifacts.
  • Ultrasound in orthopedics is useful for soft tissue and tendons but poor for bone and small calcifications; plain radiographs or MRI can detect calcifications that ultrasound misses.
  • Radiologists stress that negative findings are always conditional on modality and technique; “no X” on ultrasound doesn’t mean “no X” absolutely.

AI as Second Opinion / Patient Tool

  • Some users share positive anecdotes where LLMs helped spot misdiagnoses or suggest overlooked conditions/treatments, especially from text reports and lab data.
  • Others report blatantly wrong or internally inconsistent results on their own MRIs/X-rays, or obvious failures like misreading chessboards and basic images.
  • A recurring “best use” pattern: use LLMs to understand reports, generate questions, or surface guidelines and differential diagnoses, then discuss with a human clinician.

Trust, Self‑Diagnosis, and “AI Psychosis”

  • Clinicians worry about patients treating AI outputs as authoritative, eroding trust and consuming scarce visit time to debunk confident nonsense.
  • Multiple comments liken this to an amplified “Dr. Google” problem, with extra danger because the answers sound expert and personalized.
  • Some describe a quasi-religious overconfidence in AI (“AI psychosis”), where contrary expert feedback is dismissed as lack of vision.

Healthcare System Problems & Incentives

  • Many stories of misdiagnosis, conflicting opinions, overtreatment (e.g., unnecessary imaging, procedures, homeopathic injections), undertreatment, and rushed 5–15 minute visits.
  • This drives patients toward LLMs out of frustration and lack of access, not just techno-optimism.
  • Several argue AI could be powerful as an internal tool for doctors (guideline lookup, lead generation, checklists), but not as a stand‑alone diagnostician, especially for imaging.