Re: I'm Begging You to Leave Your AI Note-Taker at Home

Contexts where AI note-takers are (and aren’t) OK

  • Many distinguish sharply between:
    • Business/technical meetings: widely seen as appropriate or even beneficial (minutes, accountability, shared memory, interviews, long client calls).
    • Healthcare: heavily contested; some call it an ideal use case (complex instructions, remote family, elderly parents), others say it undermines privacy and comfort in disclosing sensitive information.
    • Casual/personal chats: most find this creepy or “psychotic,” and question whether it’s even common.
  • Some note doctors historically used human scribes or wrote notes after visits; AI scribes shift workflow and incentives.

Privacy, regulation, and trust

  • Big concern: data goes to third-party companies, often cloud-based, with opaque or misleading privacy practices.
  • Comparison to human secretaries:
    • Similar role in note-taking, but secretaries are employees bound by contracts and (in healthcare) HIPAA training.
    • AI tools must meet the same HIPAA/PII standards to be acceptable, but most off-the-shelf products don’t.
    • Tech firms are widely viewed as having burned public trust on privacy.
  • Some argue local/on-device models mitigate concerns; others say normalization of constant recording is the deeper problem.

Consent and social norms

  • Strong emphasis on affirmative consent:
    • Recording should be opt-in, not assumed; “no objection” is not consent.
    • Social pressure makes saying no hard, especially in medical or power-imbalanced contexts.
  • Dispute over tone:
    • Some say just politely decline and move on.
    • Others object to default recording and to framing objectors as Luddites.

Quality, accuracy, and workflow

  • Proponents: AI note-takers reduce cognitive load, help ADHD/executive function issues, democratize secretaries, improve focus in meetings, and provide accountability (“roll back the tape”).
  • Critics: summaries can be subtly wrong, omit key clinical info, or hallucinate content; important terms and names often mis-transcribed.
  • Some clinicians find manual note-taking reinforces understanding and memory better than AI-generated notes.

Broader worries

  • Fear of enshittification: admin using AI to push doctors to see more patients at lower quality.
  • Concern that permanent, searchable records chill candid conversation.
  • A few are enthusiastic about pervasive assistants (even during dates or sex), but most react negatively to that vision.