Re: I'm Begging You to Leave Your AI Note-Taker at Home

AI-powered note-taking tools are moving from corporate meetings into therapy sessions, medical appointments, and even casual coffee chats, raising sharp questions about privacy, consent, and social norms. Commenters weigh the benefits—better recall, support for people with ADHD or poor executive function, and accountability in professional settings—against risks such as data sharing with third parties, inaccurate or misleading summaries, and the chilling effect of being constantly recorded. Many argue that medical and deeply personal contexts require higher standards of consent, transparency, and regulation than routine business calls, even if that means less efficiency for providers.

Contexts where AI note-takers are (and aren’t) OK

  • Many distinguish sharply between:
    • Business/technical meetings: widely seen as appropriate or even beneficial (minutes, accountability, shared memory, interviews, long client calls).
    • Healthcare: heavily contested; some call it an ideal use case (complex instructions, remote family, elderly parents), others say it undermines privacy and comfort in disclosing sensitive information.
    • Casual/personal chats: most find this creepy or “psychotic,” and question whether it’s even common.
  • Some note doctors historically used human scribes or wrote notes after visits; AI scribes shift workflow and incentives.

Privacy, regulation, and trust

  • Big concern: data goes to third-party companies, often cloud-based, with opaque or misleading privacy practices.
  • Comparison to human secretaries:
    • Similar role in note-taking, but secretaries are employees bound by contracts and (in healthcare) HIPAA training.
    • AI tools must meet the same HIPAA/PII standards to be acceptable, but most off-the-shelf products don’t.
    • Tech firms are widely viewed as having burned public trust on privacy.
  • Some argue local/on-device models mitigate concerns; others say normalization of constant recording is the deeper problem.

Consent and social norms

  • Strong emphasis on affirmative consent:
    • Recording should be opt-in, not assumed; “no objection” is not consent.
    • Social pressure makes saying no hard, especially in medical or power-imbalanced contexts.
  • Dispute over tone:
    • Some say just politely decline and move on.
    • Others object to default recording and to framing objectors as Luddites.

Quality, accuracy, and workflow

  • Proponents: AI note-takers reduce cognitive load, help ADHD/executive function issues, democratize secretaries, improve focus in meetings, and provide accountability (“roll back the tape”).
  • Critics: summaries can be subtly wrong, omit key clinical info, or hallucinate content; important terms and names often mis-transcribed.
  • Some clinicians find manual note-taking reinforces understanding and memory better than AI-generated notes.

Broader worries

  • Fear of enshittification: admin using AI to push doctors to see more patients at lower quality.
  • Concern that permanent, searchable records chill candid conversation.
  • A few are enthusiastic about pervasive assistants (even during dates or sex), but most react negatively to that vision.