ElevenLabs Launches Scribe v3 Live Medical So Healthcare Voice Agents Get Drug Names Right

ElevenLabs released Scribe v3 Live Medical, a real-time medical transcription model for healthcare voice agents in ElevenAgents. It is tuned for drug names and procedures, supports 10,000 custom terms and more than 90 languages, and is in early access.

Christopher Ort
By i10X News Desk · Reviewed by Christopher Ort · 3 min read
Share
A clinic receptionist in scrubs seen from behind wears a headset at a front desk with paper forms.
Image: AI-generated, i10X
On this page
  1. Quick Take
  2. In plain English
  3. What happened
  4. Background
  5. Why it matters
  6. What's still open
  7. About the analysis
  8. i10x Perspective

ElevenLabs has released Scribe v3 Live Medical, a real-time speech recognition model built for healthcare voice agents that handle live calls with patients, health plan members and providers. It is optimized for clinical language such as drug names, doses and procedures, and it is available in early access inside ElevenAgents, the company’s voice agent platform. The goal is simple: an AI agent can only act on what a caller says if it hears the medication name correctly.

i10X Quick Take

Quick Take

  1. The launch: Scribe v3 Live Medical, announced November 17, built on the new Scribe v3 Live real-time model.
  2. Use cases: Intake and scheduling calls, claims and prior authorization calls, medical information lines and follow-ups.
  3. Custom vocabulary: Up to 10,000 custom terms, such as provider, clinic and drug names. With a term list loaded, ElevenLabs says the model made up to 48% fewer errors on medical terms in its tests.
  4. Languages: More than 90, including mid-call language switches.
  5. Limits: Early access, available only in ElevenAgents and not through the Speech to Text API. Transcripts are drafts meant for review by a healthcare professional.

In plain English

Phone agents in healthcare listen to callers and then do things: update a medication list, check eligibility or file a claim. If the speech recognition mishears “sitagliptin” as a different drug, the agent acts on the wrong information. ElevenLabs trained a version of its live transcription model specifically on medical language so these agents make fewer of those mistakes.

What happened

In its announcement, ElevenLabs gave a concrete example: in its testing, a speech model transcribed the diabetes drug sitagliptin as citalopram, an antidepressant. Scribe v3 Live Medical carries the clinical focus of the company’s existing Scribe v2 Medical, which handles recorded audio like dictation, into real-time conversations. On PriMock57, a public set of mock doctor visits, ElevenLabs says the new model made fewer errors than any other medical model it evaluated.

The model also uses turn prediction: when a caller reads out a member ID or date of birth in chunks, it recognizes that the number is not finished and waits, instead of interrupting. ElevenLabs says the model is HIPAA-eligible for enterprise customers with a business associate agreement and Zero Retention Mode, while its documentation asks early access users not to send protected health information until HIPAA eligibility is confirmed for this model.

Background

Voice agents are spreading fast across healthcare administration, from appointment booking to insurance follow-ups. Just yesterday we covered August AI’s health agent that calls doctors and fights insurance denials, and AI scribes are winning large contracts, as in Abridge’s VA deal.

Why it matters

In clinical settings, transcription errors are not a cosmetic problem. A wrong drug name can flow into a medication list or a prior authorization. Specialized medical speech models with custom vocabularies are a practical safety layer for the wave of healthcare voice agents now being deployed.

What’s still open

  • Independent accuracy results beyond ElevenLabs’ own testing.
  • When HIPAA eligibility is confirmed for the early access model and when EU data residency becomes available.
  • Pricing for the medical model.

About the analysis

This independent i10x analysis is based on ElevenLabs’ blog announcement and its model documentation. Accuracy figures are company test results and were not independently verified.

Sources (plain text, no links):

  • ElevenLabs blog: “Scribe v3 Live Medical helps conversational agents get clinical details right” (November 17, 2026)
  • ElevenLabs documentation: Models overview, Scribe v3 Live Medical

i10x Perspective

Vertical versions of general AI models are becoming the norm in healthcare, because general accuracy is not enough when rare words carry the most risk. The careful framing here, drafts for human review and no diagnosis, is also a sign of how vendors are positioning around regulation. More on the Health & Medical Research page.

Christopher Ort

Christopher Ort

Christopher Ort is the editor of i10X News at i10x.ai. He has worked hands-on with AI tools, models and agent workflows for years and leads i10X’s coverage of AI launches, funding and research. He is the author of “The Style Penalty”, an SSRN study on how frontier AI models judge AI-written CVs, covered by heise online and t3n.

Editor's picks

  1. Dragos canary study: attackers stole AI prompts and credentials at three AI inference providers
  2. Analysis: AI Agents in Banking Hit a Liability Wall
  3. CVE-2026-133631: FlowIntel chatbot let LLM call any API, exposed Ollama token in process table
  4. Stripe Evals: Coding Agents Score 78% on Payment Integrations, but Only 29% Pass Every Required Check
  5. Kong Volcano: A Self-Healing Agent Cloud Where Coding Agents Build, Host and Fix Apps