What is a voice agent?
It is the reason a shop phone can stop ringing out when every tech is under a car.
Voice agent
voice AI agentAI phone agent
A voice agent is software that answers a phone call, transcribes what the caller says, and speaks a reply in real time. It runs the whole loop on a phone line, not a chat window, so each step has to finish inside a latency budget the caller can't see.
Three systems work in sequence for every single thing the caller says. Speech recognition turns audio into text. A reasoning layer, usually a language model with tools, decides what to do: book a slot, look up an order, transfer the call. Text-to-speech turns the reply back into audio.
None of that is unique to phone calls. What makes a voice agent different from a chatbot with a microphone is the clock. A caller who waits two seconds assumes the line dropped. They hang up, or talk over the pause. Every stage in the loop competes for the same few hundred milliseconds.
Why the phone still needs one
A missed call is a lost job for most trades and service businesses. Staff cannot do the work and answer the phone at the same time. ZhoopZhoop, a multi-branch auto repair business, had exactly this problem: inbound calls went unanswered while every technician was on a car. Its AI receptionist now answers those calls instead.
The same pattern runs in the other direction too. ZhoopZhoop's outbound agents call parts suppliers, ask for availability and pricing, then hand staff a comparison. That used to mean someone dialing each supplier by hand.
An IVR menu ("press 1 for sales") only routes calls. It has no reasoning step, so it cannot answer a question or check a booking. A voice agent replaces the menu with a conversation. That also means it needs a plan for the calls it should not try to finish.
- ListenAudio streams in over the call.
- TranscribeSpeech becomes text as the caller talks.
- ReasonModel decides intent and next action.
- ActCalls a tool: book, look up, transfer.
- SpeakReply converts back to audio.
Every one of these five steps repeats for each thing the caller says, and the whole loop has to finish before the pause starts to feel wrong.
Common questions
01What is the difference between a voice agent and an IVR?
An IVR routes calls with a fixed menu and cannot answer a question, because it has no reasoning step. A voice agent transcribes what the caller says, works out what they need, and can act on it. That might mean booking an appointment or checking an order.
02Can a voice agent handle multiple languages?
Most speech recognition and text-to-speech models support several languages, but each one needs its own testing pass. A model that transcribes English well can still misread accents or code-switching it was not tuned for. Language coverage is a design decision, not something to assume.
03How does a voice agent know when to transfer to a human?
It matches what the caller says against a list of intents and keywords agreed before launch. Words for an emergency, a complaint, or a direct request to speak to a person. That match should be deliberately over-sensitive. A caller transferred by mistake loses a few seconds. A call that should have transferred and did not can cost far more.
Related terms
- ZhoopZhoop: AI receptionist for a collision shop →The voice agents this definition is drawn from, inbound and outbound.
- Should an AI receptionist handle emergency calls? →The escalation path in full: detection, timing, and what to log.
- AI agent development →The service behind voice agents and the systems they call into.
