Bilingual voice system for a customer-operations team
Calls needed to be handled conversationally in two languages, without building and maintaining a separate call flow for each. For a voice agent to feel usable, the pause between a caller finishing and hearing a reply has to be short — so speed was a design constraint, not a nice-to-have.
The system sits on the phone line in front of the team. Each turn was broken into stages — end-of-speech detection, transcription, reasoning, speech synthesis and playback — so each could be measured and improved separately rather than guessed at as a whole.