Post
344
We’ve published Soniqo’s voice-agent leaderboard and an article explaining what we measured.
aufklarer/full-duplex-leaderboard
The board covers three parts of a speech system:
- Turn-taking · TurnBench: detecting turn endings, false alarms and decision delay.
- Commands · SLURP: choosing the correct tool and matching its argument values.
- Voice style · InstructTTSEval: following voice descriptions, delivery directions and role-play instructions, with separate scores for each.
Models include VAP, p99, Smart Turn, Qwen3-TTS, VoxCPM2, FireRedTTS3 and MOSS-VoiceGenerator, alongside cloud configurations from OpenAI, Google, AWS and ElevenLabs. Each table shows run sizes and links to the protocol.
We also published aufklarer/P99-Turn-1-Mini-CoreML, aufklarer/VAP-OTO-CoreML and soniqo/VAP-OTO-ONNX exports. Both models have native Swift APIs; VAP also has C++ and Android support.
Explore the leaderboard aufklarer/full-duplex-leaderboard · Read the article https://soniqo.audio/blog/voice-agent-benchmarks
aufklarer/full-duplex-leaderboard
The board covers three parts of a speech system:
- Turn-taking · TurnBench: detecting turn endings, false alarms and decision delay.
- Commands · SLURP: choosing the correct tool and matching its argument values.
- Voice style · InstructTTSEval: following voice descriptions, delivery directions and role-play instructions, with separate scores for each.
Models include VAP, p99, Smart Turn, Qwen3-TTS, VoxCPM2, FireRedTTS3 and MOSS-VoiceGenerator, alongside cloud configurations from OpenAI, Google, AWS and ElevenLabs. Each table shows run sizes and links to the protocol.
We also published aufklarer/P99-Turn-1-Mini-CoreML, aufklarer/VAP-OTO-CoreML and soniqo/VAP-OTO-ONNX exports. Both models have native Swift APIs; VAP also has C++ and Android support.
Explore the leaderboard aufklarer/full-duplex-leaderboard · Read the article https://soniqo.audio/blog/voice-agent-benchmarks