When LLM responses are too slow for your realtime use case, you may be tempted to pay double the cost for a faster service tier. Anthropic’s Priority tier, OpenAI’s priority processing, Gemini’s priority inference, whatever your LLM provider calls it. There’s a simpler solution: send every request twice and take the faster response. Why tail latency matters for voice agents Our voice agent at HOAi answers phone calls. Every turn in a conversation makes an LLM request. Most responses come back wi...