AWS tutorial streams Qwen3-TTS speech from SageMaker AI with vLLM-Omni
Published September 28, AWS’s Part 1 tutorial demonstrates deploying Qwen3-TTS on Amazon SageMaker AI with the AWS vLLM-Omni Deep Learning Container, then streaming generated speech through a Gradio application over a persistent bidirectional connection.

Full Report
AWS published “Build real-time voice applications with vLLM-Omni on SageMaker AI – Part 1” on September 28, 2026. The tutorial walks through deploying Qwen3-TTS on Amazon SageMaker AI using the AWS vLLM-Omni Deep Learning Container, connecting model deployment with an application-level voice workflow.
The example streams generated speech over a persistent bidirectional connection and uses a Gradio application as its interface. In doing so, it covers both deploying the model and delivering its output within an interactive application.
The tutorial arrives amid other recent text-to-speech developments: Google announced Gemini 3.8 Flash TTS and Flash-Lite TTS on September 23, positioning them for custom voice direction and high-volume audio generation, respectively. AWS’s tutorial focuses instead on a practical implementation path combining SageMaker AI, vLLM-Omni, and Qwen3-TTS for a real-time voice application.
Why This Matters
Deploying a speech model and integrating it into an interactive application are separate engineering steps. By bringing together SageMaker AI deployment, bidirectional streaming, and a Gradio interface in one example, the tutorial gives developers a more end-to-end implementation path to study.
Evidence
Start with the primary evidence, then review supporting sources and context.
Primary Evidence
1Build real-time voice applications with vLLM-Omni on SageMaker AI – Part 1
Yadan Wei
“Deploy a text-to-speech model on Amazon SageMaker AI with the AWS vLLM-Omni Deep Learning Container and stream generated speech over a persistent bidirectional connection. This Part 1 tutorial deploys Qwen3-TTS and streams speech through a Gradio application.”
Recommended signals
Recommended by brand, topic, and recent related coverage