Skip to main content

Modalities

A modality binds one provider to one transport for a specific runtime role. Create modalities under Bot → Modalities.

TypeRole
RealtimeA single provider handles streaming audio and conversation turns
STTConverts inbound speech to text
LLMProduces text responses and tool calls
TTSConverts generated text to outbound speech

A profile uses either one Realtime modality or a pipeline composition. A pipeline voice profile uses an LLM with STT and/or TTS; a typical voice pipeline uses all three.

Create a modality

Choose a name, modality type, provider, transport, and Bot assignments. The provider and transport must already be assigned to every selected Bot. The transport scheme must also match the modality type.

A modality contains only this binding. Provider-specific model and audio settings belong to the provider. Network endpoints and timeouts belong to the transport. Turn behavior belongs to a policy.

The control plane blocks changes that would make an assigned profile incomplete or incompatible.