Reference

Models, voices and formats

Every provider, model, voice, language, sample rate, format and option the router accepts.

Each setting is a field of start on the WebSocket and a top-level field of /v1/audio/speech, with the LiveKit plugin’s name and default beside it. The router checks models, formats, sample rates and options against these lists; voices and languages go to the provider as given, so a wrong one gets the provider’s own error. The drop-ins take whatever the provider’s own API takes.

The same list as JSON, with no authentication:

curl https://api.ttscacherouter.dev/v1/models

Sarvam#

Sarvam API reference

Protocol "provider": "sarvam"Plugin tts_cache_router.Sarvam

Models: bulbul:v3, bulbul:v4-flash
Languages: 11
Speed: 0.5 – 2.0
Sample rates: 8, 16, 22.05, 24, 32, 44.1, 48 kHz
Formats: pcm, wav, mp3, aac, mulaw, alaw

Models and voices#

bulbul:v337 voices

Click a voice to copy its id.

bulbul:v4-flashVoices are listed in Sarvam’s voice catalog

Languages#

Banglabn-IN
Englishen-IN
Gujaratigu-IN
Hindihi-IN
Kannadakn-IN
Malayalamml-IN
Marathimr-IN
Odiaod-IN
Punjabipa-IN
Tamilta-IN
Telugute-IN

Settings#

Fields of the start message (top-level fields on /v1/audio/speech), with the LiveKit plugin’s name and default for each.

modelstringRequired: LiveKit model; One of bulbul:v3, bulbul:v4-flash
Which model synthesizes the segment.
voicestringRequired: LiveKit speaker; A voice of the chosen model, passed to Sarvam as given. See models and voices.
languagestringRequired: LiveKit language; A Sarvam language code from languages, passed through as given.
speednumberDefault 1.0: LiveKit pace=1.0; Range 0.5 – 2.0
Speech speed. 1.0 is normal speed.
sample_rateintegerRequired: LiveKit TTS(sample_rate=24000); One of 8000, 16000, 22050, 24000
Of the audio you receive, in Hz. /v1/audio/speech also takes 32000, 44100, 48000.
formatstringDefault "pcm": LiveKit PCM; One of pcm, wav, mp3, aac, mulaw, alaw
The audio format, produced by Sarvam itself. wav is response_format on /v1/audio/speech only.
options.temperaturenumberDefault 0.6: LiveKit temperature=0.6; Range 0.01 – 1.0
Sampling temperature: lower is steadier, higher is more expressive.
options.dict_idstring | nullDefault null: LiveKit dict_id=None; A Sarvam pronunciation dictionary to apply.
options.bitratestringDefault "128k": LiveKit —; One of 32k, 64k, 96k, 128k, 192k
Bitrate of mp3 and aac audio.
options.pitchnumberbulbul:v4-flash only. Default 0.0: LiveKit pitch=0.0; Range -0.5 – 0.5
Pitch: lower is deeper, higher is sharper.
options.loudnessnumberbulbul:v4-flash only. Default 1.0: LiveKit loudness=1.0; Range 0.1 – 2.5
Loudness: lower is quieter, higher is louder.
options.enable_preprocessingbooleanbulbul:v4-flash only. Default false: LiveKit enable_preprocessing=False; Normalize numbers and English words in the text before synthesis.
options.min_buffer_sizeinteger | nullDefault null: LiveKit min_buffer_size=None; Range 30.0 – 200.0
Characters Sarvam buffers before it starts synthesizing. Null: the router's choice, the least Sarvam allows.
options.max_chunk_lengthinteger | nullDefault null: LiveKit max_chunk_length=None; Range 50.0 – 500.0
The longest text Sarvam synthesizes in one piece; it splits longer sentences. Null: the router's choice, the most Sarvam allows, so each sentence is synthesized whole.

from livekit.plugins import tts_cache_routertts = tts_cache_router.TTS(    provider=tts_cache_router.Sarvam(        model="bulbul:v3",        speaker="shubh",        language="bn-IN",        pace=1.0,        temperature=0.6,        dict_id=None,        min_buffer_size=None,        max_chunk_length=None,    ),    sample_rate=24000,)

{  "type": "start",  "segment_id": "c0ffee",  "provider": "sarvam",  "model": "bulbul:v3",  "voice": "shubh",  "language": "bn-IN",  "speed": 1.0,  "sample_rate": 24000,  "format": "pcm",  "options": {"temperature": 0.6, "dict_id": null, "bitrate": "128k", "min_buffer_size": null, "max_chunk_length": null}}

Raya#

Raya API reference

Protocol "provider": "raya"Plugin tts_cache_router.Raya

Models: m1, standard
Languages: 14
Speed: 0.5 – 1.5
Sample rates: 8, 16, 22.05, 24 kHz
Formats: pcm, wav, mulaw

Models and voices#

m1Voices are listed in Raya’s voice catalog

standardVoices are listed in Raya’s voice catalog

Languages#

Hindihi
Marathimr
Telugute
Kannadakn
Banglabn
Assameseas
Gujaratigu
Nepaline
Malayalamml
Tamilta
English (India)en-in
English (United States)en-us
Englishm1 onlyen
Punjabim1 onlypa

Settings#

Fields of the start message (top-level fields on /v1/audio/speech), with the LiveKit plugin’s name and default for each. Raya takes no options: send {} or leave it out.

modelstringRequired: LiveKit model; One of m1, standard
Which model synthesizes the segment.
voicestringRequired: LiveKit voice_id; A voice of the chosen model, passed to Raya as given. See models and voices.
languagestringRequired: LiveKit language; A Raya language code from languages, passed through as given.
speednumberDefault 1.0: LiveKit speed=1.0; Range 0.5 – 1.5
Speech speed. 1.0 is normal speed.
sample_rateintegerRequired: LiveKit TTS(sample_rate=24000); One of 8000, 16000, 22050, 24000
Of the audio you receive, in Hz.
formatstringDefault "pcm": LiveKit PCM; One of pcm, wav, mulaw
The audio format, produced by Raya itself. wav is response_format on /v1/audio/speech only.

from livekit.plugins import tts_cache_routertts = tts_cache_router.TTS(    provider=tts_cache_router.Raya(        model="m1",        voice_id="<voice id>",        language="hi",        speed=1.0,    ),    sample_rate=24000,)

{  "type": "start",  "segment_id": "c0ffee",  "provider": "raya",  "model": "m1",  "voice": "<voice id>",  "language": "hi",  "speed": 1.0,  "sample_rate": 24000,  "format": "pcm",  "options": {}}

ElevenLabs#

ElevenLabs API reference

Protocol "provider": "elevenlabs"Plugin tts_cache_router.ElevenLabs

Models: eleven_flash_v2_5, eleven_turbo_v2_5, eleven_multilingual_v2, eleven_flash_v2, eleven_turbo_v2, eleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo
Languages: 94
Speed: set in voice_settings
Sample rates: 8, 16, 22.05, 24, 32, 44.1, 48 kHz
Formats: pcm, wav, mp3, mulaw, alaw

Models and voices#

eleven_flash_v2_5Voices are listed in ElevenLabs’s voice catalog

eleven_turbo_v2_5Voices are listed in ElevenLabs’s voice catalog

eleven_multilingual_v2Voices are listed in ElevenLabs’s voice catalog

eleven_flash_v2Voices are listed in ElevenLabs’s voice catalog

eleven_turbo_v2Voices are listed in ElevenLabs’s voice catalog

eleven_v3Voices are listed in ElevenLabs’s voice catalog

eleven_v3_conversationalVoices are listed in ElevenLabs’s voice catalog

eleven_v4Voices are listed in ElevenLabs’s voice catalog

eleven_v4_turboVoices are listed in ElevenLabs’s voice catalog

Languages#

Englishen
Japaneseeleven_flash_v2_5, eleven_turbo_v2_5, eleven_multilingual_v2, eleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyja
Chineseeleven_flash_v2_5, eleven_turbo_v2_5, eleven_multilingual_v2, eleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyzh
Germaneleven_flash_v2_5, eleven_turbo_v2_5, eleven_multilingual_v2, eleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyde
Hindieleven_flash_v2_5, eleven_turbo_v2_5, eleven_multilingual_v2, eleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyhi
Frencheleven_flash_v2_5, eleven_turbo_v2_5, eleven_multilingual_v2, eleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyfr
Koreaneleven_flash_v2_5, eleven_turbo_v2_5, eleven_multilingual_v2, eleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyko
Portugueseeleven_flash_v2_5, eleven_turbo_v2_5, eleven_multilingual_v2, eleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlypt
Italianeleven_flash_v2_5, eleven_turbo_v2_5, eleven_multilingual_v2, eleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyit
Spanisheleven_flash_v2_5, eleven_turbo_v2_5, eleven_multilingual_v2, eleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyes
Russianeleven_flash_v2_5, eleven_turbo_v2_5, eleven_multilingual_v2, eleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyru
Indonesianeleven_flash_v2_5, eleven_turbo_v2_5, eleven_multilingual_v2, eleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyid
Dutcheleven_flash_v2_5, eleven_turbo_v2_5, eleven_multilingual_v2, eleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlynl
Turkisheleven_flash_v2_5, eleven_turbo_v2_5, eleven_multilingual_v2, eleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlytr
Filipinoeleven_flash_v2_5, eleven_turbo_v2_5, eleven_multilingual_v2, eleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyfil
Polisheleven_flash_v2_5, eleven_turbo_v2_5, eleven_multilingual_v2, eleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlypl
Swedisheleven_flash_v2_5, eleven_turbo_v2_5, eleven_multilingual_v2, eleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlysv
Bulgarianeleven_flash_v2_5, eleven_turbo_v2_5, eleven_multilingual_v2, eleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlybg
Romanianeleven_flash_v2_5, eleven_turbo_v2_5, eleven_multilingual_v2, eleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyro
Arabiceleven_flash_v2_5, eleven_turbo_v2_5, eleven_multilingual_v2, eleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyar
Czecheleven_flash_v2_5, eleven_turbo_v2_5, eleven_multilingual_v2, eleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlycs
Greekeleven_flash_v2_5, eleven_turbo_v2_5, eleven_multilingual_v2, eleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyel
Finnisheleven_flash_v2_5, eleven_turbo_v2_5, eleven_multilingual_v2, eleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyfi
Croatianeleven_flash_v2_5, eleven_turbo_v2_5, eleven_multilingual_v2, eleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyhr
Malayeleven_flash_v2_5, eleven_turbo_v2_5, eleven_multilingual_v2, eleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyms
Slovakeleven_flash_v2_5, eleven_turbo_v2_5, eleven_multilingual_v2, eleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlysk
Danisheleven_flash_v2_5, eleven_turbo_v2_5, eleven_multilingual_v2, eleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyda
Tamileleven_flash_v2_5, eleven_turbo_v2_5, eleven_multilingual_v2, eleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyta
Ukrainianeleven_flash_v2_5, eleven_turbo_v2_5, eleven_multilingual_v2, eleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyuk
Hungarianeleven_flash_v2_5, eleven_turbo_v2_5, eleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyhu
Norwegianeleven_flash_v2_5, eleven_turbo_v2_5, eleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyno
Vietnameseeleven_flash_v2_5, eleven_turbo_v2_5, eleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyvi
Afrikaanseleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyaf
Armenianeleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyhy
Assameseeleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyas
Azerbaijanieleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyaz
Belarusianeleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlybe
Banglaeleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlybn
Bosnianeleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlybs
Catalaneleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyca
Cebuanoeleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyceb
Nyanjaeleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyny
Estonianeleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyet
Galicianeleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlygl
Georgianeleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyka
Gujaratieleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlygu
Hausaeleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyha
Hebreweleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyhe
Icelandiceleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyis
Irisheleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyga
Javaneseeleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyjv
Kannadaeleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlykn
Kazakheleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlykk
Kyrgyzeleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyky
Latvianeleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlylv
Lingalaeleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyln
Lithuanianeleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlylt
Luxembourgisheleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlylb
Macedonianeleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlymk
Malayalameleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyml
Marathieleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlymr
Nepalieleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyne
Pashtoeleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyps
Persianeleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyfa
Punjabieleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlypa
Serbianeleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlysr
Sindhieleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlysd
Slovenianeleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlysl
Somalieleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyso
Swahilieleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlysw
Telugueleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyte
Thaieleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyth
Urdueleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlyur
Welsheleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo onlycy
Amhariceleven_v4, eleven_v4_turbo onlyam
Asturianeleven_v4, eleven_v4_turbo onlyast
Burmeseeleven_v4, eleven_v4_turbo onlymy
Cantoneseeleven_v4, eleven_v4_turbo onlyyue
Fulaeleven_v4, eleven_v4_turbo onlyff
Kambaeleven_v4, eleven_v4_turbo onlykam
Laoeleven_v4, eleven_v4_turbo onlylo
Gandaeleven_v4, eleven_v4_turbo onlylg
Malteseeleven_v4, eleven_v4_turbo onlymt
Māorieleven_v4, eleven_v4_turbo onlymi
Mongolianeleven_v4, eleven_v4_turbo onlymn
Occitaneleven_v4, eleven_v4_turbo onlyoc
Odiaeleven_v4, eleven_v4_turbo onlyor
Shonaeleven_v4, eleven_v4_turbo onlysn
Central Kurdisheleven_v4, eleven_v4_turbo onlyckb
Tajikeleven_v4, eleven_v4_turbo onlytg
Uzbekeleven_v4, eleven_v4_turbo onlyuz
Wolofeleven_v4, eleven_v4_turbo onlywo
Yorubaeleven_v4, eleven_v4_turbo onlyyo
Zulueleven_v4, eleven_v4_turbo onlyzu

Settings#

Fields of the start message (top-level fields on /v1/audio/speech), with the LiveKit plugin’s name and default for each.

modelstringRequired: LiveKit model; One of eleven_flash_v2_5, eleven_turbo_v2_5, eleven_multilingual_v2, eleven_flash_v2, eleven_turbo_v2, eleven_v3, eleven_v3_conversational, eleven_v4, eleven_v4_turbo
Which model synthesizes the segment.
voicestringRequired: LiveKit voice_id; A voice of the chosen model, passed to ElevenLabs as given. See models and voices.
languagestring | nullOptional: LiveKit language; A ElevenLabs language code from languages, passed through as given. Leave it out and ElevenLabs detects the language.
sample_rateintegerRequired: LiveKit TTS(sample_rate=24000); One of 8000, 16000, 22050, 24000, 32000, 44100, 48000
Of the audio you receive, in Hz.
formatstringDefault "pcm": LiveKit PCM; One of pcm, wav, mp3, mulaw, alaw
The audio format, produced by ElevenLabs itself. wav is response_format on /v1/audio/speech only.
options.voice_settingsobject | nullDefault null: LiveKit voice_settings=None; stability and similarity_boost (0–1, both required), and optionally style (0–1), speed (0.7–1.2) and use_speaker_boost. Null: the voice's stored settings. Dialogue models (eleven_v3, eleven_v4) use stability only.
options.apply_text_normalizationstringDefault "auto": LiveKit apply_text_normalization="auto"; One of auto, on, off
Spell out numbers, dates and the like before speaking.
options.apply_language_text_normalizationboolean | nullDefault null: LiveKit apply_language_text_normalization=None; Language-specific normalization (Japanese); adds latency.
options.enable_ssml_parsingbooleanDefault false: LiveKit enable_ssml_parsing=False; Parse SSML tags in the text.
options.enable_loggingbooleanDefault true: LiveKit enable_logging=True; false: ElevenLabs' zero-retention mode (enterprise accounts).
options.pronunciation_dictionary_locatorsarray | nullDefault null: LiveKit pronunciation_dictionary_locators=None; Up to 3 {pronunciation_dictionary_id, version_id}.
options.bitratestring | nullDefault null: LiveKit —; One of 32k, 48k, 64k, 96k, 128k, 192k
Bitrate of mp3: 32k at 22050 Hz, 48k at 24000 Hz, 32k–192k at 44100 Hz (default 128k).
options.sync_alignmentbooleanDefault true: LiveKit sync_alignment=True; /v1/stream: send each sentence's word timings (words messages).
options.preferred_alignmentstring | nullDefault null: LiveKit preferred_alignment=None; One of normalized, original
/v1/stream: words of the text as sent (original) or as ElevenLabs normalized it. Null: original for Japanese, Korean and Chinese, else normalized.

from livekit.plugins import tts_cache_routertts = tts_cache_router.TTS(    provider=tts_cache_router.ElevenLabs(        model="eleven_flash_v2_5",        voice_id="<voice id>",        apply_text_normalization="auto",        apply_language_text_normalization=None,        enable_ssml_parsing=False,        enable_logging=True,        sync_alignment=True,        preferred_alignment=None,    ),    sample_rate=24000,)

{  "type": "start",  "segment_id": "c0ffee",  "provider": "elevenlabs",  "model": "eleven_flash_v2_5",  "voice": "<voice id>",  "sample_rate": 24000,  "format": "pcm",  "options": {"voice_settings": null, "apply_text_normalization": "auto", "apply_language_text_normalization": null, "enable_ssml_parsing": false, "enable_logging": true, "pronunciation_dictionary_locators": null, "bitrate": null, "sync_alignment": true, "preferred_alignment": null}}