Models NVIDIA

  • Speech to text
  • Streaming
  • 32 languages
  • Public beta

Nemotron 3.5 ASR Streaming 0.6B

Streaming speech recognition in one multilingual model: punctuated text while the speaker is still talking, in 32 languages.

About the model

Nemotron 3.5 ASR is NVIDIA’s 600M-parameter model for streaming speech recognition. It turns incoming speech into punctuated text while the speaker is still talking, using one multilingual checkpoint.

Its cache-aware FastConformer encoder reuses earlier context instead of repeatedly processing overlapping audio, and an RNN-T decoder writes the transcript. On .wave, text arrives while the speaker is still talking.

NVIDIA model card

Languages32

Name one, or let the model detect it.

AudioPCM16 · G.711

PCM16 at 24 or 16 kHz, or 8 kHz telephony audio.

Parameters0.6B

One multilingual checkpoint.

Key capabilities

Native streaming

Transcribe new audio as it arrives, retaining the context from earlier audio.

Multilingual recognition

Name the language of the audio, or let the model detect it automatically.

Formatted transcripts

Produce punctuation and capitalization as part of the model’s output.

Timed segments

Each completed segment carries its start and end time in the audio.

API usage

Set DOTWAVE_API_KEY on your server. With the OpenAI SDK, set its base URL to https://api.dotwave.ai/v1 and open a transcription session. With the Deepgram plugin for LiveKit Agents or Pipecat, point its base URL at .wave, as in the third example. The Realtime API and Deepgram-compatible API docs cover audio formats, languages and errors.

Model ID
nemotron-asr-streaming
Endpoint
wss://api.dotwave.ai/v1/realtime
Deepgram plugins
wss://api.dotwave.ai/v1/listen
import asyncio, os
from openai import AsyncOpenAI

client = AsyncOpenAI(
    api_key=os.environ["DOTWAVE_API_KEY"],
    base_url="https://api.dotwave.ai/v1",
)

async def main():
    async with client.realtime.connect(model="nemotron-asr-streaming") as conn:
        await conn.session.update(session={
            "type": "transcription",
            "audio": {"input": {
                "format": {"type": "audio/pcm", "rate": 24000},
                "transcription": {
                    "model": "nemotron-asr-streaming",
                    "language": "pt-BR",  # leave it out to detect the language
                },
            }},
        })
        # Stream 24 kHz mono PCM16 as it is captured, with
        # conn.input_audio_buffer.append(audio=base64_chunk).
        async for event in conn:
            if event.type == "conversation.item.input_audio_transcription.delta":
                print(event.delta, end="", flush=True)
            elif event.type == "conversation.item.input_audio_transcription.completed":
                print()

asyncio.run(main())

Pricing and limits

Rate $0.00045 / minute

Billed from the first audio until the session closes.

Credit $10 to start

Included at sign-up. No card required.

Limits Real-time audio

Stream audio at the speed of speech. A session closes after 30 seconds without audio and runs for up to 24 hours.

Public beta: we publish no accuracy figures per language yet, so test with audio like yours before you rely on it.

Data handling: audio and transcripts are not retained.

Applications & use cases

Multilingual voice agents

Provide live transcripts for customer support, in-car assistants and retail kiosks serving speakers of different languages.

Healthcare & clinical documentation

Turn medical dictation into text for clinical notes and documentation. Private deployment can support workflows that need to keep audio within a controlled environment.

Live captioning & transcription

Add captions to meetings, events and broadcasts as people speak. Make live conversations more accessible and easier to follow.

Languages

Set language to one of these tags, for example pt-BR for Portuguese as spoken in Brazil. Leave it out and the model detects the language automatically; when you know the language, naming it is more accurate.

  • Arabic ar-AR
  • Bulgarian bg-BG
  • Chinese, Mandarin Simplified zh-CN
  • Croatian hr-HR
  • Czech cs-CZ
  • Danish da-DK
  • Dutch nl-NL
  • English, United Kingdom en-GB
  • English, United States en-US
  • Estonian et-EE
  • Finnish fi-FI
  • French, Canada fr-CA
  • French, France fr-FR
  • German de-DE
  • Hindi hi-IN
  • Hungarian hu-HU
  • Italian it-IT
  • Japanese ja-JP
  • Korean ko-KR
  • Norwegian Bokmål nb-NO
  • Polish pl-PL
  • Portuguese, Brazil pt-BR
  • Portuguese, Portugal pt-PT
  • Romanian ro-RO
  • Russian ru-RU
  • Slovak sk-SK
  • Spanish, Spain es-ES
  • Spanish, United States es-US
  • Swedish sv-SE
  • Turkish tr-TR
  • Ukrainian uk-UA
  • Vietnamese vi-VN

Language coverage from NVIDIA

How .wave keeps thousands of streams on time: read the case study

Working on a streaming model?

Tell us about your model, expected traffic and timing requirements.

Talk to an engineer