Speech and Translation AI

NVIDIA Riva

Build and deploy fully customizable multilingual speech and translation AI for your large language model and retrieval-augmented generation based applications.

Overview

What Is NVIDIA Riva?

NVIDIA® Riva is a set of GPU-accelerated multilingual speech and translation microservices for building fully customizable, real-time conversational AI pipelines. Riva includes automatic speech recognition (ASR), text-to-speech (TTS), and neural machine translation (NMT) and is deployable in all clouds, in data centers, at the edge, and on embedded devices. With Riva, organizations can add speech and translation interfaces with large language models (LLMs) and retrieval-augmented generation (RAG) to transform chatbots into engaging, expressive multilingual assistants and avatars.

Unveiling End-to-End Speech and Translation AI Magic

Deliver AI chatbots with state-of-the-art multilingual transcription, translation, and voices.

Benefits

Explore the Benefits of NVIDIA Riva

pending

Accurate Multilingual Transcriptions and Expressive Voices

Achieve high multilingual transcription and translation accuracy, and provide out-of-the-box, expressive, professional female and male voices with state-of-the-art models pretrained on thousands of hours of audio on NVIDIA supercomputers.

pending

Fully Customizable

Customize across ASR pipelines for different languages, accents, domains, vocabulary, and context for the best possible accuracy for your use case and across TTS pipelines for the brand voice and intonation you want.

pending

Flexible Deployments

Provide consistent experiences to hundreds of thousands of concurrent users with higher inference performance than existing technology, and deploy anywhere—in data centers, on premises, in the cloud, at the edge, or in embedded devices.

pending

Enterprise-Grade AI

Accelerate the development and deployment of production-grade, multilingual, voice-enabled AI applications with NVIDIA AI Enterprise, an end-to-end, cloud-native software platform for enterprise-grade secure and stable generative AI.

NVIDIA Riva NIMs—Now Available for Download

Experience new ASR, TTS and NMT microservices now available—designed to provide optimized AI inference for speech and translation AI. This includes Parakeet models that deliver recording setting ASR accuracy and performance.

NVIDIA Riva NIMs now available

Use Cases

How Riva Is Being Used

Find out how industry leaders are driving innovation with Riva.

Q&A Assistants

Companies are deploying Q&A assistants to automatically address the queries of millions of customers and employees around the clock. With Riva’s speech and translation AI microservices, these assistants provide helpful and natural responses at every turn of the conversation despite background noise, poor sound quality, and diverse speaker dialects and accents.

Phone Customer Service with ASR Customization

Starting Options

Ways to Get Started With NVIDIA Riva

Use the right tools and technologies to build and deploy fully customizable, multilingual speech and translation AI applications.

Try

Experience Riva through a UI-based portal for exploring and prototyping with NVIDIA-managed endpoints, available for free through NVIDIA's API catalog.

Experience

Access NVIDIA-hosted infrastructure and guided hands-on labs that include step-by-step instructions and examples, available for free on NVIDIA LaunchPad.

Deploy

Get a free license to try NVIDIA AI Enterprise in production for 90 days using your existing infrastructure. 

Customer Stories

How Industry Leaders Are Driving Innovation With Riva

T-Mobile Customer Story
Telecommunications

Speech AI for Award-Winning Customer Care

Customer: T-Mobile

Products: NVIDIA Riva, NVIDIA-Certified Systems

Technologies: NVIDIA Data Center GPUs, NVIDIA NeMo, NVIDIA Riva

RingCentral Customer Story
Telecommunications

World-Class Speech AI for the Best Video Conferencing Experience

Customer: RingCentral

Products: NVIDIA DGX, NVIDIA Riva

Technologies: NVIDIA Data Center GPUs, NVIDIA NeMo, NVIDIA Riva, NVIDIA Triton Inference Server

Tarteel.ai Customer Story
Academia / Higher Education

Automating Real-Time Arabic Speech Recognition

Customer: Tarteel.ai

Products: NVIDIA Riva, NVIDIA-Certified Systems

Technologies: NVIDIA NeMo, NVIDIA Riva, NVIDIA Data Center GPUs

Adopters

Leading Adopters Across All Industries

Resources

The Latest in NVIDIA Riva Resources

NVIDIA and Partners Launch Agentic AI Blueprints to Automate Work for Every Enterprise
January 07, 2025
New NVIDIA AI Blueprints for building agentic AI applications are poised to help enterprises everywhere automate work. With the blueprints, developers can now build and deploy custom AI agents. These AI agents act like “knowledge robots” that can reason, plan and take action to quickly analyze large quantities of data, summarize and distill real-time insights Read Article
AI at Your Service: Digital Avatars With Speech Capabilities Offer Interactive Customer Experiences
December 18, 2024
To enhance productivity and upskill workers, organizations worldwide are seeking ways to provide consistent, around-the-clock customer service with greater speed, accuracy and scale.
Efficiency Meets Personalization: How AI Agents Improve Customer Service
November 21, 2024
Whether it’s getting a complex service claim resolved or having a simple purchase inquiry answered, customers expect timely, accurate responses to their requests.

Next Steps

Ready to Get Started?

Use the right tools and technologies to build and deploy fully customizable, multilingual, speech and translation AI applications.

pending

For Developers

Explore everything you need to start developing with NVIDIA Riva, including the latest documentation, tutorials, technical blogs, and more.

pending

Get in Touch

Talk to an NVIDIA product specialist about moving from pilot to production with the security, API stability, and support of NVIDIA AI Enterprise.

Ai2labs

AI2Labs

In 2021, AI2Labs spun off from Yoozoo Games as a local tech startup in Singapore. AI2Labs innovates, experiments, and develops AI products and applications, enabling efficient processes and improving sustainability and business outcomes.

AI2Labs integrated Riva into their Speakr—domain-specific speech AI—speech recognition API to accommodate the intricacies of Asian speech and business domains and achieved state-of-the-art Singlish translation accuracy.

Avaya

Avaya

Avaya specializes in cloud communications and workstream collaboration solutions, providing unified communications, contact center, communications platform as a service (CPaaS), and services with their OneCloud platform.

Avaya integrated the NVIDIA Riva speech-to-text engine for real-time captions at scale. Riva enables better transcription quality, lower word-error rate, and economical delivery.

Cdac

C-DAC

For over 10 years, the Applied AI Group at C-DAC in Pune, India, has focused on research and development of speech technology. They’ve successfully created a cutting-edge speech-to-text (STT) system for Indic languages such as Hindiand Marathi. The group continues to advance their work by exploring AI-enabled, open-source deep learning frameworks, libraries, and tools for creating STT and speech-enabled applications for other Indic and low-resource languages. Experiments were conducted using various neural network architectures and topologies from NVIDIA’s open-source NeMo framework, with Citrinet and Conformer-CTC network topologies proving to be effective in building and training neural acoustic models for speech recognition. These models were trained on single- and multi-node Param Siddhi AI systems, optimizing training time and performance. Finally, the models were deployed for real-time and batch-mode inference using the Riva GPU-accelerated production pipeline.

NCS

NCS

NCS, a subsidiary of Singtel Group, is a leading technology services firm with presence in Asia Pacific and partners with governments and enterprises to advance communities through technology. Combining the experience and expertise of its 12,000-strong team across 61 specialisations, NCS provides differentiated and end-to-end technology services to clients with its NEXT capabilities in digital, data, cloud and platforms, as well as core offerings in application, infrastructure, engineering and cybersecurity. NCS also believes in building a strong partner ecosystem with leading technology players, research institutions and start-ups to support open innovation and co-creation. 

NCS uses NVIDIA Riva TTS in Breeze—the driver’s companion app—for voice-guided navigation, live traffic and road condition updates, real-time parking rates, and electronic road pricing rates and operating hours, to help Singapore drivers experience smooth driving journeys. 

Learn more.

www.ncs.co

Customer Story

Ring Central

RingCentral

RingCentral, a leading provider of global enterprise cloud communications, collaboration, and contact center solutions, serves millions of users. The RingCentral platform empowers collaboration from any location and device, improving business efficiency and customer satisfaction. RingCentral uses NVIDIA Riva for video conferencing transcription for 200,000 concurrent users on their platform.

Learn more.

www.ringcentral.com

Customer Story

GTC Session

Snap

Snap

Snap is a camera and social media company that enables multimedia message creation with filters and effects. To create more interactive experiences, Snapchat users play with Lenses—a feature that adds real-time effects into snaps—over 6 billion times per day. 

NVIDIA Riva’s noise- and lingo-optimized speech AI service is integrated into Snap AR Lens Studio, enabling creators—artists and developers—to build gripping augmented reality (AR) experiences.

T-Mobile

T-Mobile

T-Mobile, a supercharged Un-carrier, delivers an advanced 4G LTE and transformative 5G network for the best customer experience. To empower contact center agents, T-Mobile implements Expert Assist. This AI-based software uses NVIDIA Riva to transcribe real-time customer conversations that feed recommenders and assist thousands of agents.

With Riva, T-Mobile fine-tunes automatic speech recognition models on custom datasets and interprets customer jargon accurately across noisy environments.

Learn more.

www.t-mobile.com

Customer Story

GTC Session

Read Ebook- Building Speech AI Applications

Building Speech AI Applications

Explore how to get started with integrating and deploying Riva ASR and TTS models in production with high-performance inference and minimal effort.

Learn about Riva’s architecture, key features and more.

An Introduction to NVIDIA Riva

Learn about Riva’s architecture, key features, and components for building speech and translation AI services.

Read how a team of NVIDIANs won the LIMMITS ’24 challenge

NVIDIA Parlays Win in Voice Challenge

Read how a team of NVIDIANs won the LIMMITS ’24 challenge, which asked contestants to recreate in real time a speaker’s voice in English or any of six languages spoken in India with the appropriate accent.