Telecommunications
Amdocs Builds Generative AI Agents for Telecom
Overview
Amdocs, a leading provider of software and services for communications and media providers, built amAIz—a domain-specific generative AI platform that helps telecom companies transform customer experiences, automate processes, and optimize decision-making. Amdocs is using NVIDIA DGX™ Cloud and NVIDIA AI Enterprise software to develop and deliver solutions based on commercially available large language models (LLMs) and domain-adapted models. They’re also using NVIDIA NIM™, a set of easy-to-use inference microservices designed to accelerate the deployment of generative AI across enterprises.
Partner
Amdocs
Audience
Executive
Use Case
Generative AI / LLMs
Products
NVIDIA AI Enterprise
NVIDIA DGX
NVIDIA NIM
Amdocs
Amdocs Accelerates Generative AI Performance and Lowers Costs
Collaborating with NVIDIA, Amdocs kick-started their strategy to integrate generative AI into their core portfolio. They began by identifying application areas and then moved to making generative AI capabilities more user friendly through UX redesign and prioritizing fast engineering. By optimizing data formats and fine-tuning LLMs, Amdocs enhanced the accuracy of their billing Q&A system while significantly reducing costs.
The engagement with NVIDIA delivered noteworthy increases in the accuracy of AI-generated responses, boosting accuracy by up to 30 percent. This type of improvement is pivotal for achieving widespread telco industry adoption and meeting the demands of direct-to-consumer generative AI services.
Using NVIDIA NIM microservices, Amdocs also achieved performance improvements in cost and latency:
- Decreased costs to operate: Using telecom-based retrieval-augmented generation on NVIDIA infrastructure, Amdocs reduced the number of tokens consumed for deployed use cases—by as much as 60 percent for data preprocessing and by up to 40 percent for inferencing. This enabled them to achieve the same level of accuracy at a significantly lower cost per token, depending on various influences and volumes used.
- Latency enhancements: The collaboration has successfully reduced query latency by approximately 80 percent, ensuring that end users experience near-real-time responses. This acceleration enhances user experiences across commerce, care, operations, and beyond.
Amdocs plans to continue integrating generative AI into their amAIz platform in multiple ways:
- Enhancing customer-query routing using AI-driven analysis of language and sentiment
- Enhancing the reasoning capabilities of their AI solutions to provide suggestions tailored to customers’ specific needs
- Addressing complex scenarios that demand extensive domain knowledge and multimodal, multi-step solutions, such as network diagnostics and optimization
Watch the on-demand NVIDIA GTC session and learn more about the Amdocs amAIz platform.
“Amdocs’ strategic partnership with NVIDIA has been crucial in our acceleration of generative AI capabilities. This allows us to build on infrastructure and frameworks that solve the needs of our customers as they evolve.”
Anthony Goonetilleke
Group President, Technology and Head of Strategy, Amdocs
Explore how other telecom leaders are transforming with generative AI.