Collaborating with NVIDIA, Amdocs kick-started their strategy to integrate generative AI into their core portfolio. They began by identifying application areas and then moved to making generative AI capabilities more user friendly through UX redesign and prioritizing fast engineering. By optimizing data formats and fine-tuning LLMs, Amdocs enhanced the accuracy of their billing Q&A system while significantly reducing costs.
The engagement with NVIDIA delivered noteworthy increases in the accuracy of AI-generated responses, boosting accuracy by up to 30 percent. This type of improvement is pivotal for achieving widespread telco industry adoption and meeting the demands of direct-to-consumer generative AI services.
Using NVIDIA NIM microservices, Amdocs also achieved performance improvements in cost and latency:
- Decreased costs to operate: Using telecom-based retrieval-augmented generation on NVIDIA infrastructure, Amdocs reduced the number of tokens consumed for deployed use cases—by as much as 60 percent for data preprocessing and by up to 40 percent for inferencing. This enabled them to achieve the same level of accuracy at a significantly lower cost per token, depending on various influences and volumes used.
- Latency enhancements: The collaboration has successfully reduced query latency by approximately 80 percent, ensuring that end users experience near-real-time responses. This acceleration enhances user experiences across commerce, care, operations, and beyond.
Amdocs plans to continue integrating generative AI into their amAIz platform in multiple ways:
- Enhancing customer-query routing using AI-driven analysis of language and sentiment
- Enhancing the reasoning capabilities of their AI solutions to provide suggestions tailored to customers’ specific needs
- Addressing complex scenarios that demand extensive domain knowledge and multimodal, multi-step solutions, such as network diagnostics and optimization
Watch the on-demand NVIDIA GTC session and learn more about the Amdocs amAIz platform.