Demo
Your Personalized AI Chatbot
Version 0.4
ChatRTX is a demo app that lets you personalize a GPT large language model (LLM) connected to your own content—docs, notes, images, or other data. Leveraging retrieval-augmented generation (RAG), TensorRT-LLM, and RTX acceleration, you can query a custom chatbot to quickly get contextually relevant answers. And because it all runs locally on your Windows RTX PC or workstation, you’ll get fast and secure results.
ChatRTX supports various file formats, including txt, pdf, doc/docx, jpg, png, gif, and xml. Simply point the application at the folder containing your files and it'll load them into the library in a matter of seconds.
ChatRTX features an automatic speech recognition system that uses AI to process spoken language and provide text responses with support for multiple languages. Simply click the microphone icon and talk to ChatRTX to get started.
Let ChatRTX do the work—sort through your photo albums with a simple text or voice search, keeping everything private and hassle-free.
Simply download, install, and start chatting right away.
The ChatRTX tech demo is built from the TensorRT-LLM RAG developer reference project available from GitHub. Developers can use that reference to develop and deploy their own RAG-based applications for RTX, accelerated by TensorRT-LLM.
Upgrade to advanced AI with NVIDIA GeForce RTX™ GPUs and accelerate gaming, creating, productivity, and development. Thanks to specialized built-in AI processors, you get world-leading AI technology and performance powering everything you do—plus, your data always stays secure on your Windows PC.
Explore NVIDIA’s generative AI developer tools and enterprise solutions.
NVIDIA Privacy Policy