Text-Based Applications
Whether it’s a RAG-based chatbot, a plug-in for an existing application, or a code generation tool, the possibilities are endless. Build generative AI projects that output text, featuring a primary model accelerated with TensorRT-LLM on Windows PCs for RTX.
Developers can choose to use a pre-optimized model for RTX (Llama 2, Mistral 7B, Phi-2, Code Llama), any community model optimized for TensorRT-LLM, or your own optimized model for TensorRT-LLM.