Project G-Assist takes voice or text inputs from the player, along with a snapshot of what’s in the game window. The snapshot is fed into AI vision models that provide context awareness and app-specific understanding for the Large Language Model (LLM), which is connected to a database of game knowledge such as a wiki. The output of the LLM is an insightful and personalized response—either text, or speech from the AI —based on what’s happening in-game.
NVIDIA partnered with Studio Wildcard to demo the technology with ARK: Survival Ascended. Project G-Assist can help answer questions about creatures, quests, items, lore, difficult to tackle bosses and more. And because Project G-Assist is context-aware, it personalizes its responses to the user’s playthrough.
Additionally, Project G-Assist can evaluate your system’s configuration and performance, and instantly tune it for an optimal experience. Apply NVIDIA app’s optimized game settings, based on extensive testing on thousands of hardware configurations; enable Performance Tuning to apply a safe GPU overclock; switch on NVIDIA Reflex to reduce system latency for more responsive gaming; plus so much more.
We envision AI assistants transforming the way we engage with our favorite games and apps. Imagine getting instant context-aware assistance with a complex creative workflow in a photo or video app. Or an AI coach analyzing your multiplayer replays, teaching you strategies to move up the ranks in competitive matches. Project G-Assist is a glimpse into that future.
Project G-Assist won’t play a game for you like we suggested in our prophetic 2017 April Fool’s video, but it can help you get more out of your favorite games, and find help for a troublesome boss. Takeout ordering, however… we could definitely add that to the roadmap.
For further details, check out our dedicated Project G-Assist article.