Using NVIDIA GPUs WITH Red Hat OpenShift Data Science and Open Data Hub for model training and serving (Presented by Red Hat, Inc.)
, Red Hat
, Red Hat
Red Hat OpenShift Data Science (RHODS) is a managed cloud service offering based on the open-source Open Data Hub (ODH) project, providing data scientists with everything they need in an accessible and convenient way. It also can benefit from the power of NVIDIA GPUs that help accelerate model training. ODH provides open-source AI tools for data storage, distributed AI and machine learning (ML) workflows, Jupyter Notebook development environment, and monitoring on OpenShift Container Platform. We'll provide a proof of concept for end-to-end integration of ODH, NVIDIA GPUs, and Triton server that's used for GPU-accelerated inference. We'll round out this presentation with a demonstration of the combined solution using a performance-intensive BERT model to play a game of trivia.