In this technology demonstration, we will showcase the deployment of an AI workload using Cisco Intersight automation on a single UCS X-Series blade, leveraging a neighboring X440p (X-Fabric) with an NVIDIA A40 GPU. This demo will highlight the powerful capabilities of both Cisco Intersight and the Cisco AI Toolkit, which includes tools for AI model deployment, system monitoring, and resource management. By utilizing Miniconda for environment management, CUDA for GPU acceleration, and various large language models like Vicuna and Meta OPT, we will feed data into a retrieval-augmented generation (RAG) model.

A cloud managed, high performance, easy to deploy and operate, consolidated network - integrated with your Al stack.

Secure your network. Observe your apps. Streamline your business. Breathe a little easier. Introducing Cisco Full Stack Observability (FSO).

Designed to be managed exclusively from the cloud.

Cisco Full-Stack Observability (FSO) Solutions on AWS - Connect the dots for your app-first world