Level: Intermediate to Advanced
Prerequisite: See below
Large language models (LLMs) have transformed the way organizations interact with their data through natural language. While these models can deliver impressive results right out of the box, their true business potential is unlocked when they are customized to meet specific needs. This hands-on workshop equips you with the practical skills to implement retrieval-augmented generation (RAG) systems, empowering your LLMs to access, interpret, and leverage your organization’s unique data assets.
In this workshop, you will learn to build and optimize a complete RAG pipeline—from selecting the right models and preparing your data to applying effective retrieval strategies and evaluation techniques, while also implementing robust guardrails for responsible AI use. Through interactive labs and real-world case studies, you will explore both foundational concepts and advanced optimizations that make LLMs indispensable in business environments.
By the end of the session, you’ll gain hands-on experience with the essential components needed to develop, evaluate, and deploy customized LLM applications that generate measurable business value.
You Will Learn
- How LLMs function and the practical considerations in model selection
- The fundamentals of prompt engineering to enhance LLM performance
- How to build a complete retrieval-augmented generation (RAG) pipeline
- Techniques for evaluating and measuring RAG system performance
- Methods for identifying and resolving common RAG failure points
- How to implement tracing and guardrails for secure, responsible AI systems
- Best practices for scoping and executing RAG projects that deliver business value
Geared To
- Data scientists and engineers deploying LLM applications
- AI/ML practitioners seeking to enhance their RAG implementation skills
- Software developers integrating LLMs into business solutions
- Technical leaders planning LLM implementation strategies
- Business analysts exploring practical applications of generative AI
- Anyone ready to move beyond basic LLM usage to create tailored, business-specific AI solutions
Pre-requisites
Workshop exercises will feature pre-written Python code, meant to be run in an online notebook.
The instructor will guide you on how to run the code, but comfort reading code will help.
Laptop Setup
Students must bring their laptops to class.
Note on Corporate Laptops:
This course requires browser access to Google Colab and other web services, as well as the ability to download data files and library files.
If your corporate laptop blocks such activities, we recommend you bring and use a personal device instead.
Machine Requirements:
Windows PC or Mac with
- Google Chrome or another web browser
- Access to Google Drive
Setup:
Instructions will be emailed to registrants prior to the event to prepare your laptop before the conference.
There is no time allotted in class for laptop preparation.
* Enrollment is limited to 40 attendees.