LLMOps with Hopsworks and Modal Labs 🧪
Wed, May 08, 2024, 06:30 PM - 08:30 PM (EDT)
Midtown (New York)
100 attendees
Join PyData NYC on May 8th at 6:30 pm for a talk night with Jim Dowling (CEO of Hopsworks) and Eric Bernhardsson (CEO of Modal Labs). Please bring your 💻 to code along and sign up with your government official name!
🏢 Venue sponsored by Microsoft - thank you
Agenda:
Modular AI Systems with Feature, Training, Inference Pipelines on Hopsworks - a LLMOps Tutorial
Speaker: Jim Dowling
In this tutorial, we will introduce a unified architecture for Batch, Real-Time, and LLM AI Systems based around three independent ML pipelines -
* a feature pipeline to create feature data,
* a training pipeline to train your model,
* and an inference pipeline to make predictions with new data on your trained model.
We will use this FTI architecture to walk through a tutorial of building a LLM system that uses RAG and function calling to access structured data and a model.
Jim Dowling is CEO of Hopsworks and an Associate Professor at KTH Royal Institute of Technology. He is lead architect of the open-source Hopsworks Feature Store platform and the organizer of the annual feature store summit. He is writing a book for O'Reilly on Building AI systems with a Feature Store - batch, real-time, and LLMs.
Introduction to Modal
Speaker: Eric Bernhardsson
Modal's platform empowers data/AI/ML teams to develop faster at lower cost, while scaling production workloads to thousands of CPUs and GPUs.
Networking
Connect with fellow data enthusiasts, professionals, and community leaders. Build meaningful connections and forge collaborations.
----------------------------------------------------------------
The building requires a government-issued photo ID for entrance.
This, and all PyData NYC events, is an all-level event. Newcomers and beginners are welcome.
This, and all NumFOCUS-affiliated events and spaces, both in-person and online, are governed by a Code of Conduct.
----------------------------------------------------------------
This event may be recorded.
LLMOps with Hopsworks and Modal Labs 🧪
Hosts
Wed, May 08, 2024, 06:30 PM - 08:30 PM (EDT)
Midtown (New York)
100 attendees
🏢 Venue sponsored by Microsoft - thank you
Agenda:
Modular AI Systems with Feature, Training, Inference Pipelines on Hopsworks - a LLMOps Tutorial
Speaker: Jim Dowling
In this tutorial, we will introduce a unified architecture for Batch, Real-Time, and LLM AI Systems based around three independent ML pipelines -
* a feature pipeline to create feature data,
* a training pipeline to train your model,
* and an inference pipeline to make predictions with new data on your trained model.
We will use this FTI architecture to walk through a tutorial of building a LLM system that uses RAG and function calling to access structured data and a model.
Jim Dowling is CEO of Hopsworks and an Associate Professor at KTH Royal Institute of Technology. He is lead architect of the open-source Hopsworks Feature Store platform and the organizer of the annual feature store summit. He is writing a book for O'Reilly on Building AI systems with a Feature Store - batch, real-time, and LLMs.
Introduction to Modal
Speaker: Eric Bernhardsson
Modal's platform empowers data/AI/ML teams to develop faster at lower cost, while scaling production workloads to thousands of CPUs and GPUs.
Networking
Connect with fellow data enthusiasts, professionals, and community leaders. Build meaningful connections and forge collaborations.
----------------------------------------------------------------
The building requires a government-issued photo ID for entrance.
This, and all PyData NYC events, is an all-level event. Newcomers and beginners are welcome.
This, and all NumFOCUS-affiliated events and spaces, both in-person and online, are governed by a Code of Conduct.
----------------------------------------------------------------
This event may be recorded.