Red Hat® User Group (RHUG) events offer a unique opportunity for Red Hat technology users to gather and discover solutions to IT challenges with subject matter experts & peers. Join the next RHUG to network and explore cutting-edge solutions for IT modernization. Don’t miss this opportunity to transform your IT services while enjoying great food and building connections with industry professionals.
Deploying large language models at scale presents challenges, including high GPU costs, unpredictable latency, and black-box infrastructure that doesn’t align with cloud-native practices. The solution? llm-d, a new open-source framework developed in collaboration with Red Hat, Google, NVIDIA, and Hugging Face. Built on Kubernetes, llm-d disaggregates LLM inference into composable, observable services — like prefill, decode, and shared caching — all orchestrated by an intelligent Inference Gateway. In this session, we’ll explore the architecture behind llm-d, compare it to traditional inference stacks, and show how it empowers enterprises to run GenAI workloads with greater efficiency, flexibility, and control.
Join the Los Angeles Red Hat User Group (RHUG) and the LA DevOps community for an evening of connection, insight and innovation.
Event Details:
Date: August 28, 2025
Time: 6-9 PM PT
Venue: O'Brien's Irish Pub: 2226 Wilshire Blvd, Santa Monica, CA 90403
Location:
O'Brien's Irish Pub
2226 Wilshire Blvd
Santa Monica, California 90403, United States
Date: Thursday, August 28, 2025
Time: 6:00 PM - 9:00 PM (UTC-07:00) Pacific Time (US & Canada)
*Food and drink will be provided.
Any questions? Reach out to rhug@redhat.com.