What we’re about
Whether building a web, VOIP, or gaming backend, Operations is using development tools to make it work.
We're interested in the built-in facilities in Linux and the BSDs to programmatically seed and deploy. We're building traditional UNIX infrastructure with lighttpd/Nginx/Apache, Syslog, NFS, LDAP, MySQL/Postgres and BIND/PowerDNS, but doing it with modern scripting languages (Python, Ruby, Perl...) and revision-control. Debconf in Debian and Ubuntu. Kickstart in Redhat and CentOS. pc-sysinstall on BSD. A mix of cloud, hosted and datacenter-minded folks. Expect musings on Puppet, Chef, Augeas, Fabric, CFEngine, and FAI.
Upcoming events (1)
See all- llm-d: Making AI a First-Class Citizen in Modern Infrastructure Photo of JordanO'Briens Irish Pub, Santa Monica, CA
For the August L.A. DevOps Meetup Christopher Nuland from Red Hat will be discussing llm-d a Kubernetes-native distributed inference serving stack, built by leaders in the Kubernetes and vLLM projects.
See the Presentation Details section below for more info.The second presentation is to be announced.
Sponsored by Red Hat!
Thanks to Red Hat for sponsoring LA DevOps!Join the Los Angeles Red Hat User Group on meetup.com at https://www.meetup.com/los-angeles-rhug/ to keep up with LA-RHUG events.
Event Details:
6:00 - 6:30 Attendees arrive. Networking/Mingle
6:30 - 6:45 LA DevOps Welcome,Attendee Introductions
6:45 - 7:30 Christopher Nuland - llm-d: Making AI a First-Class Citizen in Modern Infrastructure
7:30 - 8:00 Second Presentation TBA
8:00 - 9:00 Networking/MinglePresentation Details:
Title: llm-d: Making AI a First-Class Citizen in Modern Infrastructure
Presented by: Christopher Nuland
Description:
Deploying large language models at scale presents challenges, including high GPU costs, unpredictable latency, and black-box infrastructure that doesn’t align with cloud-native practices. The solution? `llm-d`, a new open-source framework developed in collaboration with Red Hat, Google, NVIDIA, and Hugging Face. Built on Kubernetes, `llm-d`disaggregates LLM inference into composable, observable services — like prefill, decode, and shared caching — all orchestrated by an intelligent Inference Gateway. In this session, we’ll explore the architecture behind `llm-d`, compare it to traditional inference stacks, and show how it empowers enterprises to run GenAI workloads with greater efficiency, flexibility, and control.About Christopher:
Christopher Nuland is a Principal Technical Marketing Manager for AI at Red Hat and has been with the company for over six years. Before Red Hat, he focused on machine learning and big data analytics for companies in the finance and agriculture sectors. Once coming to Red Hat, he specialized in cloud native migrations, metrics-driven transformations, and the deployment and management of modern AI platforms as a Senior Architect for Red Hat’s consulting services, working almost exclusively with Fortune 50 companies until recently moving into his current role. Christopher has spoken worldwide on AI at conferences like KubeCon EU/US and Red Hat’s Summit events.About O'Brien's Pub on Wilshire:
The covered patio at Obrien's Pub has been a great place to host LA DevOps meetups for our post covid revival. The food and drink are great and the staff are very friendly. O'brien's is also the LA home of Manchester United Football Club Supporters.
You may want to bring a jacket for the cooler months.Regarding parking, there are meters on Wilshire and the side streets that expire at 6.
Hangout at Code and Cocktails Santa Monica at Obrien's on Most Friday Nights:
The Santa Monica Code and Cocktails meetup is a great informal tech meetup that meets at Obrien's on most Friday nights. Join their page on meetup.com and discord channel to keep up on their meetups.Present at an Upcoming LA DevOps Meetup:
If you would like to present at an upcoming LA DevOps meetup please send a message in meetup to the organizers with a proposed title and a sentence or two about the talk.Subscribe to the LA DevOps Meetup Calendar at lu.ma
The LA DevOps events are also listed on lu.ma which has an interesting interface. Subscribe to LA DevOps on lu.ma at https://lu.ma/calendar/cal-F7BPqBLAe80T5nS
