Instacart cut feature store latency in half by running fewer nodes. Using Dragonfly’s multi-threaded engine, hundreds of nodes became roughly 100. This is part of our 7th annual MLOps World | GenAI Summit. Hope you can join us!

Nalin Dadhich, Senior Machine Learning Engineer, NVIDIA, built the synthetic data that took Cosmos 3 to #1. → Big Ideas, Innovations and Creative Explorations track. MLOps World Austin, Tuesday November 17, 2:10 p.m. mlopsworld.com

“Alternating between inference sampling and gradient updates creates severe low GPU duty cycles (~40%) during LLM reinforcement learning pipelines.” → Hardware and Chips track. MLOps World Austin, Wednesday November 18, 11:30 a.m

“A leaderboard win is not a product.” Kalpesh Sutaria (Director, NVIDIA) worked on Nemotron Retriever, which ranks #1 on RTEB but still wasn’t runnable for customer production. → Hardware and Chips track. MLOps World Austin mlopsworld.com

In their own words, cost came up more than anything else. @CoreWeave sits right in the middle of these discussions. They are our Platinum sponsor for MLOps World Austin. 📅 November 16 to 19 → Details and registration mlopsworld.com

A multi-agent pipeline that worked, but was slow and expensive. Parallelizing the independent roles cut runtime by roughly 40%. A per-role comparison of model tiers cut per-run cost by roughly 40% more. 📅 November 17 and 18, mlopsworld.com

A multi-agent pipeline that worked, but was slow and expensive. Parallelizing the independent roles cut runtime by roughly 40%. A per-role comparison of model tiers cut per-run cost by roughly 40% more. 📅 November 17 and 18, Austin. mlopsworld.com

Sandeep Mannapur (Staff Performance Engineer at ServiceNow) had three weeks of degraded responses already shipped by then, and every monitoring signal was green the entire time. → MLOps World Austin, Monday November 16, 12:05 p.m., virtual session day. mlopsworld.com

Jazmia Henry (Lead AI Research Engineer, collide.) is in our Evals and Benchmarks track, led by Suhas Pai. You leave with the case for decomposing reward into dimensions you can verify one at a time. 📅 Monday November 16, virtual session day mlopsworld.com

Attendees will learn from real case studies, and get a better idea of which metrics survive contact with production, and a better sense of where your evals may be giving false positives. 📅 November 17 and 18, 📍 Etter-Harbin Alumni Center, Austin. mlopsworld.com

Autonomous research agents that propose, implement, and refine ML solutions are priced out by the loop, not the model. → Recursive Self-Improvement track. MLOps World Austin, Wednesday November 18, 11:30 a.m., Etter-Harbin Alumni Center mlopsworld.com

67% of a multi-agent pipeline's latency came from a small minority of agent roles. The bottleneck wasn't the model. It was sequential chaining. Nadia Rauch (Chubb) on how parallelizing independent roles cut runtime by ~40%. Austin, Nov 17 mlopsworld.com/

Autonomous research agents are priced out by the loop, not the model. Vashishtha Patil (Amazon, Alexa+) tests a small open-weight model running the loop end to end, calling a frontier advisor only at set points on a metered budget. Austin, Nov 18 mlopsworld.com/

Where are your evals giving you false positives? KOHO, Wisedocs and Drew Crawford bring real case studies: governance on AWS, sensitive failure slices, the limits of LLM-as-a-judge, and agents evaluated against other agents. Austin, Nov 17-18 mlopsworld.com/

Ground reward in what the environment can verify, not in human proxies. Jazmia Henry (collide.) built production RL agents for BlackRock and Moody's at Microsoft. Her case: decompose reward into dimensions you verify one at a time. Nov 16, virtual: mlopsworld.com/

This November, Austin becomes the place where AI in production gets real. Engineers + leaders from OpenAI, NVIDIA, finance, healthcare & manufacturing. 700+ practitioners comparing notes. 50+ sessions. 8 tracks. Workshops, food, drinks & socials. mlopsworld.com/

Accuracy alone was no longer sufficient. The team had to account for latency, cost, failure severity, cross-component effects, and make it easy to deduce where something went wrong. Read full abstract here: lnkd.in/g4Jqnw92

Giving an agent the same access as a human engineer is the fastest way to create an insider threat nobody authorized. → MLOps World Austin. Tuesday November 17 a.m mlopsworld.com/

Tony Blank says that when priorities tightened, his team could not defend the spend or point to a dollar return. So they stopped buying per-person subscriptions and started automating one repeated hour at a time. → MLOps World Austin. November 17-18 mlopsworld.com/

Being tied to one API or one provider isn't a risk you notice until the pricing changes or a better, cheaper model shows up that you can't switch to! The AI Sovereignty track at MLOps World | GenAI Summit Austin. → mlopsworld.com/