Show Notes
Rafael (Head of Innovation, iFood) and Daniel (Data and AI Manager, iFood) pull back the curtain on ILO-Agent — iFood's conversational AI ordering system built for 200 million users across Latin America. Recorded live at AI House Amsterdam, this conversation goes deep into the engineering and product decisions behind building recommendation systems and agentic AI, and why the speed of your AI's response might actually be destroying user trust.
The Latency Goldilocks Zone Explained // MLOps Podcast #376 with iFood's Rafael Borger (Head of Innovation) and Daniel Wolbert (Data and AI Manager)
🍕 Recommendation Systems at Scale — Why personalizing for 200M users with wildly different food tastes, budgets, and cultures is a fundamentally different problem than standard ML 🤖 ILO-Agent Deep Dive — What iFood's conversational AI agent actually does, how it handles open-ended requests ("a romantic dinner for two, my wife hates onions"), and where it's headed ⏱️ The Latency Goldilocks Zone — The fascinating insight that LLM responses can be too fast (users don't trust them) or too slow (users abandon) — and how to find the sweet spot 🧠 Perceived vs. Actual Latency — Why showing progress indicators and partial results can make a 6-second response feel instant, and how iFood uses this in production 🛒 The Tinder for Food Experience — How iFood is experimenting with swipe-based discovery to solve "I don't know what I want to eat" for millions of undecided users 🗣️ Voice vs. Text AI Interfaces — Why voice ordering limits you to 6 items in 30 seconds, and why text-based agents need radically different output design 🔗 Agent-to-Agent (A2A) Architectures — What happens when your customer support agent and your ordering agent need to collaborate, and the standardization challenges ahead 📊 Measuring Product-Market Fit for AI — Why the Sean Ellis / Chanel score method breaks down in Brazil, and what iFood uses instead 🏗️ Scalability vs. Ecosystem Health — The real tension between consuming partner APIs aggressively and keeping the food delivery ecosystem sustainable 🌎 Building AI for Global-Local Markets — Why one-size-fits-all AI products fail and how iFood builds for cultural and economic diversity simultaneously.
This episode is for ML engineers, AI product managers, and data scientists building production AI systems at scale — especially if you're working on recommendation, retrieval, or agentic systems in consumer apps.
🔗 Links & Resources MLOps.community: https://mlops.community AI House Amsterdam: https://aihouse.amsterdam iFood: https://www.ifood.com.br/ iFood AILO launch coverage: https://tiinside.com.br/en/10/10/2025/ifood-lanca-ailo-assistente-de-ia-que-inaugura-pedidos-por-conversa/ iFood AI case study (AWS): https://aws.amazon.com/solutions/case-studies/ifood-bedrock/ Related MLOps Community talk — "From Zero to AILO" by Nishikant Dhanuka & Chiara Caratelli: https://home.mlops.community/public/videos/from-zero-to-ailo-lessons-learned-from-building-ifoods-ai-agent-nishikant-dhanuka-and-chiara-caratelli-2025-11-25 ZenML LLMOps database write-up on iFood's hyper-personalized agent: https://www.zenml.io/llmops-database/building-a-hyper-personalized-food-ordering-agent-for-e-commerce-at-scale
⏱️ Timestamps [00:00] Recommending the unknown [00:18] Ailo Hyperpersonalization Insight [06:24] Predictive Personalization Insights [09:13] "Jet skis" of innovation [17:45] Consumer Behavior and Chatbots [26:33] Perceived Latency and Engagement [33:22] AI-driven UI Evolution [38:17] LCM Voice Mode Inquiry [45:20] Chat as Interface [47:46] Wrap up
More from Agentic Conversations (formally mlops.community)
What happens when you give 200 engineers who have barely touched AI a coding assistant and a six-month deadline to rebuild their platform? Pepijn Senders, a principal engineer who previously led AI enablement at HelloFresh, has done exactly that, and he chose Sonnet over Opus on purpose.
An AI slips out of its sandbox. A chatbot won’t explain your cat’s stripes. And your next shopping spree might not involve you clicking anything.
What happens to the web when the ones browsing it are no longer people? Sarah Drasner, Area Tech Lead at Google, sits down with us ahead of her Agentic Web keynote at AGNTCon + MCPCon North America. She works through that question from both directions: rebuild the web so agents can use it properly, or build agents smart enough to handle the web as it already exists.
Everyone is racing to build one agent that can do everything. Justin Schroeder, co-founder of Standard Agents, thinks the future looks more like thousands of tiny ones. Ahead of his talk on domain-specific agents at AGNTCon + MCPCon North America, he explains why tightly scoped agents might be the smarter bet, even if it feels like a step back toward the single-purpose machine learning models of a few years ago.
What happens to an MMORPG when half the players never log off? Issac Lee, who runs AI and blockchain experiments at NEXUS, has been testing that idea. His team is filling game worlds with agent players instead of scripted NPCs, so a new title feels alive from day one.