Show Notes
In this talk, Aleksandr Kim, Senior Data Scientist at Intuit, shares his expertise in building AI-powered features in production from fine-tuning BERT models in cyber security to engineering scalable data verification platforms. We explore the reality of moving beyond messy research code to build observable, cost-effective AI agents and automated pipelines.You’ll learn about:- Translating traditional machine learning metrics into actionable business outcomes- Validating large language model behavior through robust evaluation and alignment techniques- Pivoting from a generic chatbot project to high-value Slack automation workflows- Structuring outputs and guided reasoning layers to eliminate trivial AI summaries- Defining the overlapping skills between AI engineers, data scientists, and full-stack software engineers- Implementing multi-LLM routing logic and token caching to minimize enterprise API expenses- Identifying critical data infrastructure bottlenecks to determine when to pivot or drop an AI pilotTIMECODES:00:00 AI Engineering Production and Scalability06:12 Intuit Ecosystem and QuickBooks Products12:17 Aligning ML Metrics with Business Outcomes18:52 AI Engineers Conducting Customer Interviews25:13 Structured Output and Guided Reasoning31:13 Defining AI Engineering vs Software Engineering37:20 Cost Optimization and Multi LLM Routing43:26 UI Trends and Token Management in Industry49:33 Future Career Trends in AI Engineering55:46 Data Infrastructure Bottlenecks and ML FailuresThis session is designed for mid-to-senior level Data Scientists, Machine Learning Engineers, and Software Engineers who want to develop a highly practical, production-first approach to generative AI. It is especially useful for technology leads focused on reducing token overhead and building self-correcting agentic systems.Connect with Aleksandr- Website - https://alexkimds.github.io/- Linkedin - https://www.linkedin.com/in/aleksandrkim/
More from DataTalks.Club
Tejas Kumar joins Alexey Grigorev to discuss building evaluation datasets, calibrating LLM judges against human preferences, and testing agents beyond their final answers.
In this talk, Dewang Sultania, ML Engineer at Netflix and co-author of Designing AI Systems, shares his technical journey from building early inference platforms at Adobe to deploying multimodal AI models at scale. We explore the complete architecture of enterprise AI platforms, focusing on evaluation datasets, tool calling orchestration, and the practical realities of shipping production agents.
In this talk, Suhas Suresha, Senior Machine Learning Engineer at Adobe and co-author of Designing AI Systems, shares his expertise in building large-scale generative AI infrastructure from deploying real-time ECG analysis models at his previous startup, QALY, to architecting enterprise LLM platforms. We explore the massive engineering effort required to take an AI application from a weekend prototype to a scalable production system, and how to build a unified AI platform that eliminates "AI sprawl."
In this talk, Sahil Walia, Senior Technical Architect at Snowflake, shares his extensive data engineering expertise from writing simple SQL queries early in his career to architecting enterprise-scale Apache Iceberg lakehouses today. We explore the evolution of the modern data platform, the mechanics of open lakehouses, and how decoupling storage from compute is transforming data architecture.
In this talk, Philip Christos, Associate at M2VC, shares his expertise in frontier AI investing from his early days as a data analyst to evaluating cutting-edge deep tech startups. We explore how AI agents are reshaping modern work, the realities of venture capital in the LLM era, and why the future of software engineering relies more on high-level systems thinking than writing syntax.You’ll learn about:- How venture capitalists formulate AI investment strategies and evaluate startup pitch decks.- The rapid adoption of AI in software engineering compared to traditional sectors like accounting.- The crucial difference between data progress and algorithmic progress in frontier models.- Why LLMs still struggle with high-level software architecture, business logic, and design "taste."- How AI is accelerating iterations and breakthroughs in classical engineering and scientific research.- What specific deep tech and AI infrastructure ideas are actually attracting VC funding today.TIMECODES:00:00 Venture Capital Career Journey05:14 VC Analyst vs Data Analyst Roles10:13 AI Investment Thesis Strategy16:00 Emotion Analytics and Voice AI Startups22:09 LLM Impact on Venture Capital28:19 Software Engineering AI Adoption34:18 Data vs Algorithmic AI Progress40:15 Classical Engineering AI Acceleration46:12 Software Architecture AI Limitations51:11 Future Software Engineering Careers57:55 Systems Thinking in DevOps1:03:00 Pitching Deep Tech StartupsThis talk is perfect for software engineers, AI founders, and technical product managers who want to understand the evolving tech job market and venture landscape. It provides essential insights for anyone looking to build VC-backed AI startups or future-proof their career as AI coding tools become ubiquitous.Connect with Philip- Linkedin - https://www.linkedin.com/in/philipchristos/- Twitter - https://x.com/phil_christos- Website - https://t.me/stacked_channelConnect with DataTalks.Club:- Join the community - https://datatalks.club/slack.html- Subscribe to our Google calendar to have all our events in your calendar - https://calendar.google.com/calendar/r?cid=ZjhxaWRqbnEwamhzY3A4ODA5azFlZ2hzNjBAZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ- Check other upcoming events - https://lu.ma/dtc-events- GitHub: https://github.com/DataTalksClub- LinkedIn - https://www.linkedin.com/company/datatalks-club/ - Twitter - https://twitter.com/DataTalksClub - Website - https://datatalks.club/