
Show Notes
In this talk, Radovan Bacovic, Principal Data Engineer and Snowflake/dbt Ambassador, shares his two-decade journey, from traditional database administration to leading modern data platform engineering. We explore the essential building blocks of scalable data architectures, the trade-offs of no-code solutions, and how to effectively integrate AI into your data pipelines while maintaining strict security and governance. You’ll learn about: - The evolution of the full-stack data engineer over the past two decades. - Building scalable, business-driven data platforms without premature optimization. - Efficient data modeling and transformation using DuckDB and dbt. - Leveraging AI to accelerate pipeline development and launch data products. - Implementing enterprise data governance and robust pipeline security.- Balancing no-code integration tools with strict DataOps methodologies. LINKS: https://gitlab.com/radovan.bacovic/wsc26_dataops/-/blob/main/README.md?ref_type=heads
TIMECODES: 0:00 Data Engineering Career Trajectory and Industry Experience 6:37 Full Stack Data Engineer Role Evolution and Responsibilities 14:45 Scalable Data Platform Architecture and Business Alignment 21:59 DuckDB Integration and Premature Database Optimization Avoidance 30:04 Data Pipeline Transformation and Data Modeling with dbt 35:31 Modern Data Platform Ecosystem and Infrastructure Orchestration 42:13 AI Powered Data Products and LLM Pipeline Automation 49:42 Enterprise Data Governance and Pipeline Security Best Practices 55:06 No Code Data Integration Tools and DataOps MethodologyThis talk is ideal for data engineers, analytics engineers, and data platform leads looking to modernize their tech stacks and future-proof their infrastructure. It provides highly actionable insights for anyone aiming to build resilient, AI-ready data platforms that prioritize real business value and strict security constraints.
Connect with Radovan - Twitter - https://x.com/SvenMurtinson - Linkedin - https://www.linkedin.com/in/radovanbacovic/ - Github: https://gitlab.com/radovan.bacovic/ - Website: www.bacovic.com
Connect with DataTalks.Club: - Join the community - https://datatalks.club/slack.html - Subscribe to our Google calendar to have all our events in your calendar - https://calendar.google.com/calendar/r?cid=ZjhxaWRqbnEwamhzY3A4ODA5azFlZ2hzNjBAZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ - Check other upcoming events - https://lu.ma/dtc-events - GitHub: https://github.com/DataTalksClub - LinkedIn - https://www.linkedin.com/company/datatalks-club/ - Twitter - https://twitter.com/DataTalksClub - Website - https://datatalks.club/
More from DataTalks.Club
Tejas Kumar joins Alexey Grigorev to discuss building evaluation datasets, calibrating LLM judges against human preferences, and testing agents beyond their final answers.
In this talk, Dewang Sultania, ML Engineer at Netflix and co-author of Designing AI Systems, shares his technical journey from building early inference platforms at Adobe to deploying multimodal AI models at scale. We explore the complete architecture of enterprise AI platforms, focusing on evaluation datasets, tool calling orchestration, and the practical realities of shipping production agents.
In this talk, Suhas Suresha, Senior Machine Learning Engineer at Adobe and co-author of Designing AI Systems, shares his expertise in building large-scale generative AI infrastructure from deploying real-time ECG analysis models at his previous startup, QALY, to architecting enterprise LLM platforms. We explore the massive engineering effort required to take an AI application from a weekend prototype to a scalable production system, and how to build a unified AI platform that eliminates "AI sprawl."
In this talk, Sahil Walia, Senior Technical Architect at Snowflake, shares his extensive data engineering expertise from writing simple SQL queries early in his career to architecting enterprise-scale Apache Iceberg lakehouses today. We explore the evolution of the modern data platform, the mechanics of open lakehouses, and how decoupling storage from compute is transforming data architecture.
In this talk, Philip Christos, Associate at M2VC, shares his expertise in frontier AI investing from his early days as a data analyst to evaluating cutting-edge deep tech startups. We explore how AI agents are reshaping modern work, the realities of venture capital in the LLM era, and why the future of software engineering relies more on high-level systems thinking than writing syntax.You’ll learn about:- How venture capitalists formulate AI investment strategies and evaluate startup pitch decks.- The rapid adoption of AI in software engineering compared to traditional sectors like accounting.- The crucial difference between data progress and algorithmic progress in frontier models.- Why LLMs still struggle with high-level software architecture, business logic, and design "taste."- How AI is accelerating iterations and breakthroughs in classical engineering and scientific research.- What specific deep tech and AI infrastructure ideas are actually attracting VC funding today.TIMECODES:00:00 Venture Capital Career Journey05:14 VC Analyst vs Data Analyst Roles10:13 AI Investment Thesis Strategy16:00 Emotion Analytics and Voice AI Startups22:09 LLM Impact on Venture Capital28:19 Software Engineering AI Adoption34:18 Data vs Algorithmic AI Progress40:15 Classical Engineering AI Acceleration46:12 Software Architecture AI Limitations51:11 Future Software Engineering Careers57:55 Systems Thinking in DevOps1:03:00 Pitching Deep Tech StartupsThis talk is perfect for software engineers, AI founders, and technical product managers who want to understand the evolving tech job market and venture landscape. It provides essential insights for anyone looking to build VC-backed AI startups or future-proof their career as AI coding tools become ubiquitous.Connect with Philip- Linkedin - https://www.linkedin.com/in/philipchristos/- Twitter - https://x.com/phil_christos- Website - https://t.me/stacked_channelConnect with DataTalks.Club:- Join the community - https://datatalks.club/slack.html- Subscribe to our Google calendar to have all our events in your calendar - https://calendar.google.com/calendar/r?cid=ZjhxaWRqbnEwamhzY3A4ODA5azFlZ2hzNjBAZ3JvdXAuY2FsZW5kYXIuZ29vZ2xlLmNvbQ- Check other upcoming events - https://lu.ma/dtc-events- GitHub: https://github.com/DataTalksClub- LinkedIn - https://www.linkedin.com/company/datatalks-club/ - Twitter - https://twitter.com/DataTalksClub - Website - https://datatalks.club/