The patterns of Focal Data Modeling and Identity Resolution with Patrik Lager - Episode #82
Agile Data N’ InfoShow Notes
In this episode of the Agile Data Podcast, where host Shane Gibson sits down with Patrik Lager, a data integration expert with 25 years of experience and a lead developer of the Focal framework. In this episode, the conversation explores the intricate world of Focal data modeling and identity resolution. Patrik explains how the Focal framework operates as a highly abstract, metadata-driven engine that creates an extremely agile, non-destructive architecture. By focusing on understanding the business and using documentation to generate code, Focal ensures that your architecture and documentation are always perfectly in sync. The discussion also dives deep into the complexities of identity resolution, clarifying the crucial differences between stable “identities” (surrogate keys) and system-specific “identifiers”. Patrik breaks down how the Focal framework prevents key collisions and achieves seamless key integration across multiple source systems using a specialized identifier table. Whether you are curious about ensemble modeling techniques, how AI and metadata-driven automation are changing data engineering, or want to learn about the new Daana command-line interface (CLI) that makes implementing Focal easier than ever, this episode is packed with valuable insights for data professionals.
You can get in touch with Patrik via LinkedIn or over at https://daana.dev If you want want to read a summary generated with GenAI, head over to: https://agiledata.substack.com/i/196898093/google-notebooklm-briefing
If you want to download the transcript for the podcast, head over to: https://agiledata.substack.com/i/196898093/transcript
Listen to more podcasts on applying Agile Data patterns over at https://podcast.agiledata.io/ Read more on the Agile Data Way of Working over at https://AgileDataGuides.com/
If you just want to talk about making magic happen with agile and data you can connect with Shane @shagility on LinkedIn.
Subscribe: Apple Podcast | Spotify | Google Podcast | Amazon Audible | TuneIn | iHeartRadio | PlayerFM | Listen Notes | Podchaser | Deezer | Podcast Addict |
<-OO-> Information Product Canvas Workshop
“That’s not what I wanted.”“But that’s what you asked for.”
Shane runs a one-day workshop on the Information Product Canvas, a repeatable way to gather data requirements in 30 minutes. The approach he actually uses with his stakeholders, not a textbook version that falls apart on contact with messy data and vague stakeholder requirements. Latest dates: Gather data requirements in 30 minutes using a shared language.
Simply Magical Data Ways of Working
More from Agile Data N’ Info
In this episode Shane Gibson sits down with data modeling veteran’s John Giles and Remco Broekmans The conversation explores the premise of democratising data modeling through AI, centered around a paper published by John regarding where AI can and cannot add real value. The group highlights the critical importance of conceptual and context data modeling, stressing that business terms and definitions must be established upfront before looking at physical source tables. They strongly critique the anti-pattern of placing humans “at the end of the line” merely to rubber-stamp automated outputs, arguing instead for an “AI-in-the-loop” approach where technology serves strictly as an assistant under human direction. The discussion also dives deep into complex real-world scenarios where automated tools fail—specifically when physical data or source systems do not yet exist. John shares extreme edge cases, such as establishing a brand-new government department from scratch based on a vague Act of Parliament, unifying over 70 distinct healthcare organisations into a single model, and modeling evolving visions like the Australian wool industry. Remco breaks down his multi-agent ELM framework, explaining how introducing deliberate manual friction points between LLM tasks keeps human modelers in control and why model-storming workshops, human trust, and organisational culture are far more vital than push-button automation. Whether you are curious about conceptual modeling techniques, how to effectively integrate “AI in the loop” while avoiding push-button modeling pitfalls, or strategies for aligning business definitions across complex organisations, this episode is packed with valuable insights for data professionals.
Raw and unedited Top 3 things:
Raw and unedited Top 3 things:
Raw and unedited Top 3 things:
Raw and unedited