Challenges and Solutions in Managing Code Security for ML Developers - ML 175
Adventures in Machine LearningShow Notes
Today, join Michael and Ben as they delve into crucial topics surrounding code security and the safe execution of machine learning models. This episode focuses on preventing accidental key leaks in notebooks, creating secure environments for code execution, and the pros and cons of various isolation methods like VMs, containers, and micro VMs. They explore the challenges of evaluating and executing generated code, highlighting the risks of running arbitrary Python code and the importance of secure evaluation processes. Ben shares his experiences and best practices, emphasizing human evaluation and secure virtual environments to mitigate risks. The episode also includes an in-depth discussion on developing new projects with a focus on proper engineering procedures, and the sophisticated efforts behind Databricks' Genie service and MLflow's RunLLM. Finally, Ben and Michael explore the potential of fine-tuning machine learning models, creating high-quality datasets, and the complexities of managing code execution with AI. Tune in for all this and more as we navigate the secure pathways to responsible and effective machine learning development.
Socials LinkedIn: Michael Berk LinkedIn: Ben Wilson
Become a supporter of this podcast: https://www.spreaker.com/podcast/adventures-in-machine-learning--6102041/support.
More from Adventures in Machine Learning
In this episode, we dive deep into the evolving landscape of digital marketing and brand storytelling. We explore how the intersection of authenticity, community, and technology is reshaping how brands connect with people—and why it's no longer just about the product, but about the experience.
Welcome back to another episode of Adventures in Machine Learning, where hosts Michael Berk and Ben Wilson delve into the intricate process of implementing model serving solutions. In this episode, they explore a detailed case study focused on enhancing search functionality with a particular emphasis on a hot dog recipe search engine. The discussion takes you through the entire development loop, beginning with understanding product requirements and success criteria, moving through prototyping and tool selection, and culminating in team collaboration and stakeholder engagement. Michael and Ben share their insights on optimizing for quick signal in design, leveraging existing tools, and ensuring service stability. If you're eager to learn about effective development strategies in machine learning projects, this episode is packed with valuable lessons and behind-the-scenes engineering perspectives. Join us as we navigate the challenges and triumphs of building impactful search solutions.
Welcome to another insightful episode of Top End Devs, where we delve into the fascinating world of machine learning and data science. In this episode, host Charles Max Wood is joined by special guest Pierpaolo Hipolito, a data scientist at the SAS Institute in the UK. Together, they explore the intriguing paradoxes of data science, discussing how these paradoxes can impact the accuracy of machine learning models and providing insights on how to mitigate them.
What do cows and camels have to do with the human brain? The latest developments in machine learning, of course! In this episode, Michael and Ben dive into a new white paper from Facebook AI researchers that reveals a LOT about the future of modeling. They discuss “cows and camels”, the question of predictive vs causal modeling, and how algorithms are getting scary good at emulating the human brain these days. In This Episode Why Facebook’s new research is VERY exciting for AI learning and causality (but what does it have to do with cows and camels?) The answer to “Is predictive or causal modeling more accurate?” (and why it’s not the best question to ask) Not sure if you need machine learning or just plain data modeling? Michael lays it out for you What algorithms are learning about human behavior to accurately emulate the human brain in 2022 and beyond
Michael Berk joins the adventure to discuss how he uses Machine Learning within the context of A/B testing features within applications and how to know when you have a viable test option for your setup.