Bridging AI and Science: The Impact of Machine Learning on Material Innovation with Joe Spisak of Meta
Gradient Dissent: Conversations on AIShow Notes
In the latest episode of Gradient Dissent, we hear from Joseph Spisak, Product Director, Generative AI @Meta, to explore the boundless impacts of AI and its expansive role in reshaping various sectors. We delve into the intricacies of models like GPT and Llama2, their influence on user experiences, and AI's groundbreaking contributions to fields like biology, material science, and green hydrogen production through the Open Catalyst Project. The episode also examines AI's practical business applications, from document summarization to intelligent note-taking, addressing the ethical complexities of AI deployment. We wrap up with a discussion on the significance of open-source AI development, community collaboration, and AI democratization. Tune in for valuable insights into the expansive world of AI, relevant to developers, business leaders, and tech enthusiasts. We discuss: 0:00 Intro 0:32 Joe is Back at Meta 3:28 What Does Meta Get Out Of Putting Out LLMs? 8:24 Measuring The Quality Of LLMs 10:55 How Do You Pick The Sizes Of Models 16:45 Advice On Choosing Which Model To Start With 24:57 The Secret Sauce In The Training 26:17 What Is Being Worked On Now 33:00 The Safety Mechanisms In Llama 2 37:00 The Datasets Llama 2 Is Trained On 38:00 On Multilingual Capabilities & Tone 43:30 On The Biggest Applications Of Llama 2 47:25 On Why The Best Teams Are Built By Users 54:01 The Culture Differences Of Meta vs Open Source 57:39 The AI Learning Alliance 1:01:34 Where To Learn About Machine Learning 1:05:10 Why AI For Science Is Under-rated 1:11:36 What Are The Biggest Issues With Real-World Applications
Thanks for listening to the Gradient Dissent podcast, brought to you by Weights & Biases. If you enjoyed this episode, please leave a review to help get the word out about the show. And be sure to subscribe so you never miss another insightful conversation. #OCR #DeepLearning #AI #Modeling #ML
More from Gradient Dissent: Conversations on AI
Can today's power grid handle the explosive growth of AI data centers? Tesla Alum Drew Baglino, now founder & CEO of Heron Power, doesn't think so.
Should American companies be worried about Chinese open-source AI models?
"We are going to switch from the problem in AI being that nothing works to the problem being that everything works."
Samuel Rodriques left physics because there were no unsolved problems left. Instead, he built an AI scientist named Kosmos to cure every disease, solve aging, and map the human brain. In this episode: The cure his AI proposed for blindness Why he would never touch a peptide Whether we'll need human scientists in 20 years What's stopping America in drug discovery
"Every vehicle is capable of driverless operation. That's clearly the steady state of where we're going." Wayve started in a rented house in Cambridge with $1.5M, a car in the garage, and an aim to integrate end-to-end AI into driving. A decade later it's driven across 506 cities without a single HD map and is worth over $8.6 billion. In this episode, CEO Alex Kendall joins Lukas Biewald to talk about how he built the AI driver Uber, Nvidia, Mercedes, and Nissan all backed, and why putting self-driving AI into 100 million cars a year is a far bigger bet than 10,000 robotaxis. Waymo and Tesla both come up. He doesn't shy away.