Show Notes
Jake and I chat about a forthcoming book chapter titled, "Welcome to the Era of Experience" by David Silver and Richard Sutton (link below). This—naturally—led other topics to surface, such as companies staffed entirely by AI agents (which turned out as well as that sounds); superintelligence (we might be legally required to reference this during the 2025 AI hype cycle); and how practical systems built on these ideas would even be architected (we both came in with different ideas here which was fun). Happy listening.
Links to things mentioned: Smith, D., & Sutton, R. S. (April 26, 2025). Welcome to the Era of Experience. Preprint of a chapter to appear in Designing an Intelligence. MIT Press. Sutton, R. S., & Barto, A. G. (2015). Reinforcement Learning: An Introduction. The MIT Press. Wilkins, J. (April 27, 2025). Professors Staffed a Fake Company Entirely With AI Agents, and You'll Never Guess What Happened. Who would have thought? [Friendly write-up of the agentic company work] Xu, F. F., Song, Y., Li, B., Tang, Y., Jain, K., Bao, M., ..., & Neubig, G. (2024). TheAgentCompany: Benchmarking LLM agents on consequential real world tasks. arXiv:2412.14161. [Actual study.]
More from The Behavioral Data Science Podcast
LLMs are one type of generative artificial intelligence (AI) which is one type of AI/machine learning which is one type of approach to computational modeling. In this episode Jake and David talk about the ethics of computational modeling, generally, and how behavior scientists might incorporate these ideas as they begin to build models specific to their everyday work settings.
In this episode, Jake and David discuss the Stanford AI Index Report (https://hai.stanford.edu/ai-index) with an eye toward the intersection of ethics, AI, and behavior science.
The term "bias" means different things to people coming from different scientific backgrounds. In this episode, Jake and David discuss those different definitions of bias, how those definitions impact the conversation around bias in AI, and recommendations for mitigating "bias" in AI systems, regardless of the point of view from which you come.
In this episode, Jake and David discuss the unique ethical concerns raised by LLMs, generative AI, agentic systems, and multi-modal AI.
In this episode, Jake and David discuss the ever-present possibility of bias in AI systems, and the resulting work and implications that has to mitigate AI bias when using LLM-driven products.