
AI Is Not Magic: The Truth Behind the Technology Changing Everything | Diana Kelley
Security by DefaultShow Notes
This podcast episode elucidates the evolution of artificial intelligence, particularly focusing on the transition from earlier models such as ELIZA and Watson to contemporary systems like ChatGPT and Claude. Our discussion emphasizes the importance of understanding the context and limitations of AI, as well as the implications of its rapid advancement on our professional landscape. We delve into the nuances of prompt engineering and the necessity of training AI models to interpret context effectively, which has become increasingly pivotal in their application. Furthermore, we address the societal concerns regarding job displacement in the wake of AI proliferation, positing that while certain roles may be rendered obsolete, new opportunities will arise, necessitating continuous adaptation and retraining. Ultimately, our dialogue aims to provide clarity amidst the complexities of AI technology, underscoring the imperative for informed engagement with these transformative tools. In this episode of the Security by Default podcast, host Joe Carson welcomes Diana Kelley, a prominent figure in the tech industry, to discuss her journey in technology, the evolution of AI, and its implications for cybersecurity and the job market. They explore the historical context of AI, from early systems like ELIZA to modern advancements like Watson and ChatGPT, and address common misconceptions about AI's capabilities. The conversation also delves into the future of jobs in an AI-driven world, emphasizing the need for training and understanding of AI technologies. In this conversation, Joseph Carson and Diana Kelley discuss the evolution of jobs in the context of technological advancements, particularly focusing on AI and its implications for the workforce. They explore the necessity of continuous retraining and the emergence of new roles, the importance of contextual understanding in AI, and the behavior of AI agents. Additionally, they emphasize the need for control mechanisms in AI development and the importance of empowering women in cybersecurity to address the growing challenges in the field.
Takeaways The podcast aims to bring clarity and transparency to the chaos in the tech world. Diana Kelley has a rich history in technology, starting from the DARPAnet in the 1970s. ELIZA was one of the first AI systems, designed to emulate a therapist. Watson's success in Jeopardy was due to its speed, not intelligence. AI's interaction with humans can lead to misconceptions about its capabilities. Chain of thought prompting has improved AI's problem-solving abilities. AI is a probability machine, not a sentient being. Training is essential for effective AI usage. The evolution of AI has implications for job security and creation. Legacy systems still require human oversight and expertise. The jobs we have today are constantly evolving due to technology. Retraining is essential to stay relevant in the workforce. AI will create new job opportunities in various fields. Understanding context is crucial for effective AI interaction. Prompt engineering is a vital skill in working with AI models. Control mechanisms are necessary for managing AI behavior. Empowering women in cybersecurity is critical for the industry's future. Community support is essential for fostering diversity in tech. Continuous learning is key to adapting to technological changes. Networking and mentorship play a significant role in career development.
Chapters 00:00 Introduction to the Podcast and Guest 01:01 Diana Kelley's Journey in Tech 04:56 The Evolution of AI: From ELIZA to Watson 10:14 AI in Cybersecurity: Training Watson for Cyber 14:03 Understanding AI: Human-like Interaction and Misconceptions 16:33 Advancements in AI: Chain of Thought Prompting 20:11 The Future of Jobs in the Age of AI 21:20 The Evolution of Jobs and Skills 23:51 AI and Human Interaction 27:06 Contextual Understanding in AI 29:56 Agent Behavior and Control 32:58 Staying Informed in a Rapidly Changing Field 3
More from Security by Default
It's Cybersecurity Awareness Month, and Joe Carson is joined by Erich Kron of KnowBe4 to ask whether the classic messages — strong passwords, phishing awareness, MFA, and patching — still hold up. Spoiler: they do, but attackers have upgraded the wrapper. Erich explains why users should ignore deepfake "tells" and focus on emotion, urgency and the request itself, how phishing has moved into Teams, WhatsApp and SMS, and why agentic AI is exploding the number of non-human identities we already struggle to manage. They also cover email bombing, MFA fatigue, mitigation before patches, deepfakes in the courtroom, and the shift from ransomware encryption to data extortion.
We assert that agentic AI constitutes a profound and immediate threat to passwords, passkeys, and credential stewardship when such agents are afforded unfettered operational or contractual authority without deterministic guardrails. I describe, with technical specificity, how agents that hold passkeys or password-manager access can act autonomously to transact, alter accounts, or execute legally binding operations, and we categorize those risks into task-level, operational, and contractual modes of delegation. We argue that the remediation imperative involves explicit delegation models, ephemeral and auditable identities, and cryptographic assertions that bind an agent’s scope of action to a human owner. I counsel continued adoption of hardened password practices and password managers, combined with resilient offline backups and dual-control or deterministic controls layered atop probabilistic AI systems. We further insist that security-by-default, mandatory auditability, and standards for AI skill and supply-chain review are prerequisites to any safe integration of AI with authentication systems. Finally, I exhort practitioners to prioritize availability, integrity, and accountability alongside confidentiality so that credential resilience endures in an era of accelerating AI capability. We offer clear, practical guidance for individuals and organizations to protect credentials in the age of AI. I recommend using a zero-knowledge password manager and enabling secure backups. Evil Mog affirms that printed or offline copies of critical credentials are valid resilience measures when they are managed and backed up properly. We advise random and unique passwords of appropriate length, routine backups of vaults, and giving trusted delegates access via documented procedures rather than ad hoc sharing. For family and estate planning, we explain how offline copies or delegated access can help manage accounts after death. We also recommend operational controls when using agents. Always run agents with least privilege. Use ephemeral tokens for short-lived tasks. Maintain strong audit logs that tie agent actions back to an owner. Keep humans in the loop for operational and contractual actions. We advise treating AI as an assistant for tasks and threat detection, not as a trusted keeper of passwords without deterministic guardrails. Finally, we remind security teams to prioritize availability and integrity alongside confidentiality and to make secure defaults easy to use so users do not bypass protections. Takeaways: I explain three agent categories: task, operational, and contractual, each requiring different controls and audit. We caution against giving probabilistic AI full control of password managers without deterministic guardrails. I recommend using zero knowledge password managers, backing them up, and keeping an offline printed copy. We note that passkeys can be compromised if they are not bound to secure hardware or secure elements. I urge clear delegation, ephemeral identities, and auditable signatures when agents act on our behalf to ensure accountability. We advise keeping humans in the loop for high risk operational actions and verifying AI outputs before execution. I emphasize secure by default design, reducing friction without disabling protections, to prevent users from bypassing security.
I discuss with Lukas Hlavicka how ordinary security incidents can escalate into full-blown crises when organizations lack preparation, reliable backups, and secure deployment pipelines. We share stark war stories, from backups that were never actually taken to compromised software deployment systems and a ransomware attack that exposed six months of bank fraud. Lukas draws on over a decade of incident response experience, including leadership of a national CSIRT and work in the private sector. We describe common failure points: unknown assets and third‑party links, intertwined IT and OT systems, missing evidence, unclear roles for decision and containment, and compromised CI/CD. We stress clear, practical steps: maintain offline incident plans and backups, map assets and dependencies, secure and monitor deployment pipelines, and practice response with defined authorities. This episode targets any organization that thinks “it won’t happen to us” and seeks concrete lessons to prevent incidents from becoming crises.
Navigating the intricate landscape of identity security has evolved dramatically over the past two decades. Once characterized by a mere username and password, the contemporary environment demands that employees manage an astonishing array of digital identities—approximately one hundred per individual, not accounting for the emerging complexities introduced by agentic AI.
Daniel Raines, a luminary in the realm of electronic security, shares his extensive journey through the intricate landscape of physical security and digital access. With three decades of experience, he has transitioned from hands-on installation of access control systems to software development, addressing vulnerabilities and enhancing security measures. Our discourse delves into the convergence of physical and digital security, exploring the nuances of vulnerability disclosure and the industry's response to emerging threats. Raines elucidates the complexities of hard-coded encryption keys and the imperative for robust security practices, particularly as the industry shifts towards mobile credentials and biometric solutions. This episode serves as a profound exploration of security's evolving nature, emphasizing the significance of adapting to technological advancements and fostering a culture of continuous learning and improvement.