Show Notes
I have personal-agent fatigue, so I ran the first How I AI personal-agent benchmark: Grok Bot, Dot, Muse, and Claude Duet across nine real tasks, from a Slack reply and a Sentry bug to a Figma thumbnail, inbox triage, a family newspaper, physics homework for a fourth grader, shoe shopping, and a ChatPRD launch video. I used computer use to operate them: Claude ran Dot, Codex ran the rest and scored the results live. Here’s the scoreboard—and which agent I’d actually trust for work vs. life. — Brought to you by: WorkOS—Make your app enterprise-ready, with SSO, SCIM, RBAC, and more Firecrawl—Give your AI agents web data and beyond — In this episode, we cover: (00:00) Introduction (02:13) The personal-agent benchmark setup (05:00) The nine tasks and the prompts I used (07:20) Scoreboard overview (10:06) Task 1: Draft a Slack reply as me (11:39) Task 2: Cut a short-form video from raw Dropbox footage (14:56) Task 3: Fix a bug from Sentry (17:30) Task 4: Build a How I AI thumbnail in Figma (19:25) Task 5: Triage my inbox for to-dos (21:06) Task 6: Build a family newspaper (23:30) Task 7: Explain a physics homework question to a fourth grader (24:54) Task 8: Shop for shoes (26:46) Task 9: Make a ChatPRD Product Intelligence launch video (30:01) Final scores (32:38) My takeaways — Tools referenced: • Grok Bot: https://x.ai/bot • Dot: https://chatgpt.com/features/dots/ • Meta Muse: https://ai.meta.com/muse/ • Claude Duet: https://claude.com/product/claude-duet • Codex: https://openai.com/codex • ElevenLabs: https://elevenlabs.io/ • Figma: https://www.figma.com/ • Sentry: https://sentry.io/ • Linear: https://linear.app/ • Dropbox: https://www.dropbox.com/ — Where to find Claire Vo: ChatPRD: https://www.chatprd.ai/ Website: https://clairevo.com/ LinkedIn: https://www.linkedin.com/in/clairevo/ X: https://x.com/clairevo — Production and marketing by https://penname.co/. For inquiries about sponsoring the podcast, email [email protected].
More from How I AI
Blair Metcalf is the principal UX engineer at Reddit and the builder of Reddit Proto, the company’s in-house vibe-coding harness. With a design system MCP that maps Reddit’s product language to production code, Proto has reached 100% adoption across Reddit’s UX and product org, and more than 700 prototypes are live on it.
Anthropic's new personal agent, Claude Duet, lives on your phone, inherits all your Claude plugins and connectors, and is pitched at small business owners and busy professionals. It's the most polished agent launch I've seen: thoughtful onboarding, task lists, first-class artifacts, and Slack-style channels. But polish isn't enough when you're competing with every other personal agent for attention. I put it to work on my inbox and Slack, my sales pipeline, a Google Docs sales deck, a launch video, and finding Warriors tickets for my kids, and I'll walk you through what it nails, where it stalls, and what Anthropic needs to fix before it can become anyone's number one agent.
Brooke Lacey has been making videos since before Facebook had video, and she built a TikTok audience of more than 290,000 by learning to cut short-form videos herself. With over 25 years in tech, she now builds her own apps, including Zosha, a free mobile app for learning AI. In this episode, Brooke walks me through the Claude Code, FFmpeg, and Whisper workflow that edits her TikToks in about 15 seconds, how she mines her comments for new scripts, and how she runs a weekly short-form operation with no editor.
I put Meta’s new Muse Wonder (and Wonder Full) frontier models through the How I AI bench, which covers nearly 20 tasks across prototyping, agentic workflows, coding, writing, and creative work. I scored everything with an LLM-as-a-judge pass and my own voice notes, then pulled together the first-look results you see here.
Alex Cornell is a design director at Meta, where he leads design on Muse, Meta’s consumer AI agent. He came to the role with a long background in software product design, including time as a founder, and has spent the past year building one of the most thoughtful agent interfaces in the consumer AI space. Muse ships with a custom avatar, a three-layer status display, a personalized ideas surface, and a generative feed. Alex has been sharing the reasoning behind each of those design decisions publicly on Threads.