Forcing AI to Self-Test and Debug Its Own Code – Epic Fails and Wins - ShopTalk!
Dave’s Garage: Shop TalkShow Notes
00:00 - Hey Jerome… 00:45 - Could you use AI to write a test suite to verify the Basic interpreter? 02:13 - Isn’t there a coding LLM that can automatically test and debug its own code? 02:52 - What happens if you tell it to implement usr() and the jump table? 03:21 - How about a version in 6502 assembly code, like the real thing? 03:55 - The code is horrific… Maybe you make another video about the code quality? 04:34 - How about a Basic interpreter in the browser? Would that be doable? 05:25 - Which LLM do you use? Is it a special subscription? 07:14 - How long before something like a modern Linux kernel can be made on demand. And who owns that code? 08:12 - I cant imagine how many man hours the same would take? Can OpenAI estimate the equivalent Man Hours? 12:25 - Can you tell something about your LLM setup in VSCode, please? Are you using local models? 13:20 - Wondering if you can share how to use the AI itself? 14:18 - Any chance you could paste those prompts here? 14:44 - Did it emulate the hard ones like LOAD, SCRATCH, FRE, INPUT#, SYS, etc.? 15:41 - What is that copilot Agent (full access) indicator in your vscode? 16:15 - Have you tried other AI extensions for VS Code? 18:04 - What VSC theme are you using? 18:49 - I mean what donkey chooses to have a cloud based password manager? 20:54 - And if it’s not an issue with a specific data center but with something like DNS, how do those fail over? 22:01 - Who said: The cloud is safer? I’ve never heard that. 23:48 - Why would I, as an individual or small company, need or want cloud when I have an external SSD drive? 24:19 - Dave make a video about msi installers. 25:03 - Are the power requirements of these machines compatible with residential electrical service? 26:46 - Do you use these devices for anything? 27:05 - TLDR: Respectfully, is it useful for anything? 28:25 - Can you explain what split ID space is? 29:31 - Could we see the USB-SCSI interface please? 32:07 - So Dave, when are you getting a Vax? 33:05 - So this is the infamous don’t forget to tip your server scenario? 33:46 - How do you have the time to do all of that and also run a YouTube channel? 34:06 - Anyone else as amused as I am at the mental image of Dave doing those swoopy-camera shots of the hardware? 34:51 - In the early 2000 and late 90 .. the command /con/con would bluescreen the whole computer. Can you please explain why? 36:13 - I noticed a Tektronix 4014 storage tube graphic terminal standing there are there any plans to use it? 37:05 - Do you have to enjoy maple syrup to be considered an honorary Canadian? 38:50 - Omg. !!! The Friendly Giant! Why put that in your video other than you had that in your childhood too?? 40:01 - That’s a sweet sounding keyboard. What’s it packing down there? 41:27 - cool T, where can i get one? 43:10 - The Friendly Coder outro 43:32 - Maybe a blooper or two…
More from Dave’s Garage: Shop Talk
What would 1996 Dave think of rebuilding Task Manager with AI? Dave and Glen celebrate 100 episodes of Shop Talk with Windows stories, retro computing, fresh viewer questions, and a look at the community behind the show.Across the first 99 episodes, our comment archive contains more than 23,000 comments. We recognize some familiar contributors, revisit the rebuilt Task Manager episode’s response, and share the most-liked comment in the archive.Then it’s back to your questions: how overlays helped programs fit into limited memory, porting Colossal Cave to a PDP-11, getting started with AI, checking AI-generated code, and using AI for business strategy.Plus: a difficult day at Microsoft, whether Spy++ deserves a modern makeover, TMOG follow-ups, missing hard-drive activity lights, and Deluxe Asteroids.Thank you to everyone who has watched, commented, and kept the conversation going.
Windows war stories meet AI-assisted retro computing in this week’s Shop Talk. Dave and Glen explore AI development on the PDP-11, how they prompt and review generated code, and what older computers can still teach us.Dave discusses improving top for BSD, compiler changes for ksh, and getting Samba running on a 16-bit machine. Viewer questions cover detailed specifications, native apps versus Electron, ownership of AI-generated code, and improving PDP Gary.We also revisit Microsoft Bob’s connection to the Windows XP disc, instant shutdown shortcuts, and a CHKDSK job that could run for days. Plus: TMOG memory usage and temperature graphs, lessons from the TRS-80, Windows 3.1 on modern hardware, and Tempest with a joystick.
PDP Gary has a personality—but how did Dave define it? This week on Shop Talk, Dave and Glen start with Gary, then explore Dave’s recent work using AI on BSD, the PDP kernel, and its peripherals.
What happens when AI stops being a useful tool and starts becoming a crutch?
Can autonomous AI agents cause serious harm without being conscious, sentient or malicious?