The Prompt Desk

Can custom chips save AI's power problem?

The Prompt Desk

Show Notes

Cutting-edge AI models use a lot of power. It is not uncommon to hear of data centers under construction that require the power output of the largest nuclear reactors all by themselves. Large tech companies used to tout their green credentials - now they quietly buried that message to pursue fortunes in generative AI. In this environmentally conscious episode of The Prompt Desk, your hosts Justin Macorin and Bradley Arsenault sit down with hardware entrepreneur Raymond Chik to talk about his startup, Untether.ai, to understand what the next generation of AI chips will look like. We dig into how it's possible to make a chip do the same calculations more efficiently, how to compete with Nvidia and other dominant chipmakers, and everything about hardware chips. --- Continue listening to The Prompt Desk Podcast for everything LLM & GPT, Prompt Engineering, Generative AI, and LLM Security. Check out PromptDesk.ai for an open-source prompt management tool. Check out Brad’s AI Consultancy at bradleyarsenault.me Add Justin Macorin and Bradley Arsenault on LinkedIn.

Please fill out our listener survey here to help us create a better podcast: https://docs.google.com/forms/d/e/1FAIpQLSfNjWlWyg8zROYmGX745a56AtagX_7cS16jyhjV2u_ebgc-tw/viewform?usp=sf_link

Hosted on Ausha. See ausha.co/privacy-policy for more information.

More from The Prompt Desk

Oct 2, 2024

In this one year anniversary episode of the podcast, your show hosts look back on what they have learned and observed over the past year. They made the following observations:

Sep 25, 2024

In this thought-provoking episode, AI experts Bradley Arsenault and Justin Macorin delve into the cutting-edge world of input validation using large language models (LLMs). The hosts explore how this innovative approach is transforming traditional data validation methods in software applications.

Sep 18, 2024

In this episode of Prompt Desk, hosts Bradley Arsenault and Justin Macorin dive into the evolving landscape of AI applications. They explore the shift from full automation dreams to the reality of human-AI collaboration, discussing why guided experiences are proving more effective than autonomous systems. The hosts share insights on designing AI interfaces, managing error rates, and the importance of human oversight in complex AI tasks. Whether you're an AI enthusiast, developer, or business leader, this episode offers valuable perspectives on harnessing the power of large language models while avoiding common pitfalls. Join Bradley and Justin as they unpack the challenges and opportunities in creating reliable, user-friendly AI applications that truly augment human capabilities.

Sep 11, 2024

In this episode of The Prompt Desk podcast, hosts Bradley Arsenault and Justin Macorin dive deep into the world of fine-tuning large language models. They discuss:

Aug 28, 2024

Have you ever tried to run a prompt in another language and gotten completely different results? It is a sad truth that our LLM models continue to work best in English. It is something that will probably always remain true because of the dominance of the English language, which ensures that a disproportionate amount of the worlds data is found in English.

See all episodes →