Show Notes
Matt discusses a paper quantifying emergent behaviors in LLMs, and looking at Microsoft CodeT and how it applies to general use of LLMs at an app layer.
More from AI Everyday
For this AI Everyday, I'm turning the reins over to the dynamic duo at the Deep Dive podcast, as they discuss Kamiwaza, the Enterprise Generative AI platform, from the company I co-founded. Please enjoy! (Note: slightly improved episode updated 10/21, same hosts and topic!) (Note: The deep dive podcast is entirely AI generated by Google's NotebookLM, and in many ways, the quality of the output IS the news!)
Matt Wallace talks about the latest OpenAI announcements regarding the release of GPT-4, its improved speed, cost, and performance compared to other AI models. He explores features like Elo ratings, real-time interactions, and potential applications in coding and vision processing. He also mentions the upcoming release of a desktop app and the free availability of GPT-4.
Matt talks about the big things this week - Gemini 1.5 Pro with 1m token context, and OpenAI text-to-video model Sora, which is generating incredible high-quality videos up to 1 minute long.
7 wild updates from this week in about 8 minutes. #AI moving at crazy speed!
Hands on and discussion around vLLM, high performance inference engine supporting continuous batching and paged attention.