The Prompt Desk

Data Preparation Best Practices for Fine Tuning

The Prompt Desk

Show Notes

In this episode of The Prompt Desk podcast, hosts Bradley Arsenault and Justin Macorin dive deep into the world of fine-tuning large language models. They discuss:

The evolution of data preparation techniques from traditional NLP to modern LLMs

Strategies for creating high-quality datasets for fine-tuning

The surprising effectiveness of small, well-curated datasets

Best practices for aligning training data with production environments

The importance of data quality and its impact on model performance

Practical tips for engineers working on LLM fine-tuning projects

Whether you're a seasoned AI practitioner or just getting started with large language models, this episode offers valuable insights into the critical process of data preparation and fine-tuning. Join Brad and Justin as they share their expertise and help you navigate the challenges of building effective AI systems. --- Continue listening to The Prompt Desk Podcast for everything LLM & GPT, Prompt Engineering, Generative AI, and LLM Security. Check out PromptDesk.ai for an open-source prompt management tool. Check out Brad’s AI Consultancy at bradleyarsenault.me Add Justin Macorin and Bradley Arsenault on LinkedIn.

Hosted on Ausha. See ausha.co/privacy-policy for more information.

More from The Prompt Desk

Oct 2, 2024

In this one year anniversary episode of the podcast, your show hosts look back on what they have learned and observed over the past year. They made the following observations:

Sep 25, 2024

In this thought-provoking episode, AI experts Bradley Arsenault and Justin Macorin delve into the cutting-edge world of input validation using large language models (LLMs). The hosts explore how this innovative approach is transforming traditional data validation methods in software applications.

Sep 18, 2024

In this episode of Prompt Desk, hosts Bradley Arsenault and Justin Macorin dive into the evolving landscape of AI applications. They explore the shift from full automation dreams to the reality of human-AI collaboration, discussing why guided experiences are proving more effective than autonomous systems. The hosts share insights on designing AI interfaces, managing error rates, and the importance of human oversight in complex AI tasks. Whether you're an AI enthusiast, developer, or business leader, this episode offers valuable perspectives on harnessing the power of large language models while avoiding common pitfalls. Join Bradley and Justin as they unpack the challenges and opportunities in creating reliable, user-friendly AI applications that truly augment human capabilities.

Aug 28, 2024

Have you ever tried to run a prompt in another language and gotten completely different results? It is a sad truth that our LLM models continue to work best in English. It is something that will probably always remain true because of the dominance of the English language, which ensures that a disproportionate amount of the worlds data is found in English.

Aug 21, 2024

In this episode, AI experts Bradley Arsenault and Justin Macon dive deep into the challenges and best practices for safely executing code generated by large language models in a production environment. They discuss key security considerations, containerization techniques, static/dynamic code analysis, and error handling - providing valuable insights for anyone looking to leverage the power of LLMs while mitigating the risks of abuse by AI hackers.

See all episodes →