Show Notes
AI might look simple on the surface — just send a prompt, get a response — but behind the scenes, there’s a whole platform challenge to solve. In this episode of SEEK Bytes – we’re joined by Thet Ko, Senior Staff Engineer in SEEK’s AI Platform Services team, to unpack how SEEK is building an AI Gateway to centralise AI calls, improve governance and make it easier for teams to build with AI without reinventing the foundations every time. From cost visibility and PII protection to guardrails, resilience and shared memory across agents, this episode lifts the lid on the platform work that makes enterprise AI actually usable at scale.
This episode's special guest: Thet Ko (Senior Staff Engineer)
In this episode you’ll learn: • Why an AI Gateway matters – how centralising AI usage helps teams get better governance, clearer cost visibility and shared protection against risks like PII leakage and prompt injection. • What platform teams need to solve for AI at scale – from giving agents the right tools and memory to helping teams focus on the use case while the platform handles the foundations. • Why reliability and economics matter more than the hype – including model outages, fallback across regions, evaluation with golden datasets and LangFuse, and the reality that AI only scales if the value outweighs the cost.
🔔 Follow the SEEK Bytes podcast so you never miss a new episode
More from SEEK Bytes
This special Season 3 finale of SEEK Bytes – a podcast for engineers by engineers – dives into one of the biggest AI engineering shifts of the moment: spec-driven development with GitHub Spec Kit. If you’ve been wondering how teams are using AI for more than just code completion, this episode unpacks a workflow designed to help engineers plan better, reduce drift and build higher-quality software faster.
What happens when you give 100 high school students four days, real SEEK mentors and a crash course in how tech actually works? In this episode of SEEK Bytes – we're joined by special guests Asha Ioculari and Leon Belobrov and go behind the scenes of Camp SEEK, SEEK’s immersive program designed to open the doors of tech to girls and non-binary students and show them there’s far more to this industry than just writing code. From design thinking and user research to pitching in front of 200+ people and senior SEEK leaders, this is a brilliant look at how SEEK is building confidence, broadening horizons and helping shape a more inclusive future for tech.
Ever shipped a UI that “works” but still feels clunky, janky or confusing to users? In this episode of SEEK Bytes, Elliott and Will chat with lead engineer Eddy Nguyen about Bleeds – a simple but powerful way to design every UI state your users actually experience, not just the happy path.
AI is moving fast — but are we building it responsibly? In this episode of SEEK Bytes – we sit down with Sreyna Rath, CEO and co-founder of jaimee.ai, who arrived in Australia as a refugee and is now running her own AI company with the aim to create something truly transformative for women. Elliott sits down with Reyna to unpack her journey and the real-world risks of AI bias, why safety can’t be bolted on at the end, and what developers can do to build tools that are fairer, safer and more human from day one. From biased hiring systems to sexualised image outputs and AI companions designed for vulnerable users, this conversation is a powerful reminder that AI doesn’t just reflect technology — it reflects us.
Still throwing one prompt at an AI agent and hoping for the best? In this episode of SEEK Bytes – we unpack PERL: Plan, Execute, Review and Learn — a smarter way to work with AI that helps teams get better outputs, catch mistakes earlier and turn trial-and-error into a repeatable workflow. This is the episode for anyone curious about how AI tools are really being used inside modern tech teams — not just to generate answers, but to plan better, work faster and learn as a team.