TWICM 207: Samsung Ads’ Matt Butts on Marketing Science and the Rigour Behind Better Decisions
That's What I Call MarketingShow Notes
Matt Butts, Head of Marketing Science at Samsung Ads Europe, joins That’s What I Call Marketing to discuss marketing science, incrementality, connected TV measurement and why rigorous testing matters more than a positive result. This episode explains how marketers can move beyond convenient metrics, design better experiments and connect advertising activity to meaningful business outcomes. Matt also explores how changing television behaviours are reshaping media planning, audience measurement and the role of connected TV. In this episode, we cover: – Why marketers often measure metrics without questioning whether they matter – The difference between basic A/B testing and genuine incrementality testing – Why the quality of the test matters more than whether the result is positive – How marketing scientists translate complex analysis into commercial decisions – How Samsung Ads measures viewing across linear television, streaming and gaming – Why reported reach can hide significant audience duplication – How incremental reach can reduce media waste and identify missed audiences – The role of connected TV data in advertising planning and measurement – Why marketers need to communicate measurement differently to CMOs, CFOs and media teams – How rigorous measurement helped one advertiser move from zero investment to a seven-figure commitment
Matt argues that marketing science should not simply validate decisions that have already been made. Its role is to challenge assumptions, identify what would have happened without the advertising and give marketers evidence they can confidently use to make better investment decisions. A useful listen for marketers interested in marketing science, advertising effectiveness, connected TV, incrementality, media measurement, experimentation and commercial impact. Timestamps 01:16 How Matt found his way into marketing science 02:19 How advertising measurement has changed 03:27 Are marketers measuring things without knowing why? 04:27 Why measurement assumptions must be tested continually 05:02 Do marketers know how to test properly? 06:00 The limitations of basic A/B testing 06:17 Why incrementality is the missing part of marketing testing 07:18 The importance of statisticians, data scientists and translation 08:13 Matt’s journey to Samsung Ads 08:18 What Samsung Ads does 09:00 How television viewing behaviour has changed 10:18 Balancing audience precision, relevance and scale 11:02 Relevance without intrusive personalisation 12:19 Samsung Ads’ Total View measurement capability 12:36 Audience duplication, incremental reach and missed audiences 13:40 Why platform reach figures can be misleading 14:06 What a Head of Marketing Science actually does 14:40 Building advertiser-specific measurement playbooks 15:16 Using measurement to improve future advertising investment 15:23 How to explain incrementality to senior business leaders 15:41 Why marketers need to understand marketing science 17:00 How measurement feeds into marketing mix models 17:33 A real example of fixing incomplete advertising data 19:00 How a geo test led to a seven-figure investment 19:43 Why negative test results should not frighten marketers 20:40 Combining scientific rigour with commercial thinking 21:51 What comes next for connected TV measurement 22:00 Connecting television and mobile data 23:30 Why marketing measurement must keep pace with human behaviour
That’s What I Call Marketing is the podcast for marketers who care about brand, B2B, creativity, effectiveness and the future of the profession. Follow the show for more conversations with CMOs, marketing leaders, agency leaders, professors, authors, thinkers and practitioners. Find more episodes at: https://www.thatswhaticallmarketing.com Thanks to the Digital Voice for their partnership https://www.thedigitalvoice.co.uk/ That’s What I Call Marketing is where marketers come for real conversations about brand, B2B, creativity, effectiveness and the future of the profession. Ho
More from That's What I Call Marketing
Dee Cunniam, Head of Brand Marketing and Innovation at Britvic Ireland, joins That’s What I Call Marketing to discuss growing iconic Irish brands, leading through change and building a marketing career that keeps moving forward. How do you adapt a much-loved brand without losing what people love about it? Through her work on MiWadi and Ballygowan, Dee explains how consumer insight, product innovation and commercial judgement come together and why 18 years in one business has meant many different careers.
Make Your Mark: Stephanie Bell, Head of Marketing for Mercedes-Benz in Ireland joins That’s What I Call Marketing to discuss building commercial credibility, making a global brand relevant locally and earning support for ambitious marketing.
Make Your Mark is a three-part series exploring how marketers build their careers and make a difference to their businesses, their customers and the people around them, in partnership with the Marketing Institute of Ireland.
Bella Harrison and Ed Parkin from Tracksuit join That’s What I Call Marketing to discuss Grindr’s push into real-world experiences, On’s entry into football and Walkers’ growing brand preference, exploring what each story tells marketers about building brands and measuring progress. Three brands, three different challenges: giving people more reasons to use an app, taking a specialist sports brand to a wider audience, and keeping an established favourite relevant. Conor Byrne, Bella and Ed examine the strategies alongside Tracksuit’s brand health data, discussing what is moving, what remains uncertain and which measures matter. In this episode, we cover: – Grindr’s “Global Gayborhood” ambition: how a surprise Madonna performance, events and broader services support its move beyond a hook-up app, and why its younger audience deserves closer attention. – On’s move into football with Kylian Mbappé and Thierry Henry: building on its running and tennis credentials, competing with Nike and adidas, and the questions facing a premium brand entering the boot market. – The difference between recognising a brand and thinking of it first, and how expanding into another sport could give On more opportunities to come to mind. – Walkers’ brand refresh, new flavours and football partnerships with Lionel Messi, David Beckham and Thierry Henry, alongside a rise in preference from 29% to 36%. – Why flat awareness or usage figures do not tell the whole story, and how audience differences, category context and preference can help marketers make a stronger case for their work. – “What the Actual?”: the discussion around Sydney Sweeney’s Novig campaign, PNC Bank using the Titanic in its advertising, and why the Laughing Cow has stopped laughing. A useful listen for marketers interested in brand strategy, customer insight, experiential marketing, sports marketing, brand building, marketing effectiveness and commercial impact. That’s What I Call Marketing is the podcast for marketers who care about brand, B2B, creativity, effectiveness and the future of the profession. Follow the show for more conversations with CMOs, marketing leaders, agency leaders, professors, authors, thinkers and practitioners. Find more episodes at: https://www.thatswhaticallmarketing.com THE SINGLES — IN PARTNERSHIP WITH TRACKSUIT The Singles is our monthly look at the marketing stories getting people talking, using Tracksuit’s brand tracking data to bring evidence and context to the conversation. A huge thanks to Tracksuit for supporting the series, and to Bella Harrison and Ed Parkin for helping us understand the brand performance behind the headlines. Explore Tracksuit’s always-on, affordable brand tracking platform: https://www.gotracksuit.com
On the day he retires from Goodby Silverstein & Partners, co-founder Rich Silverstein joins That’s What I Call Marketing to reflect on 40 years in advertising, the making of ‘Got Milk?’ and what makes an idea last. Rich takes us back to the early days of the agency, when a project for Electronic Arts helped turn a group of creatives who wanted to do things their own way into a business. We get into the thinking behind ‘Got Milk?’, the E*TRADE monkey ad and the lizards, and ask whether work made for a different media era could be even more powerful today. Rich is candid about the role of craft, humour and client confidence, as well as his concern that AI could make it easier to settle for work that is merely good enough.