Version A: Join Simon and Jim as they babble about button colors while the experts tell them what really matters in experimentation.

Version B: Have you ever wondered what makes for a great experimentation culture?

(Let us know in the comments which version you prefer!)

We were lucky to talk with Kelly Worthham and Ton Wesseling, both experts in decision science and experimentation.We cover the transition from traditional conversion rate optimization (CRO) to broader growth engineering, organizational transformation for better decision-making, and the impact of AI on experimentation.

Discover how conferences like Experimentation Island and Conversion Hotel foster deep, meaningful conversations and collaborations within the community.

Links from the show:

The Conference known as Conversion Hotel

The Conference known as Experimentation Island

Test & Learn Community

No Hacks Podcast

Experimentation Culture Awards

00:00 Introduction and Casual Banter

00:52 Halloween Candy Stories

02:27 Introducing the Special Guests

02:41 Kelly Worthham's Background

03:58 Todd's Background and Contributions

05:18 Experimentation Island Conference

13:57 Conversion Optimization vs. Growth Optimization

25:07 The Risk of Imitating Big Brands

25:22 Helping Businesses Make Data-Driven Decisions

27:02 Building Effective Experimentation Processes

30:22 Challenges in Replicability and Experimentation

34:54 The Role of AI in Experimentation

40:52 Future of Experimentation and AI

48:32 Concluding Thoughts and Recommendations

Ever wonder how Walmart, Kroger, Home Depot, and Instacart are different from a guy in a trench coat? They ask for consent before exposure! Join Simon and Jim as they dive into the often misunderstood world of retail media networks with Sky Frontier, EVP at Incremental.Discover why retail media is the Wild West of advertising, how it's moving up the funnel, and the unique challenges it poses. Learn about Sky's journey from philosophy to advertising, and why your branded search strategy might need a rethink. Plus, we tackle Amazon's recent Google Shopping mystery – did they just pull off the greatest experiment of all time?

Links from the show:

Skye Frontier on LinkedIn

IncrementalShow Notes:00:00 Welcome Back and Summer Catch-Up00:34 AI Measurement Solutions and Future Prospects01:10 Retail Media Networks: An Introduction02:21 Guest Introduction: Sky Frontier04:15 Defining Retail Media Networks06:46 Challenges in Retail Media Measurement14:12 Incrementality in Retail Media18:42 Operational Challenges and Clean Rooms22:55 Challenges in Retail Media Experimentation23:41 Econometrics and Granularity in Retail Media25:18 Synthetic Experimentation and Difference-in-Differences Analysis28:30 Future Trends in Retail Media32:28 Amazon's Strategic Shift in Advertising41:55 Concluding Thoughts on Retail Media Measurement

Should you measure SEO by its ability to climb a tree? Hear Mike King's take on all things SEO - how AI is disrupting the space, and how measurement is (or should be) changing for this channel.Mike King is the founder and CEO of digital marketing agency iPullRank. King's journey from battle rapping with the Wu-Tang Clan to decoding Google's algorithms lays the foundation for a spirited discussion on the future of SEO, the impact of AI on search behavior, and innovative measurement techniques.Listen as we explore the shift from traditional click-based metrics to more complex, probabilistic methods driven by AI. Learn how SEO is adapting to changes in user behavior, including the rise of AI overviews and the challenges of measuring their impact.Plus, don't miss King's tips on leveraging advanced tools and strategies to stay ahead in the ever-changing SEO landscape.

Links from the episode:

Mike King on LinkedIn

iPullRank

Qforia

Show Notes:00:00 Introduction to Mike King00:23 Mike King's Early Career and Achievements00:38 Transition to Digital Marketing01:08 Future of SEO and Measurement Challenges01:51 Understanding SEO Metrics04:36 Google's AI Overviews and User Behavior05:21 SEO as a Brand Channel07:45 Challenges in Measuring SEO Effectiveness09:21 Impact of AI on SEO Traffic11:49 Evolving SEO Measurement Techniques18:22 Tools and Strategies for SEO Measurement25:07 Understanding Query Fan Out and Reasoning in SEO28:42 Client Education and Shifts in Search Behavior32:57 Improving Relevance and Content Structure36:04 Measuring SEO Performance and Authoritativeness43:25 Sentiment Analysis and Query Fan Out46:03 Reframing SEO for Better Investment48:41 Final Thoughts and Incremental Insights