『Spotify — Why Bayesian A/B Testing Doesn't Pay Off』のカバーアート

Spotify — Why Bayesian A/B Testing Doesn't Pay Off

Spotify — Why Bayesian A/B Testing Doesn't Pay Off

無料で聴く

ポッドキャストの詳細を見る

【Amazonプライム会員限定】今ならプレミアムプランが4か月 月額99円。

10月19日まで。※適用条件あり
Bayesian A/B testing gets pitched as more intuitive, safer to peek at early, and automatically smarter about multiple metrics — so why didn't Spotify adopt it? This episode walks through Spotify's own math: under the flat priors most platforms actually ship, Bayesian and frequentist testing produce numerically identical results, and the "advantages" people cite either require infrastructure most teams don't have (calibrated priors, Bayes-factor stopping, hundreds of historical experiments) or quietly reduce to standard frequentist practice anyway. We cover the business context (why experimentation trustworthiness matters more than framework fashion), the statistical reasoning (posterior equivalence, the winner's curse, decision theory), and what it means for teams facing the same "should we go Bayesian?" question. Source article: "Why Spotify Is Not Using Bayesian A/B Testing" — Spotify Engineering, https://engineering.atspotify.com/2026/9/why-spotify-is-not-using-bayesian-a-b-testing (published 2026-09).
adbl_web_anon_alc_button_suppression_t1
まだレビューはありません