A/B testing tools - all they do is randomize traffic. So why are we spending thousands of dollars for it?
Jonas "Elvis" Alves (of AB Smartly) joined the pod to discuss some of the major challenges in building A/B testing tools. It kinda started in a way I had no idea it would - that you're not buying a testing tool, but buying a... trust platform?
Jonas throws some shade at other testing tools, but I bleep it out, don't worry ;) . (And thankfully, he doesn't sales pitch at all. )
We got into:
- Jonas makes the case for BOTH building in-house and buying an external tool
- How to earn back trust once it's broken, through data or experimentation
- Booking.com ran A/B tests on A/B testers (it's super meta and super cool)
Go follow him! https://www.linkedin.com/in/jonasalves/
Featured Clip from Episode: What you are actually paying for in an A/B testing platform…?
Latest Skit
Trying to use GenAI in 2026 kinda feels… frustrating. Like they ignore your instructions. Like, a lot.
(Ft. Iqbal Ali - certified homie - https://www.linkedin.com/in/iqbalhussainali/)
Latest Meme
Let’s try to have more rigor in our statistical significance, yes? A good 2026 goal!
Thing on my mind
Networking is amazing. My social battery drains very quickly, but I love how many genuine and authentic people we have in our industry. Keep going to conferences. Keep reaching out to people and building authentic relationships. Stop using AI for cold outreach - be human. And stop trying to use ‘authenticity’ to sell me shit. I promise - you’ll have a better time working with me if your product is good.
Things to go subscribe to:
Podcast:
YouTube:
LinkedIn(s):
This newsletter, yo!

