A/B testing tools - all they do is randomize traffic. So why are we spending thousands of dollars for it?

Jonas "Elvis" Alves (of AB Smartly) joined the pod to discuss some of the major challenges in building A/B testing tools. It kinda started in a way I had no idea it would - that you're not buying a testing tool, but buying a... trust platform?

Jonas throws some shade at other testing tools, but I bleep it out, don't worry ;) . (And thankfully, he doesn't sales pitch at all. )

We got into:

- Jonas makes the case for BOTH building in-house and buying an external tool

- How to earn back trust once it's broken, through data or experimentation

- Booking.com ran A/B tests on A/B testers (it's super meta and super cool)

Latest Skit

Trying to use GenAI in 2026 kinda feels… frustrating. Like they ignore your instructions. Like, a lot.

(Ft. Iqbal Ali - certified homie - https://www.linkedin.com/in/iqbalhussainali/)

Latest Meme

Let’s try to have more rigor in our statistical significance, yes? A good 2026 goal!

Thing on my mind

Networking is amazing. My social battery drains very quickly, but I love how many genuine and authentic people we have in our industry. Keep going to conferences. Keep reaching out to people and building authentic relationships. Stop using AI for cold outreach - be human. And stop trying to use ‘authenticity’ to sell me shit. I promise - you’ll have a better time working with me if your product is good.

Things to go subscribe to:

Reply

Avatar

or to participate

Keep Reading