Best A/B Testing Tools: Reviews & Recommendations

Dylan Jones

Oct 29, 2024, 11:26 AM

What is your go-to A/B testing tool? I'm looking at a few, currently (listed below), but would love to hear some opinions from folks on the positives, negatives, and favorites that you might have!

• <https://www.searchpilot.com/>

• <https://www.abtasty.com/>

• <https://www.optimizely.com/>

• <https://www.crazyegg.com/ab-testing>

• <https://vwo.com/>

Forwarded thread from another channel:

Derek Perkins

Oct 29, 2024, 1:01 PM

SearchPilot doesn't really belong in that same list. It's targeted at SEO A/B testing, vs the other tools that are more about on-site A/B testing, usually for CRO. It depends what you're wanting to focus on

Dylan Jones

Oct 29, 2024, 1:07 PM

Probably a bit of both if possible. From the little research I've done so far, SearchPilot advertises itself as being able to make changes at an HTML level which feels like it would cover a decent amount of on-site, CRO stuff as well. Is that not correct?

Derek Perkins

Oct 29, 2024, 1:09 PM

the technology is basically the same for both, making HTML changes for users / Googlebot, but the platform analytics are going to be focused on different things

Dylan Jones

Oct 29, 2024, 1:22 PM

I suppose I could see how SearchPilot may have metrics more focused on incoming traffic/rankings vs others being more focused on engagement metrics (once the user is already on page). What have you seen more use out of, because I can definitely see benefits to both.

Derek Perkins

Oct 29, 2024, 1:23 PM

SearchPilot is awesome at enterprise scale, but smaller sites may have trouble getting to statistical significance

Nick Swan

Oct 29, 2024, 2:45 PM

I think you need to qualify your question a bit more as Derek alluded to - are you looking for a CRO tool, or SEO split testing tool?

A CRO tool will present different versions of the same page to different users with changes being made at render time by javascript.

SEO split testing tools put similar pages into two groups - test and control group, with changes only being made to the test group. The performance of the test group is then compared to the control group over the same period of time.

Richard Gargan

Oct 30, 2024, 3:45 AM

If it’s a CRO tool, <https://posthog.com/experiments> upto 1m events per month free

Bill Scully

Oct 31, 2024, 7:16 AM

@richard thanks! Looks interesting, have you used it?

Richard Gargan

Oct 31, 2024, 7:24 AM

Np, yes, posted a quick comment on it here - <https://theseocommunity.slack.com/archives/C05J031AJ81/p1730197490213509?thread_ts=1730196171.482489&cid=C05J031AJ81>

Forwarded from another channel

Richard Gargan

I really like Posthog, it’s the first thing I install on a client’s website

Especially having it both inside your app and on the website, you can have events like a signup or starting a trial, and then see what website page views led up to it. And ability to A/B test everything

It’s upto 1m events free too, usually it’s the session recordings (upto 5k free) that I go over on, but you can set limits to make sure you don’t go over X spend

View original message in Slack