Fox News AB Testing

Website: https://www.foxnews.com/

Problem: Management and stakeholders wanted to launch products without testing how they would perform, or if our users were even interested in interacting with them.

Hypothesis: If we A/B Test new features, we could see how the product will perform at 1% and then, if it’s deemed successful, slowly roll it out to 100% of our users. If it is not a successful A/B Test we can rest assured knowing we didn’t invest a ton of time and labor into building it.

Solution: We teamed up with a company called Taplytics and began to A/B Test all sorts of features on the homepage. At last count, I launched 39 A/B Tests from conception, design, development to launch and the coordinating with BI to analyze the results.

Platforms: We tested on Mobile, Desktop and Tablet for both iOS and Windows.

Highlights: Running these tests made me an expert at being able to understand our user base as well as to proritize which products we’d like to work on and get out in scale.