From the course: Practical A/B Testing

Unlock this course with a free trial

Join today to access over 25,500 courses taught by industry experts.

Statistical analysis of A/B test data

Statistical analysis of A/B test data - VWO Tutorial

From the course: Practical A/B Testing

Start my 1-month free trial Buy for my team

Statistical analysis of A/B test data

“

- [Instructor] Now that we have run the experiment for two weeks, let's now take a look at the statistical data generated by the users of my portfolio website. We have a total of 58 users who visited my website with a total expected conversion rate of 14.61%. Expected conversion rate is like the median conversion rates you can expect from the variation. The control had 23.72% and the variant had only 5.92%, and there was a negative 74.85% potential improvement in the user engagement. This clearly implies a negative performance. So scrolling down to the graph, the graph visualizes this performance better, and in a few moments we will decipher each data point story. Just feel free to explore the graph's various facets. You can switch to the box plot to see the graph in a bar chart or the probability density tab for an area chart, depending on which one is more visually understandable to you. Back to the date range, you could also toggle between conversion rates, conversions, and…

Contents