Heads up! To view this whole video, sign in with your Courses account or enroll in your free 7-day trial. Sign In Enroll
Start a free Courses trial
to watch this video
An important part of A/B testing is the analysis that follows the study. In this video we will go over how to formulate that analysis.
VWO A/B Testing Calculator
Additional considerations when reviewing the study outcome
- Are you using multiple sources of data?
- Did your design solution not improve the outcome?
- Did you study the user segments?
Further Reading
Real-life examples
- FaceBook Feed - Ever notice that your FB feed looks different, but when you mention it to your friends, they don’t know what you’re talking about? That’s likely because you’re part of an experiment in which Facebook is running. Let’s imagine you see a new Live Feed design. What do you think is a possible metric that FaceBook is evaluating? It could be time on site, the click-through rate on their ads or a friend’s post, etc.
- Shopping site checkout flow - Let’s say that Amazon wants to know if a slightly darker shade of orange on their Checkout button will increase conversions. Given their size, they might allot just 1% of their traffic to use the new color and after a few days, they’ll have a large enough sample to know if this change is worthwhile.
Related Discussions
Have questions about this video? Start a discussion with the community and Treehouse staff.
Sign upRelated Discussions
Have questions about this video? Start a discussion with the community and Treehouse staff.
Sign up
You need to sign up for Treehouse in order to download course files.
Sign upYou need to sign up for Treehouse in order to set up Workspace
Sign up