Reviewing Test Results

Reviewing the test results

Depending on how much traffic you have on your site, you would have to wait for a day or a week before you run the split test results report. Usually it is recommended that you wait until you have at least 100 visitors, so that the results of the test are reliable. There are two types of results possible: there will be either a winner page (A or B) or URL in the URL based test, ot the results will be inconclusive because there will be too little difference between the conversion rate. When interpreting the test results it is important to bear in mind that Logaholic looks only at the conversion rate percentages to calculate the result of the PHP and URL tests. In the example below, even though it seems like there is a lot more traffic drawn from page B, the results are still inconclusive since the conversion rate is very close to the one of page A.

Screenshot A/B split test with Winner,

Screenshot A/B split test Inconclusive

Screenshot URL split test with Winner.

Screenshot URL split test Inconclusive.