Documentation

Welcome to Split Test Pro! Before diving in, it's essential to understand the fundamentals of A/B testing and how our tool can help you make data-driven decisions.

Explore our interface and familiarize yourself with the dashboard, where you'll monitor all your active tests.

Split Test Pro Homepage

The Split Test Pro homepage is your starting point. Here, you can kickstart a new test, get a snapshot of ongoing tests, and also find resources to help you navigate through the app.

Whether you're a novice or an expert, our homepage has been designed to give you a seamless experience.

Experiments

The Experiments section provides a holistic view of all your tests, past and present. Here, you can create new experiments, monitor ongoing ones, and review completed tests.

Filter and sort tests based on their states of completion to efficiently manage your experiments.

Settings

Your Settings page houses essential information about your app subscription. Keep tabs on your subscription status, update payment methods, and view billing histories with ease.

Ensure your account is always in good standing by frequently checking this section.

Support

At Split Test Pro, we prioritize your experience. Should you encounter any issues or have queries about the application, our Support section is here to help.

Fill out the support form, and our dedicated team will get back to you promptly.

Setting up your first A/B test might seem daunting, but with Split Test Pro, it's a breeze! Follow our step-by-step guide to initiate your test.

Choose the webpages for testing, set your desired metrics, and let Split Test Pro handle the rest. Remember, a successful A/B test starts with a clear hypothesis.

Step-by-Step Guide:

Step 1: On the homepage or experiments page, click the green "Create Experiment" button. This is the starting point for creating a new test.

Step 2: Name your experiment. A pro tip for naming is to make it descriptive of what you're testing. For instance, "Homepage Button Color - Blue vs. Green" gives a clear idea of the test's focus.

Step 3: Set up the rules for your test.

• Preview URL: This is where the preview link will take you. It provides a snapshot of how the test will look.
• URL Targeting Rules: The power of URL targeting is that it allows you to dictate where your test will run. For instance, if you only want the test to apply to a specific product page or category, you can set that up.
• Adding Variants: You can add different versions or "variants" of your webpage to test against each other. Naming variants can be based on the changes they represent. For instance, "Blue Button" or "Large Font Size."

Step 4: Once your variant is created, click the edit button on the variant. This will allow you to add or modify CSS to create the change you want to test. Make sure the changes are in line with what you want to study and that they are correctly implemented.

Step 5: Click "Start Experiment." Your test is now live!

Congratulations! You've set up your first A/B test with Split Test Pro. As you navigate to the results page, remember that data won't populate immediately. It might take a little while as visitors interact with your test pages. This delay is normal, and soon, you'll have valuable insights pouring in.

Stay patient, keep an eye on the data, and always strive to make data-driven decisions. If you ever get stuck, our support team is just a click away.

Understanding and interpreting the results of your A/B tests is crucial to making informed decisions for your website or application. Let's dive deep into each metric provided by Split Test Pro so that you can confidently assess your experiments.

1. Results by Experience:

This segment gives a detailed breakdown of how each variant or "experience" performed. Instead of just seeing an overall conversion rate, you can understand how each specific change impacted user behavior.

2. Number of Sessions:

This is the count of unique user visits during the test. The larger the number, the more data you have to make a reliable decision. Remember, a significant number of sessions can help ensure that the results of the test are not due to random chance.

3. Conversions:

Conversions are the number of users who completed a desired action, like signing up for a newsletter, making a purchase, or any other goal you've set for the test. It’s the raw count of successes.

4. Conversion Rate:

This metric represents the percentage of sessions that resulted in a conversion. It’s calculated by dividing the number of conversions by the number of sessions and multiplying by 100. A higher conversion rate usually indicates a better performing variant, but always consider this in conjunction with other metrics.

5. Probability to be Better:

It's not always enough to know which variant had a better conversion rate. This metric indicates the likelihood that one variant is genuinely better than another, and it's not just due to random chance. A probability over 95% is often considered statistically significant, but depending on your industry and goals, you might adjust this threshold.

6. Probability to be Best:

While 'Probability to be Better' compares two variants, 'Probability to be Best' indicates the likelihood that a variant is the best among all tested. This is especially useful when you have multiple variants in a single test.

In conclusion, analyzing test results is not just about looking at which variant won, but understanding why it won. The combination of these metrics provided by Split Test Pro will give you a comprehensive view of your test performance, enabling you to make data-driven decisions with confidence. Always remember to contextualize these metrics with your business goals and user feedback for a holistic understanding.