At Purchasely we believe that product and marketing teams should be able to iterate, test, learn and optimize without having to scatter the focus of developing teams.
We know how much important AB testing is when it comes to learn and mitigate risks of experiments. That why we have designed a built-in AB testing feature to allow you to better understand and optimize your subscription business.
To be able to use Ab testing with Purchasely the only pre-requisites are to update the SDK to 3.2 or above and to have setup at least one Placement.
Setup and start an AB test
Step 1: In Purchasely Console, Click on A/B Test --> you can either click on Start your first A/B testor New A/B Test
Step 2: Provide the mandatory fields- Name, ID, and Placement. You can add a short description of the A/B test created.
Name & ID- have to be unique
Description- a short phrase about the test
Placement- Only one placement can be selected per test. If the placement was already chosen by another test, it can be used in another test.
Significance of the A/B test ID
Step 3: Select the paywall for A/B/C test respectively
ID- is created by default
Weight- is assigned by default
Paywall- you can choose any paywall that you have already created
Total weight- your total weightage for all the tests you have created should be equivalent to 100. You can click on equalize to make them=100
You can click on Save as a draftif you haven't finalized the test yet.
Once you have started the A/B test:
You can neither edit the Placement nor the paywall
Interpreting results through Data
You have created and started a new A/B test for your desired Placement. Once the test is started, it goes live without any further dependency.
Name- of the paywall test variant
Repartition- Weightage of the test variant
Unique Viewers- the total number of the distinctive viewer of the paywall in the subject
Subscription Started- the total number of users who started their subscription with the regular price( Do not include the free trial or intro price)
Trial Started- the total number of users who started their free trial or intro price or promo code
Trial Converted- the total number of users who started their free trial/intro price/promo code and converted to the regular price subscription
Trial Ended- the total number of users whose trial period ended(free trial/intro price/promo code)
View to Paid- the sum of the subscription started and the trial converted.
The % of views to paid= (Subscription Started+Trial converted)/Unique Viewers
First Renewal- the total number of users who renewed their subscription while they were in the regular price cycle
You can choose your chart based on three dimensions
Plan- the plan displayed in the paywall monthly, yearly etc.
Platform- the mobile platform used by the user to subscribe like iOS, Android etc.
Country- the location of the user mobile store
Reading the chart:
If you look at the chart below,
The Test have achieved 9 monthly subscription
Out of which 8 of them are started with regular price cycle and 1 was started as a trial cycle
Both the trial and the regular price subscriptions were renewed after their first subscription period
Tracking your AB tests
The A/B test involves two IDs that will allow you to track their performance using your own tools (internal or third party).