A/B testing
This notebook visualizes and measures the results of an A/B test.
Comparative analysis of in-game currency and spending trends
Evaluating these metrics reveals the impact of different currency types on player behavior, helping to refine in-game economy strategies for optimal engagement and revenue.
Spending rate by currency type
Player retention by currency type
Here is the overall conversion rate for each variant:
Significance test
It looks like Variant B has a higher conversion rate than Variant A. We need to make sure these results are significant.
Retention rate
We also want to know whether one variant of the website results in higher retention than another variant. For this, let's look at the weekly sessions of our users.
Significance test
Once again, check that the difference in retention is significance.