A/B Testing
Conversion Rate
variantobject
conversion_ratefloat64
0
variant_a
0.008130040076880632
1
variant_b
0.01352708068051098
p-value is 4.536508742253485e-12
The difference in Conversion Rate between Variants A and B is statistically significant.
Retention Rate
variantobject
Retentionfloat64
0
variant_a
0.17602092352092352
1
variant_b
0.3770292854143786
p-value is 2.5434010296902054e-12
The difference in Retention between Variants A and B is statistically significant.