A/B Testing
2-3 concurrent variables
Weeks to Months
$thousands per test to reach statistical significance
1-2 weeks
Running A/B testing contains rules that must be enforced, otherwise, tests might be broken (e.g. no overlapping between groups, not exposing users to more than 1 variant).
![](https://simpool.io/wp-content/uploads/2022/01/Vector.png)
Number of test configurations
![](https://simpool.io/wp-content/uploads/2022/01/Vector2.png)
![](https://simpool.io/wp-content/uploads/2022/01/Vector.png)
Decision Speed
![](https://simpool.io/wp-content/uploads/2022/01/Vector2.png)
![](https://simpool.io/wp-content/uploads/2022/01/Vector.png)
Cost
![](https://simpool.io/wp-content/uploads/2022/01/Vector2.png)
![](https://simpool.io/wp-content/uploads/2022/01/Vector.png)
Measurement period
![](https://simpool.io/wp-content/uploads/2022/01/Vector2.png)
![](https://simpool.io/wp-content/uploads/2022/01/Vector.png)
Complexity
![](https://simpool.io/wp-content/uploads/2022/01/Vector2.png)