A/B Test Customer Segment Change
- A/B Test Customer Segment Change are bunch of tests which compares the effect of Customers Segments of Change within Time Periods to the business. Before and After time periods are constants time periods which are day, week and month. Each segment of current day, current week and current month are compared with the last 4 weeks of same weekday of current weekday, last 4 weeks and last 4 months. There are two metrics which help us to measure comparison values. These are number of orders counts per segment and Average purchase amount per segment. Difference of Segments between before and after time periods related to these metrics are tested with Before - After Analysis. in order to the answer the question that is "Is there any significant increase/decrease on Order Count / Average Payment Amount per Customer Segment" While we need to see to Segment which increases/decreases the number of orders and the average purchase amount, This Section can help us to find the right Segment of Improvements.
-
Hypothesis are;
H0 : These is no significant Difference with A - B of order count / purchase amount.H1 : These is significant Difference with A - B of order count / purchase amount. -
Bootstrapping Method;
Each test process are applied with Boostraping Method. So, Iteratively randomly selected A and B sample customers of order count / average purchase amount will be tested acceptable enough time. Each iteration A - B samples are randomly selected. Accepted ratio will show us the confidence of our test results. For instance, There are 100 tests and 75 of them are ended with H0 Accepted. So, test are % 75 our test are H0 Accepted.