Hi All - Couple questions...
a) What’s your A/B test failure rate with limited B2B traffic?
b) What does each failure cost ($ + time) you?
Context: 8 out of 12 A/B tests failed for us this year. Each took 8 weeks and ~$25K to discover it was a dud. Root cause? B2B traffic. We get 5,000 visitors/month but need 2,000+ per variant. The math doesn’t work.
Exploring better ways to identify losers before building them. Would love to compare notes.