Resources

Following are selected lists of publications that influenced us the most in making ep-stats design decisions and development. The most important being Ron Kohavi, Trustworthy Online Controlled Experiments: A Practical Guide to A/B Testing that we used for inspiration on soft topics like how to build experimentation culture and protocol and as a checklist to make sure we haven't forgot anything in implementation.

• Ron Kohavi, Trustworthy Online Controlled Experiments: A Practical Guide to A/B Testing
• Georgi Z. Georgiev, Statistical Methods in Online A/B Testing: Statistics for data-driven business decisions and risk management in e-commerce
• ExP Experimentation Platform
• A. Fabijan et al., Three Key Checklists and Remedies for Trustworthy Analysis of Online Controlled Experiments at Scale
• R. Kohavi, Sample Ratio Mismatch
• A. Deng et al., Improving the Sensitivity of Online Controlled Experiments by Utilizing Pre-Experiment Data
• Yandex, Practical Aspects of Sensitivity in Online Experimentation with User Engagement Metrics
• R. Kohavi et al., Seven Rules of Thumb for Web Site Experiments
• H. Hohnhold et al., Focusing on the Long-term: It's Good for Users and Business
• Yandex, Practical Aspects of Sensitivity in Online Experimentation with User Engagement Metrics
• Various authors, Top Challenges from the first Practical Online Controlled Experiments Summit
• David L. DeMents, K. K. Gordon Lan, Interim analysis: The alpha spending function approach
• P. C. O’Brien, T.R. Fleming - A Multiple Testing Procedure for Clinical Trials
• A. Deng et al., Applying the Delta Method in Metrics Analytics: A Practical Guide with Novel Ideas