Book contents
- Trustworthy Online Controlled Experiments
- Reviews
- Trustworthy Online Controlled Experiments
- Copyright page
- Contents
- Preface
- Acknowledgments
- Part I Introductory Topics for Everyone
- Part II Selected Topics for Everyone
- Part III Complementary and Alternative Techniques to Controlled Experiments
- Part IV Advanced Topics for Building an Experimentation Platform
- 12 Client-Side Experiments
- 13 Instrumentation
- 14 Choosing a Randomization Unit
- 15 Ramping Experiment Exposure: Trading Off Speed, Quality, and Risk
- 16 Scaling Experiment Analyses
- Part V Advanced Topics for Analyzing Experiments
- References
- Index
13 - Instrumentation
from Part IV - Advanced Topics for Building an Experimentation Platform
Published online by Cambridge University Press: 13 March 2020
- Trustworthy Online Controlled Experiments
- Reviews
- Trustworthy Online Controlled Experiments
- Copyright page
- Contents
- Preface
- Acknowledgments
- Part I Introductory Topics for Everyone
- Part II Selected Topics for Everyone
- Part III Complementary and Alternative Techniques to Controlled Experiments
- Part IV Advanced Topics for Building an Experimentation Platform
- 12 Client-Side Experiments
- 13 Instrumentation
- 14 Choosing a Randomization Unit
- 15 Ramping Experiment Exposure: Trading Off Speed, Quality, and Risk
- 16 Scaling Experiment Analyses
- Part V Advanced Topics for Analyzing Experiments
- References
- Index
Summary
Why you care: Before you can run any experiments, you must have instrumentation in place to log what is happening to the users and the system (e.g., website, application). Moreover, every business should have a baseline understanding of how the system is performing and how users interact with it, which requires instrumentation. When running experiments, having rich data about what users saw, their interactions (e.g., clicks, hovers, and time-to-click), and system performance (e.g., latencies) is critical.
- Type
- Chapter
- Information
- Trustworthy Online Controlled ExperimentsA Practical Guide to A/B Testing, pp. 162 - 165Publisher: Cambridge University PressPrint publication year: 2020