Hannah Li
Columbia DRO
Operational Dosage: Implications of Capacity Constraints for Experimentation
Hannah Li · Columbia DRO
Randomized controlled trials are the gold standard for evaluating interventions — yet a broad class of trials systematically violates a core assumption of standard experimental design. When interventions are delivered by capacity-constrained resources — teachers, healthcare providers, social workers, and countless others — participants compete for finite service capacity, creating hidden variation in the treatment itself. We call this operational dosage. Using queueing-theoretic methods, we show that in such settings, treatment effects are both capacity- and sample-size-dependent, and that statistical power is non-monotone in sample size: adding participants beyond a critical threshold reduces power, directly contradicting conventional power calculations. We validate these insights through simulations calibrated to a real-world tuberculosis intervention trial in Kenya. Our results reveal a fundamental design lever — capacity selection — that has been largely ignored in experimental practice, and offer a unifying explanation for why promising interventions so often fail to replicate or scale.
Joint work with Justin Boutilier, Jonas Jonasson, and Erez Yoeli.
About the speaker
Hannah Li is an Assistant Professor in the Decision, Risk, and Operations division at Columbia Business School. Her research focuses on developing data science methods for social settings—online platforms, education, and healthcare. Her research combines techniques from operations research, statistics, and economics to develop theoretical insights for practically motivated problems. Her work has been recognized by the INFORMS Dantzig Dissertation Award, MSOM Service Management SIG Best Paper Award, INFORMS DEI Best Student Paper Award, and the ACM Equity and Access in Algorithms, Mechanisms, and Optimization (EAAMO) Best Student Paper Award. She holds a BA in mathematics from Pomona College and a Ph.D. in operations research from Stanford, and was previously a postdoctoral associate at MIT.