Eur. Phys. J. Plus (2012) 127: 157
https://doi.org/10.1140/epjp/i2012-12157-0

Regular Article

Evidence for conservatism in LHC SUSY searches

¹ SLAC, Stanford University, Stanford, USA
² Department of Physics, Harvard University, Boston, USA

^* e-mail: bnachman@cern.ch

Received: 18 November 2012
Revised: 1 December 2012
Accepted: 10 December 2012
Published online: 19 December 2012

Abstract

The standard in the high-energy physics community for claiming discovery of new physics is a 5σ excess in the observed signal over the estimated background. While a 3σ excess is not enough to claim discovery, it is certainly enough to pique the interest of both experimentalists and theorists. However, with a large number of searches performed by both the ATLAS and CMS Collaborations at the LHC, one expects a nonzero number of multi-σ results simply due to statistical fluctuations in the no-signal scenario. Our analysis examines the distribution of p-values for CMS and ATLAS supersymmetry (SUSY) searches using the full 2011 data set to determine if the collaborations are being overly conservative in their analyses. We find that there is a statistically significant difference between the expected and observed distributions of p-values and suggest that the most probable cause is overconservatism in the estimation of uncertainties.