Ego Depletion May Disappear by 2020
Abstract
Abstract. Ego depletion has been successfully replicated in hundreds of studies. Yet the most recent large-scale Registered Replication Reports (RRR), comprising thousands of participants, have yielded disappointingly small effects, sometimes even failing to reach statistical significance. Although these results may seem surprising, in the present article I suggest that they are perfectly consistent with a long-term decline in the size of the depletion effects that can be traced back to at least 10 years ago, well before any of the RRR on ego depletion were conceived. The decline seems to be at least partly due to a parallel trend toward publishing better and less biased research.
References
2018). Open Science challenges, benefits and tips in early career and beyond. Unpublished manuscript. Available at https://doi.org/10.31234/osf.io/3czyt
(2016). Charting the future of social psychology on stormy seas: Winners, losers, and recommendations. Journal of Experimental Psychology, 66, 153–158. https://doi.org/10.1016/j.jesp.2016.02.003
(1998). Ego depletion: Is the active self a limited resource? Journal of Personality and Social Psychology, 74, 1252–1265. https://doi.org/10.1037/0022-3514.74.5.1252
(2016). Misguided effort with elusive implications. Perspectives on Psychological Science, 11, 574–575. https://doi.org/10.1177/1745691616652878
(2016). Evaluating replicability of laboratory experiments in economics. Science, 351, 1433–1436. https://doi.org/10.1126/science.aaf0918
(2018). Evaluating the replicability of social science experiments in Nature and Science between 2010 and 2015. Nature Human Behaviour, 2, 637–644. https://doi.org/10.1038/s41562-018-0399-z
(2015). A series of meta-analytic tests of the depletion effect: Self-control does not seem to rely on a limited resource. Journal of Experimental Psychology: General, 144, 796–815. https://doi.org/10.1037/xge0000083
(2013). Is ego depletion too incredible? Evidence for the overestimation of the depletion effect. Behavioral and Brain Sciences, 36, 683–684. https://doi.org/10.1017/S0140525X13000952
(2014). Publication bias and the limited strength model of self-control: Has the evidence for ego depletion been overestimated? Frontiers in Psychology, 5, 823. https://doi.org/10.3389/fpsyg.2014.00823
(2018). A simple, principled approach to combining evidence from meta-analysis and high-quality replications. Advances in Methods and Practices in Psychological Science, 1, 174–185. https://doi.org/10.1177/2515245918756858
(2013). Whatever next? Predictive brains, situated agents, and the future of cognitive science. Behavioral and Brain Sciences, 36, 181–204. https://doi.org/10.1017/S0140525X12000477
(2016). Commentary: “A multilab preregistered replication of the ego-depletion effect”. Frontiers in Psychology, 7, 1155. https://doi.org/10.3389/fpsyg.2016.01155
(2018). An updated meta-analysis of the ego depletion effect. Psychological Research, 82, 645–651. https://doi.org/10.1007/s00426-017-0862-x
(2017). The ego could be depleted, providing initial exertion is depleting. Social Psychology, 48, 242–245. https://doi.org/10.1027/1864-9335/a000308
(2018). Reflection on the professor priming replication report. Perspectives on Psychological Science, 13, 295–296. https://doi.org/10.1177/1745691618755705
(2017). Commentary: “Misguided effort with elusive implications” and “A multi-lab pre-registered replication of the ego depletion effect”. Frontiers in Psychology, 8, 273. https://doi.org/10.3389/fpsyg.2017.00273
(2016). Many Labs 3: Evaluating participant pool quality across the academic semester via replication. Journal of Experimental Social Psychology, 67, 68–82. https://doi.org/10.1016/j.jesp.2015.10.012
(2017). The (non-)replicability of regulatory resource depletion: A field report employing non-invasive brain stimulation. PLoS One, 12, e0174331. https://doi.org/10.1371/journal.pone.0174331
(2012). Too good to be true: Publication bias in two prominent studies from experimental psychology. Psychonomic Bulletin & Review, 19, 151–156. https://doi.org/10.3758/s13423-012-0227-9
(2014). Publication bias in the social sciences: Unlocking the file drawer. Science, 345, 1502–1505. https://doi.org/10.1126/science.1255484
(in press). Is ego depletion real? An analysis of arguments. Personality and Social Psychology Review. https://doi.org/10.1177/1088868318762183
(in press). Ego depletion reduces attention control: Evidence from two high-powered preregistered experiments. Personality and Social Psychology Bulletin. https://doi.org/10.1177/0146167218796473
(2006). The fading of reported effectiveness: A meta-analysis of randomised controlled trials. BMC Medical Research Methodology, 6, 25. https://doi.org/10.1186/1471-2288-6-25
(2016). Comment on “Estimating the reproducibility of psychological science”. Science, 351, 1037b. https://doi.org/10.1126/science.aad7243
(2016). A multi-lab pre-registered replication of the ego-depletion effect. Perspectives on Psychological Science, 11, 546–573. https://doi.org/10.1177/1745691616652873
(2010). Ego depletion and the strength model of self-control: A meta-analysis. Psychological Bulletin, 136, 495–525. https://doi.org/10.1037/a0019486
(2018). Improving the replicability of psychological science through pedagogy. Advances in Methods and Practices in Psychological Science, 1, 7–18. https://doi.org/10.1177/2515245917740427
(1998). Effect of the statistical significance of results on the time to completion and publication of randomized efficacy trials. Journal of the American Medical Association, 279, 281–286. https://doi.org/10.1001/jama.279.4.281
(2008). Why most discovered true associations are inflated. Epidemiology, 19, 640–648. https://doi.org/10.1097/EDE.0b013e31818131e7
(2002). Relationships fade with time: A meta-analysis of temporal trends in publication in ecology and evolution. Proceedings of the Royal Society of London, B, 269, 43–48. https://doi.org/10.1098/rspb.2001.1832
(2015). The effects of cognitive behavioral therapy as an anti-depressive treatment is falling: A meta-analysis. Psychological Bulletin, 14, 747–768. https://doi.org/10.1037/bul0000015
(2015). Likelihood of null effects on large NHLBI clinical trials has increased over time. PLoS One, 10, e0132382. https://doi.org/10.1371/journal.pone.0132382
(2014). Investigating variation in replicability: A “many labs” replication project. Social Psychology, 45, 142–152. https://doi.org/10.1027/1864-9335/a000178
(2011, December 13). The truth wears off: Is there something wrong with the scientific method? New Yorker Magazine, 52–56.
(2016). No evidence of the ego-depletion effect across task characteristics and individual differences: A pre-registered study. PLoS One, 11, e0147770. https://doi.org/10.1371/journal.pone.0147770
(2002). Combining effect size estimates in meta-analysis with repeated measures and independent-groups designs. Psychological Methods, 7, 105–125. https://doi.org/10.1037/1082-989X.7.1.105
(1998). Self- control as a limited resource: Regulatory depletion patterns. Journal of Personality and Social Psychology, 74, 774–789. https://doi.org/10.1037/0022-3514.74.3.774
(2018). Registered Replication Report: Dijksterhuis & van Knippenberg (1998). Perspectives on Psychological Science, 13, 268–294. https://doi.org/10.1177/1745691618755704
(2015). Estimating the reproducibility of psychological science. Science, 349, aac4716. https://doi.org/10.1126/science.aac4716
. (2018). Registered trials report less beneficial treatment effects than unregistered ones: A meta-epidemiological study in orthodontics. Journal of Clinical Epidemiology, 100, 44–52. https://doi.org/10.1016/j.jclinepi.2018.04.017
(2012). Editors’ introduction to the special section on replicability in psychological science: A crisis of confidence? Perspectives on Psychological Science, 7, 528–530. https://doi.org/10.1177/1745691612465253
(2012). Empirical evaluation of very large treatment effects of medical interventions. The Journal of the American Medical Association, 308, 1676–1684. https://doi.org/10.1001/jama.2012.13444
(2017, September 13). Kids these days. Retrieved from https://osf.io/j9tuz/
(2017).
(Decline effects: Types, mechanisms, and personal reflections . In S. O. LilienfeldI. D. WaldmanEds., Psychological science under scrutiny: Recent challenges and proposed solutions (pp. 85–107). Chichester, UK: Wiley.2018). Non-naivety may reduce the effect of intuition manipulations. Nature Human Behavior, 2, 602. https://doi.org/10.1038/s41562-018-0404-6
(1972).
(A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement . In A. H. BlackW. F. ProkasyEds., Classical conditioning II (pp. 64–99). New York, NY: Appleton-Century-Crofts.1979). The file drawer problem and tolerance for null results. Psychological Bulletin, 86, 638–641. https://doi.org/10.1037/0033-2909.86.3.638
(2011). Unpublished results hide the decline effect. Nature, 470, 437. https://doi.org/10.1038/470437a
(1999). Fluctuating paradigm. Proceedings of the Royal Society of London, B, 266, 593–595. https://doi.org/10.1098/rspb.1999.0677
(2014). An introduction to registered replication reports at Perspectives on Psychological Science. Perspectives on Psychological Science, 9, 552–555. https://doi.org/10.1177/1745691614543974
(2014). No-way interactions. [Blog post]. Retrieved from http://datacolada.org/17
(2018). Ego depletion does not interfere with working memory performance. Frontiers in Psychology, 9, 538. https://doi.org/10.3389/fpsyg.2018.00538
(2014). Methylphenidate blocks effort-induced depletion of regulatory control in healthy volunteers. Psychological Science, 25, 1227–1234. https://doi.org/10.1177/0956797614526415
(2018, March 3). About to start – a symposium session on fresh* results from a multi-site ego depletion study #spsp2018 [Tweet]. Retrieved from https://twitter.com/hardsci/status/970015349499465729
(1959). Publication decisions and their possible effects on inferences drawn from tests of significance – or vice versa. Journal of the American Statistical Association, 54, 30–34. 10.2307/2282137
(1997). Publication bias: Evidence of delayed publication in a cohort study of clinical research projects. British Medical Journal, 315, 640–645. https://doi.org/10.1136/bmj.315.7109.640
(2011). Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. British Medical Journal, 343, 4002. https://doi.org/10.1136/bmj.d4002
(2016). Reflection on the smiling registered replication report. Perspectives on Psychological Science, 11, 929–930. https://doi.org/10.1177/1745691616674460
(2004). Effect sizes in cumulative meta-analyses of mental health randomized trials evolved over time. Journal of Clinical Epidemiology, 57, 1124–1130. https://doi.org/10.1016/j.jclinepi.2004.02.018
(2005).
(Assessing the evolution of effect sizes over time . In H. R. RothsteinA. J. SuttonM. BorensteinEds., Publication bias and meta-analysis: Prevention, assessment and adjustments (pp. 241–259). New York, NY: Wiley.2018). Searching for the bottom of the ego well: Failure to uncover ego depletion in Many Labs 3. Royal Society Open Science, 5, 180390. https://doi.org/10.1098/rsos.180390
(2015). Money priming can change people’s thoughts, feelings, motivations, and behaviors: An update on 10 years of experiments. Journal of Experimental Psychology: General, 144, e86–e93. https://doi.org/10.1037/xge0000091
(2016). Registered Replication Report: Strack, Martin, & Stepper (1988). Perspectives on Psychological Science, 11, 917–928. https://doi.org/10.1177/1745691616674458
(2016). Meta-analytic and empirical estimates of the resource depletion effect size (Unpublished doctoral dissertation). University of Minnesota, Minneapolis, MI.
(