Skip to main content
Original Articles and Reviews

Best Practices and Recommendations for Digital Interventions to Improve Engagement and Adherence in Chronic Illness Sufferers

Published Online:https://doi.org/10.1027/1016-9040/a000349

Abstract. Chronic illnesses cause considerable burden in quality of life, often leading to physical, psychological, and social dysfunctioning of the sufferers and their family. There is a growing need for flexible provision of home-based psychological services to increase reach even for traditionally underserved chronic illness sufferer populations. Digital interventions can fulfill this role and provide a range of psychological services to improve functioning. Despite the potential of digital interventions, concerns remain regarding users’ engagement, as low engagement is associated with low adherence rates, high attrition, and suboptimal exposure to the intervention. Human–computer interaction (e.g., theoretical models of persuasive system design, gamification, tailoring, and supportive accountability) and user characteristics (e.g., gender, age, computer literacy) are the main identified culprits contributing to engagement and adherence difficulties. To date, there have not been any clear and concise recommendations for improved utilization and engagement in digital interventions. This paper provides an overview of user engagement factors and proposes research informed recommendations for engagement and adherence planning in digital intervention development. The recommendations were derived from the literature and consensualized by expert members of the European Federation of Psychology Associations, Psychology and Health Standing Committee, and e-Health Task Force. These recommendations serve as a starting point for researchers and clinicians interested in the digitalized health field and promote effective planning for engagement when developing digital interventions with the potential to maximize adherence and optimal exposure in the treatment of chronic health conditions.

References

  • Abraham, C. & Michie, S. (2008). A taxonomy of behavior change techniques used in interventions. Health Psychology, 27, 379–387. https://doi.org/10.1037/0278-6133.27.3.379 First citation in articleCrossrefGoogle Scholar

  • Adams, J. S. (1965). Inequity in social exchange. Advances in Experimental Social Psychology, 2, 267–299. https://doi.org/10.1016/S0065-2601(08)60108-2 First citation in articleCrossrefGoogle Scholar

  • Andersson, G., Carlbring, P., Berger, T., Almlöv, J. & Cuijpers, P. (2009). What makes Internet therapy work? Cognitive Behaviour Therapy, 38(S1), 55–60. https://doi.org/10.1080/16506070902916400 First citation in articleCrossrefGoogle Scholar

  • Arora, S., Yttri, J. & Nilsen, W. (2014). Privacy and security in Mobile Health (mHealth) Research. Alcohol Research: Current Reviews, 36, 143–151. First citation in articleGoogle Scholar

  • Bandura, A. (1982). Self-efficacy mechanism in human agency. American Psychologist, 37, 122–147. https://doi.org/10.1037/0003-066X.37.2.122 First citation in articleCrossrefGoogle Scholar

  • Barak, A., Klein, B. & Proudfoot, J. G. (2009). Defining Internet-supported therapeutic interventions. Annals of Behavioral Medicine, 38, 4–17. https://doi.org/10.1007/s12160-009-9130-7 First citation in articleCrossrefGoogle Scholar

  • Baumeister, H., Reichler, L., Munzinger, M. & Lin, J. (2014). The impact of guidance on Internet-based mental health interventions – A systematic review. Internet Interventions, 1, 205–215. https://doi.org/10.1016/j.invent.2014.08.003 First citation in articleCrossrefGoogle Scholar

  • Bender, J. L., Radhakrishnan, A., Diorio, C., Englesakis, M. & Jadad, A. R. (2011). Can pain be managed through the Internet? A systematic review of randomized controlled trials. Pain, 152, 1740–1750. https://doi.org/10.1016/j.pain.2011.02.012 First citation in articleCrossrefGoogle Scholar

  • Bennett, G. G. & Glasgow, R. E. (2009). The delivery of public health interventions via the Internet: actualizing their potential. Annual Review of Public Health, 30, 273–292. https://doi.org/10.1146/annurev.publhealth.031308.100235 First citation in articleCrossrefGoogle Scholar

  • Black, A. D., Car, J., Pagliari, C., Anandan, C., Cresswell, K., Bokun, T., … Sheikh, A. (2011). The impact of eHealth on the quality and safety of health care: A systematic overview. PLoS Medicine, 8, e1000387. https://doi.org/10.1371/journal.pmed.1000387 First citation in articleCrossrefGoogle Scholar

  • Breivik, H., Collett, B., Ventafridda, V., Cohen, R. & Gallacher, D. (2006). Survey of chronic pain in Europe: Prevalence, impact on daily life, and treatment. European Journal of Pain, 10, 287–333. https://doi.org/10.1016/j.ejpain.2005.06.009 First citation in articleCrossrefGoogle Scholar

  • Brouwer, W., Kroeze, W., Crutzen, R., de Nooijer, J., de Vries, N. K., Brug, J. & Oenema, A. (2011). Which intervention characteristics are related to more exposure to Internet-delivered healthy lifestyle promotion interventions? A systematic review. Journal of Medical Internet Research, 13, e2. https://doi.org/10.2196/jmir.1639 First citation in articleCrossrefGoogle Scholar

  • Brouwer, W., Oenema, A., Raat, H., Crutzen, R., de Nooijer, J., de Vries, N. K. & Brug, J. (2010). Characteristics of visitors and revisitors to an Internet-delivered computer-tailored lifestyle intervention implemented for use by the general public. Health Education Research, 25, 585–595. https://doi.org/10.1093/her/cyp063 First citation in articleCrossrefGoogle Scholar

  • Brown, M., O’Neill, N., van Woerden, H., Eslambolchilar, P., Jones, M. & John, A. (2016). Gamification and adherence to Web-based mental health interventions: A systematic review. JMIR Mental Health, 3, e39. https://doi.org/10.2196/mental.5710 First citation in articleCrossrefGoogle Scholar

  • Brug, J., Oenema, A. & Campbell, M. (2003). Past, present, and future of computer-tailored nutrition education. The American Journal of Clinical Nutrition, 77, 1028S–1034S. https://doi.org/10.1093/ajcn/77.4.1028S First citation in articleCrossrefGoogle Scholar

  • Brug, J., Oenema, A., Kroeze, W. & Raat, H. (2005). The Internet and nutrition education: Challenges and opportunities. European Journal of Clinical Nutrition, 59, S130–S139. https://doi.org/10.1038/sj.ejcn.1602186 First citation in articleCrossrefGoogle Scholar

  • Buckingham D.Ed. (2008). Youth, identity, and digital media. Cambridge, MA: MIT Press. First citation in articleGoogle Scholar

  • Carlbring, P., Westling, B. E., Ljungstrand, P., Ekselius, L. & Andersson, G. (2001). Treatment of panic disorder via the Internet: A randomized trial of a self-help program. Behavior Therapy, 32, 751–764. https://doi.org/10.1016/S0005-7894(01)80019-8 First citation in articleCrossrefGoogle Scholar

  • Carney, R. M., Freedland, K. E., Kenneth, E., Eisen, S. A., Rich, M. W. & Jaffe, A. S. (1995). Major depression and medication adherence in elderly patients with coronary artery disease. Health Psychology, 14, 88–90. https://doi.org/10.1037/0278-6133.14.1.88 First citation in articleCrossrefGoogle Scholar

  • Carpenter, K. M., Stoner, S. A., Mundt, J. M. & Stoelb, B. (2012). An online self-help CBT intervention for chronic lower back pain. The Clinical Journal of Pain, 28, 14–22. https://doi.org/10.1097%2FAJP.0b013e31822363db First citation in articleCrossrefGoogle Scholar

  • Checkland, K., Marshall, M. & Harrison, S. (2004). Re-thinking accountability: Trust versus confidence in medical practice. Quality and Safety in Health Care, 13, 130–135. https://doi.org/10.1136/qshc.2003.009720 First citation in articleCrossrefGoogle Scholar

  • Christensen, A. J., Benotsch, E. G. & Smith, T. W. (1997). Determinants of regimen adherence in renal dialysis. In D. S. GochmanEd., Handbook of health behavior research II (pp. 231–244). Boston, MA: Springer. https://doi.org/10.1007/978-1-4899-1760-7_12 First citation in articleGoogle Scholar

  • Christensen, H., Griffiths, K. M. & Farrer, L. (2009). Adherence in Internet interventions for anxiety and depression: Systematic review. Journal of Medical Internet Research, 11, e13. https://doi.org/10.2196/jmir.1194 First citation in articleCrossrefGoogle Scholar

  • Christensen, H., Griffiths, K. M. & Korten, A. (2002). Web-based cognitive behavior therapy: Analysis of site usage and changes in depression and anxiety scores. Journal of Medical Internet Research, 4, e3. https://doi.org/10.2196/jmir.4.1.e3 First citation in articleCrossrefGoogle Scholar

  • Christensen, H., Griffiths, K. M., Korten, A. E., Brittliffe, K. & Groves, C. (2004). A comparison of changes in anxiety and depression symptoms of spontaneous users and trial participants of a cognitive behavior therapy website. Journal of Medical Internet Research, 6, e46. https://doi.org/10.2196/jmir.6.4.e46 First citation in articleCrossrefGoogle Scholar

  • Cobb, N. K. & Poirier, J. (2014). Effectiveness of a multimodal online well-being intervention: A randomized controlled trial. American Journal of Preventive Medicine, 46, 41–48. https://doi.org/10.1016/j.amepre.2013.08.018 First citation in articleCrossrefGoogle Scholar

  • Corsonello, A., Pedone, C., Garasto, S., Maiuri, G., Carelli, A., Zottola, C. & Lattanzio, F. (2010). The impact of comorbidity on medication adherence and therapeutic goals. BMC Geriatrics, 10(Suppl 1), L21. https://doi.org/10.1186/1471-2318-10-S1-L21 First citation in articleCrossrefGoogle Scholar

  • Couper, M. P., Alexander, G. L., Zhang, N., Little, R. J. A., Maddy, N., Nowak, M. A., … Johnson, C. C. (2010). Engagement and retention: Measuring breadth and depth of participant use of an online intervention. Journal of Medical Internet Research, 12, e52. https://doi.org/10.2196/jmir.1430 First citation in articleCrossrefGoogle Scholar

  • Cugelman, B. (2013). Gamification: What it is and why it matters to digital health behavior change developers. JMIR Serious Games, 1, e3. https://doi.org/10.2196/games.3139 First citation in articleCrossrefGoogle Scholar

  • Cuijpers, P., Van Straten, A. & Andersson, G. (2008). Internet-administered cognitive behavior therapy for health problems: A systematic review. Journal of Behavioral Medicine, 31, 169–177. https://doi.org/10.1007/s10865-007-9144-1 First citation in articleCrossrefGoogle Scholar

  • De Nooijer, J., Oenema, A., Kloek, G., Brug, H., De Vries, H. & De Vries, N. (2005). Bevordering van gezond gedrag via het Internet: nu en in de toekomst [Promotion of healthy behavior through the Internet: Now and in the future]. Retrieved from https://maastrichtuniversity.nl/portal/en/publications/bevordering-van-gezond-gedrag-via-internet-nu-en-in-de-toekomst(1d99b191–a6b8–4895-8e08–7eefefbcb9b3).html. Maastricht, The Netherlands: Universiteit Maastricht. First citation in articleGoogle Scholar

  • Dennison, L., Morrison, L., Conway, G. & Yardley, L. (2013). Opportunities and challenges for smartphone applications in supporting health behavior change: Qualitative study. Journal of medical Internet research, 15, e86. https://doi.org/10.2196/jmir.2583 First citation in articleCrossrefGoogle Scholar

  • Deterding, S., Dixon, D., Khaled, R. & Nacke, L. (2011). From game design elements to gamefulness: Defining gamification. In ACMEd., Proceedings of the 15th International Academic MindTrek Conference: Envisioning future media environments (pp. 9–15). New York, NY: ACM. https://doi.org/10.1145/2181037.2181040 First citation in articleGoogle Scholar

  • DiMatteo, M. R., Haskard, K. B. & Williams, S. L. (2007). Health beliefs, disease severity, and patient adherence: A meta-analysis. Medical Care, 45, 521–528. https://doi.org/10.1097/MLR.0b013e318032937e First citation in articleCrossrefGoogle Scholar

  • Donkin, L., Christensen, H., Naismith, S. L., Neal, B., Hickie, I. B. & Glozier, N. (2011). A systematic review of the impact of adherence on the effectiveness of e-therapies. Journal of medical Internet research, 13, e52. https://doi.org/10.2196/jmir.1772 First citation in articleCrossrefGoogle Scholar

  • Eccleston, C., Fisher, E., Craig, L., Duggan, G. B., Rosser, B. A. & Keogh, E. (2014). Psychological therapies (Internet‐delivered) for the management of chronic pain in adults. The Cochrane Library, 2, CD010152. https://doi.org/10.1002/14651858.CD010152.pub2 First citation in articleGoogle Scholar

  • Enzle, M. E. & Anderson, S. C. (1993). Surveillant intentions and intrinsic motivation. Journal of Personality and Social Psychology, 64, 257–266. https://doi.org/10.1037/0022-3514.64.2.257 First citation in articleCrossrefGoogle Scholar

  • European Group on Ethics in Science and New Technologies to the European Commission, & European Commission. (2012). Ethics of information and communication technologies, Publications Office of the European Union. First citation in articleGoogle Scholar

  • Eysenbach, G. (2005). The law of attrition. Journal of Medical Internet Research, 7, e11. https://doi.org/10.2196/jmir.7.1.e11 First citation in articleCrossrefGoogle Scholar

  • Fairburn, C. G. & Patel, V. (2017). The impact of digital technology on psychological treatments and their dissemination. Behaviour Research and Therapy, 88, 19–25. https://doi.org/10.1016/j.brat.2016.08.012 First citation in articleCrossrefGoogle Scholar

  • Fishbain, D. A., Rosomoff, H. L. & Rosomoff, R. S. (1992). Drug abuse, dependence, and addiction in chronic pain patients. The Clinical Journal of Pain, 8, 77–85. https://doi.org/10.1097/00002508-199206000-00003 First citation in articleCrossrefGoogle Scholar

  • Fogg, B. J. (1997). Charismatic computers: Creating more likable and persuasive interactive technologies by leveraging principles from social psychology PhD Thesis. Stanford, CA: Stanford University First citation in articleGoogle Scholar

  • Fogg, B. J. (1998). Persuasive computers: Perspectives and research directions. In ACMEd., Proceedings of the SIGCHI conference on Human factors in computing systems (pp. 225–232). New York, NY: ACM Press/Addison-Wesley. https://doi.org/10.1145/274644.274677 First citation in articleGoogle Scholar

  • Fogg, B. J. (2002). Persuasive technology: Using computers to change what we think and do. Ubiquity, 2002, 5. https://doi.org/10.1145/764008.763957 First citation in articleCrossrefGoogle Scholar

  • Geissler, G. L., Zinkhan, G. M. & Watson, R. T. (2006). The influence of home page complexity on consumer attention, attitudes, and purchase intent. Journal of Advertising, 35, 69–80. https://doi.org/10.1080/00913367.2006.10639232 First citation in articleCrossrefGoogle Scholar

  • Glasgow, R. E. (2007). eHealth evaluation and dissemination research. American Journal of Preventive Medicine, 32, S119–S126. https://doi.org/10.1016/j.amepre.2007.01.023 First citation in articleCrossrefGoogle Scholar

  • Haas, L. J. & Malouf, J. L. (2002). Keeping up the good work: A practitioner’s guide to mental health ethics (2nd ed.). Sarasota, FL: Professional Resource Press. https://doi.org/10.1207/s15327019eb0201_5 First citation in articleGoogle Scholar

  • Hall, J. A., Roter, D. L., Milburn, M. A. & Daltroy, L. H. (1996). Patients’ health as a predictor of physician and patient behavior in medical visits: A synthesis of four studies. Medical Care, 34, 1205–1218. First citation in articleCrossrefGoogle Scholar

  • Hayes, S. C., Strosahl, K. D. & Wilson, K. G. (1999). Acceptance and commitment therapy: An experiential approach to behavior change. New York, NY: Guilford Press. First citation in articleGoogle Scholar

  • Henry, S. L., Rook, K. S., Stephens, M. A. & Franks, M. M. (2013). Spousal undermining of older diabetic patients’ disease management. Journal of Health Psychology, 18, 1550–1561. https://doi.org/10.1177/1359105312465913 First citation in articleCrossrefGoogle Scholar

  • Hilvert-Bruce, Z., Rossouw, P. J., Wong, N., Sunderland, M. & Andrews, G. (2012). Adherence as a determinant of effectiveness of Internet cognitive behavioural therapy for anxiety and depressive disorders. Behaviour Research and Therapy, 50, 463–468. https://doi.org/10.1016/j.brat.2012.04.001 First citation in articleCrossrefGoogle Scholar

  • Hoffmann, N. G., Olofsson, O., Salen, B. & Wickstrom, L. (1995). Prevalence of abuse and dependency in chronic pain patients. International Journal of the Addictions, 30, 919–927. https://doi.org/10.3109/10826089509055820 First citation in articleCrossrefGoogle Scholar

  • Hong, T. (2006). Contributing factors to the use of health-related websites. Journal of Health Communication, 11, 149–165. https://doi.org/10.1080/10810730500526679 First citation in articleCrossrefGoogle Scholar

  • Horne, R. & Weinman, J. (1999). Patients’ beliefs about prescribed medicines and their role in adherence to treatment in chronic physical illness. Journal of Psychosomatic Research, 47, 555–567. https://doi.org/10.1016/S0022-3999(99)00057-4 First citation in articleCrossrefGoogle Scholar

  • Hsiung, R. (2001). PSI Suggested principles of professional ethics for the online provision of mental health services. Telemedicine Journal and E-health, 7, 39–45. https://doi.org/10.1089/153056201300093895 First citation in articleCrossrefGoogle Scholar

  • Imamura, K., Kawakami, N., Furukawa, T. A., Matsuyama, Y., Shimazu, A., Umanodan, R., … Kasai, K. (2014). Effects of an Internet-based Cognitive Behavioral Therapy (iCBT) program in Manga format on improving subthreshold depressive symptoms among healthy workers: A randomized controlled trial. PLoS One, 9, e97167. https://doi.org/10.1371/journal.pone.0097167 First citation in articleCrossrefGoogle Scholar

  • International Society for Mental Health Online. (2000). ISMHO/PSI suggested principles for the online provision of mental health services. Retrieved from http://www.ismho.org/suggestions.html First citation in articleGoogle Scholar

  • Irvine, A. B., Gelatt, V. A., Seeley, J. R., Macfarlane, P. & Gau, J. M. (2013). Web-based intervention to promote physical activity by sedentary older adults: Randomized controlled trial. Journal of Medical Internet Research, 15, e19. https://doi.org/10.2196/jmir.2158 First citation in articleCrossrefGoogle Scholar

  • Jamison, R. N., Gintner, L., Rogers, J. F. & Fairchild, D. G. (2002). Disease management for chronic pain: Barriers of program implementation with primary care physicians. Pain Medicine, 3, 92–101. https://doi.org/10.1046/j.1526-4637.2002.02022.x First citation in articleCrossrefGoogle Scholar

  • Japuntich, S. J., Zehner, M. E., Smith, S. S., Jorenby, D. E., Valdez, J. A., Fiore, M. C., … Gustafson, D. H. (2006). Smoking cessation via the Internet: A randomized clinical trial of an Internet intervention as adjuvant treatment in a smoking cessation intervention. Nicotine & Tobacco Research, 8(Suppl 1), S59–S67. https://doi.org/10.1080/14622200601047900 First citation in articleCrossrefGoogle Scholar

  • Jasper, K., Weise, C., Conrad, I., Andersson, G., Hiller, W. & Kleinstäuber, M. (2014). The working alliance in a randomized controlled trial comparing Internet-based self-help and face-to-face cognitive behavior therapy for chronic tinnitus. Internet Interventions, 1, 49–57. https://doi.org/10.1016/j.invent.2014.04.002 First citation in articleCrossrefGoogle Scholar

  • Jensen, M. P., Nielson, W. R., Romano, J. M., Hill, M. L. & Turner, J. A. (2000). Further evaluation of the pain stages of change questionnaire: Is the transtheoretical model of change useful for patients with chronic pain? Pain, 86, 255–264. https://doi.org/10.1016/S0304-3959(00)00257-8 First citation in articleCrossrefGoogle Scholar

  • Jerant, A. F., von Friederichs-Fitzwater, M. M. & Moore, M. (2005). Patients’ perceived barriers to active self-management of chronic conditions. Patient Education and Counseling, 57, 300–307. https://doi.org/10.1016/j.pec.2004.08.004 First citation in articleCrossrefGoogle Scholar

  • Johansson, R. & Andersson, G. (2012). Internet-based psychological treatments for depression. Expert Review of Neurotherapeutics, 12, 861. https://doi.org/10.1586/ern.12.63 First citation in articleCrossrefGoogle Scholar

  • Karekla, M. (2017). ACT-based digital applications for health behavior change: #FlexiQuit #AcceptMe#AlgeaApp. Invited address at the Association of Contextual Behavior Science Annual World Conference, Seville, Spain. First citation in articleGoogle Scholar

  • Karekla, M., Karademas, E., Vasiliou, V., Kasinopoulos, O., Flouri, M., Christou, G. & Papacostas, S. (2017). In search for novel and more effective psychological treatments for chronic pain: The “Algea” Research Project. European Health Psychologist, 19, 297–301. First citation in articleGoogle Scholar

  • Karyotaki, E., Kleiboer, A., Smit, F., Turner, D. T., Pastor, A. M., Andersson, G., … Christensen, H. (2015). Predictors of treatment dropout in self-guided web-based interventions for depression: An “individual patient data” meta-analysis. Psychological Medicine, 45, 2717–2726. https://doi.org/10.1017/S0033291715000665 First citation in articleCrossrefGoogle Scholar

  • Kavanagh, D. J. (1992). Recent developments in expressed emotion and schizophrenia. The British Journal of Psychiatry, 160, 601–620. https://doi.org/10.1192/bjp.160.5.601 First citation in articleCrossrefGoogle Scholar

  • Kelders, S. M., Kok, R. N., Ossebaard, H. C. & Van Gemert-Pijnen, J. E. (2012). Persuasive system design does matter: A systematic review of adherence to web-based interventions. Journal of Medical Internet Research, 14, e152. https://doi.org/10.2196/jmir.2104 First citation in articleCrossrefGoogle Scholar

  • Kelders, S. M., Van Gemert-Pijnen, J. E., Werkman, A., Nijland, N. & Seydel, E. R. (2011). Effectiveness of a web-based intervention aimed at healthy dietary and physical activity behavior: A randomized controlled trial about users and usage. Journal of Medical Internet Research, 13, e32. https://doi.org/10.2196/jmir.1624 First citation in articleCrossrefGoogle Scholar

  • Kenwright, M., Marks, I. M., Gega, L. & Mataix-Cols, D. (2004). Computer-aided self-help for phobia/panic via Internet at home: A pilot study. The British Journal of Psychiatry, 184, 448–449. https://doi.org/10.1192/bjp.184.5.448 First citation in articleCrossrefGoogle Scholar

  • Keogh, E. (2013). Developments in the use of e-health for chronic pain management. Pain Management, 3, 27–33. https://doi.org/10.2217/pmt.12.70 First citation in articleCrossrefGoogle Scholar

  • Keogh, E., Rosser, B. A. & Eccleston, C. (2010). eHealth and chronic pain management: Current status and developments. Pain, 151, 18–21. https://doi.org/10.2217/pmt.12.70 First citation in articleCrossrefGoogle Scholar

  • Konow, J. (2000). Fair shares: Accountability and cognitive dissonance in allocation decisions. The American Economic Review, 90, 1072–1091. https://doi.org/10.1257/aer.90.4.1072 First citation in articleCrossrefGoogle Scholar

  • Koocher, G. P. & Keith-Spiegel, P. (1998). Ethics in psychology: Professional standards and cases (2nd ed.). New York, NY: Oxford University Press. First citation in articleGoogle Scholar

  • Kravitz, R. L., Bell, R. A., Azari, R., Krupat, E., Kelly-Reif, S. & Thom, D. (2002). Request fulfillment in office practice: Antecedents and relationship to outcomes. Medical Care, 40, 38–51. First citation in articleCrossrefGoogle Scholar

  • Kuijpers, W., Groen, W. G., Aaronson, N. K. & Harten, W. V. (2013). A systematic review of web-based interventions for patient empowerment and physical activity in chronic diseases: Relevance for cancer survivors. Journal of Medical Internet Research, 15, e37. https://doi.org/10.2196/jmir.2281 First citation in articleCrossrefGoogle Scholar

  • Lange, A., Van De Ven, J. P. & Schrieken, B. (2003). Interapy: Treatment of post-traumatic stress via the Internet. Cognitive Behaviour Therapy, 32, 110–124. https://doi.org/10.1080/16506070302317 First citation in articleCrossrefGoogle Scholar

  • Lerner, J. S. & Tetlock, P. E. (1999). Accounting for the effects of accountability. Psychological Bulletin, 125, 255–275. https://doi.org/10.1037/0033-2909.125.2.255 First citation in articleCrossrefGoogle Scholar

  • Leslie, E., Marshall, A. L., Owen, N. & Bauman, A. (2005). Engagement and retention of participants in a physical activity website. Preventive Medicine, 40, 54–59. https://doi.org/10.1016/j.ypmed.2004.05.002 First citation in articleCrossrefGoogle Scholar

  • Long, A. C. & Palermo, T. M. (2009). Brief report: Web-based management of adolescent chronic pain: Development and usability testing of an online family cognitive behavioral therapy program. Journal of Pediatric Psychology, 34, 511–516. https://doi.org/10.1093/jpepsy/jsn082 First citation in articleCrossrefGoogle Scholar

  • Liu, S., Hodgson, C., Zbib, A. M., Payne, A. Y. & Nolan, R. P. (2014). The effectiveness of loyalty rewards to promote the use of an Internet-based heart health program. Journal of Medical Internet Research, 16, e163. https://doi.org/10.2196/jmir.3458 First citation in articleCrossrefGoogle Scholar

  • Lorig, K. R., Laurent, D. D., Deyo, R. A., Marnell, M. E., Minor, M. A. & Ritter, P. L. (2002). Can a Back Pain E-mail Discussion Group improve health status and lower health care costs? A randomized study. Archives of Internal Medicine, 162, 792–796. https://doi.org/10.1001/archinte.162.7.792 First citation in articleCrossrefGoogle Scholar

  • Lorig, K. R., Ritter, P. L., Laurent, D. D. & Plant, K. (2006). Internet-based chronic disease self-management: A randomized trial. Medical Care, 44, 964–971. https://doi.org/10.1097/01.mlr.0000233678.80203.c1 First citation in articleCrossrefGoogle Scholar

  • Macea, D. D., Gajos, K., Calil, Y. A. D. & Fregni, F. (2010). The efficacy of web-based cognitive behavioral interventions for chronic pain: A systematic review and meta-analysis. The Journal of Pain, 11, 917–929. https://doi.org/10.1016/j.jpain.2010.06.005 First citation in articleCrossrefGoogle Scholar

  • Manwaring, J. L., Bryson, S. W., Goldschmidt, A. B., Winzelberg, A. J., Luce, K. H., Cunning, D., … Taylor, C. B. (2008). Do adherence variables predict outcome in an online program for the prevention of eating disorders? Journal of Consulting and Clinical Psychology, 76, 341–346. https://doi.org/10.1037/0022-006X.76.2.341 First citation in articleCrossrefGoogle Scholar

  • McGeary, D. D., McGeary, C. A. & Gatchel, R. J. (2012). A comprehensive review of telehealth for pain management: Where we are and the way ahead. Pain Practice, 12, 570–577. https://doi.org/10.1111/j.1533-2500.2012.00534.x First citation in articleCrossrefGoogle Scholar

  • Melville, K. M., Casey, L. M. & Kavanagh, D. J. (2010). Dropout from Internet‐based treatment for psychological disorders. British Journal of Clinical Psychology, 49, 455–471. https://doi.org/10.1348/014466509X472138 First citation in articleCrossrefGoogle Scholar

  • Michie, S., Richardson, M., Johnston, M., Abraham, C., Francis, J., Hardeman, W., … Wood, C. E. (2013). The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: Building an international consensus for the reporting of behavior change interventions. Annals of Behavioral Medicine, 46, 81–95. https://doi.org/10.1007/s12160-013-9486-6 First citation in articleCrossrefGoogle Scholar

  • Michie, S., Yardley, L., West, R., Patrick, K. & Greaves, F. (2017). Developing and evaluating digital interventions to promote behavior change in health and health care: Recommendations resulting from an international workshop. Journal of Medical Internet Research, 19, e232. https://doi.org/10.2196/jmir.7126 First citation in articleCrossrefGoogle Scholar

  • Mohl, P. C., Martinez, D., Ticknor, C., Huang, M. & Cordell, L. (1991). Early dropouts from psychotherapy. The Journal of Nervous and Mental Disease, 179, 478–481. https://doi.org/10.1097/00005053-199108000-00005 First citation in articleCrossrefGoogle Scholar

  • Mohr, D., Cuijpers, P. & Lehman, K. (2011). Supportive accountability: A model for providing human support to enhance adherence to eHealth interventions. Journal of Medical Internet Research, 13, e30. https://doi.org/10.2196/jmir.1602 First citation in articleCrossrefGoogle Scholar

  • Morrison, L. G. (2015). Theory-based strategies for enhancing the impact and usage of digital health behaviour change interventions: A review. Digital Health, 1, 2055207615595335. https://doi.org/10.1177/2055207615595335 First citation in articleCrossrefGoogle Scholar

  • Neff, R. & Fry, J. (2009). Periodic prompts and reminders in health promotion and health behavior interventions: Systematic review. Journal of Medical Internet Research, 11, e16. https://doi.org/10.2196/jmir.1138 First citation in articleCrossrefGoogle Scholar

  • O’Connor, S., Hanlon, P., O’Donnell, C. A., Garcia, S., Glanville, J. & Mair, F. S. (2016). Understanding factors affecting patient and public engagement and recruitment to digital health interventions: A systematic review of qualitative studies. BMC Medical Informatics and Decision Making, 16, 120. https://doi.org/10.1186/s12911-016-0359-3 First citation in articleCrossrefGoogle Scholar

  • Oinas-Kukkonen, H. (2013). A foundation for the study of behavior change support systems. Personal and Ubiquitous Computing, 17, 1223–1235. https://doi.org/10.1007/s00779-012-0591-5 First citation in articleCrossrefGoogle Scholar

  • Oinas-Kukkonen, H. & Harjumaa, M. (2009). Persuasive systems design: Key issues, process model, and system features. Communications of the Association for Information Systems, 24, 28. Retrieved from http://aisel.aisnet.org/cais/vol24/iss1/28 First citation in articleCrossrefGoogle Scholar

  • Palmqvist, B., Carlbring, P. & Andersson, G. (2007). Internet-delivered treatments with or without therapist input: Does the therapist factor have implications for efficacy and cost? Expert Review of Pharmacoeconomics & Outcomes Research, 7, 291–297. https://doi.org/10.1586/14737167.7.3.291 First citation in articleCrossrefGoogle Scholar

  • Perski, O., Blandford, A., West, R. & Michie, S. (2017). Conceptualising engagement with digital behaviour change interventions: A systematic review using principles from critical interpretive synthesis. Translational Behavioral Medicine, 7, 254–267. https://doi.org/10.1007/s1314 First citation in articleCrossrefGoogle Scholar

  • Proudfoot, J. G., Parker, G. B., Pavlovic, D. H., Manicavasagar, V., Adler, E. & Whitton, A. E. (2010). Community attitudes to the appropriation of mobile phones for monitoring and managing depression, anxiety, and stress. Journal of Medical Internet Research, 12, e64. https://doi.org/10.2196/jmir.1475 First citation in articleCrossrefGoogle Scholar

  • Reeves, B. & Read, J. L. (2009). Total engagement. Using Games and Virtual Worlds to change the way people work and businesses compete. Computers in Human Behavior, 26, 1276–1277. First citation in articleGoogle Scholar

  • Reid, M. C., Eccleston, C. & Pillemer, K. (2015). Management of chronic pain in older adults. British Medical Journal, 350, 1–10. https://doi.org/10.1136/bmj.h532 First citation in articleCrossrefGoogle Scholar

  • Reynolds, G. S. (1968). A primer of operant conditioning. Glenview, IL: Scott Foresman. First citation in articleGoogle Scholar

  • Sabaté, E. (2003). Adherence to long-term therapies: Evidence for action. Geneva, Switzerland: World Health Organization. https://doi.org/10.1016/S1474-5151(03)00091-4 First citation in articleGoogle Scholar

  • Savvides, S. N. & Karekla, M. (2015). Evaluating an acceptance and commitment therapy Internet-based intervention for smoking cessation in young adults. European Health Psychologist, 17(S), 415. First citation in articleGoogle Scholar

  • Schueller, S. M., Tomasino, K. N. & Mohr, D. C. (2016). Integrating human support into behavioral intervention technologies: The efficiency model of support. Clinical Psychology: Science and Practice, 24, 27–45. https://doi.org/10.1111/cpsp.12173 First citation in articleCrossrefGoogle Scholar

  • Shapiro, D. A., Cavanagh, K. & Lomas, H. (2003). Geographic inequity in the availability of cognitive behavioural therapy in England and Wales. Behavioural and Cognitive Psychotherapy, 31, 185–192. https://doi.org/10.1017/S1352465803002066 First citation in articleCrossrefGoogle Scholar

  • Society of Clinical Psychology, Division 12 of the American Psychological Association. (2011, March 21). Research-supported psychological therapies. Retrieved from http://www.div12.org/PsychologicalTreatments/treatments/chronicpain_act.html First citation in articleGoogle Scholar

  • Sonderegger, A. & Sauer, J. (2010). The influence of design aesthetics in usability testing: Effects on user performance and perceived usability. Applied Ergonomics, 41, 403–410. https://doi.org/10.1016/j.apergo.2009.09.002 First citation in articleCrossrefGoogle Scholar

  • Sprangers, M. A., de Regt, E. B., Andries, F., van Agt, H. M., Bijl, R. V., de Boer, J. B., … Miedema, H. S. (2000). Which chronic conditions are associated with better or poorer quality of life? Journal of Clinical Epidemiology, 53, 895–907. https://doi.org/10.1016/S0895-4356(00)00204-3 First citation in articleCrossrefGoogle Scholar

  • Titov, N., Dear, B. F., Johnston, L., Lorian, C., Zou, J., Wootton, B., … Rapee, R. M. (2013). Improving adherence and clinical outcomes in self-guided Internet treatment for anxiety and depression: Randomised controlled trial. PLoS One, 8, e62873. https://doi.org/10.1371/journal.pone.0062873 First citation in articleCrossrefGoogle Scholar

  • Trompetter, H. R., Bohlmeijer, E. T., Veehof, M. M. & Schreurs, K. M. (2015). Internet-based guided self-help intervention for chronic pain based on Acceptance and Commitment Therapy: A randomized controlled trial. Journal of Behavioral Medicine, 38, 66–80. https://doi.org/10.1007/s10865-014-9579-0 First citation in articleCrossrefGoogle Scholar

  • van Ballegooijen, W., Cuijpers, P., van Straten, A., Karyotaki, E., Andersson, G., Smit, J. H. & Riper, H. (2014). Adherence to Internet-based and face-to-face cognitive behavioural therapy for depression: A meta-analysis. PLoS One, 9, e100674. https://doi.org/10.1371/journal.pone.0100674 First citation in articleCrossrefGoogle Scholar

  • van Gemert-Pijnen, J. E., Nijland, N., van Limburg, M., Ossebaard, H. C., Kelders, S. M., Eysenbach, G. & Seydel, E. R. (2011). A holistic framework to improve the uptake and impact of eHealth technologies. Journal of Medical Internet Research, 13, e111. https://doi.org/10.2196/jmir.1672 First citation in articleCrossrefGoogle Scholar

  • Velleman, S., Stallard, P. & Richardson, T. (2010). A review and meta‐analysis of computerized cognitive behaviour therapy for the treatment of pain in children and adolescents. Child: Care, Health and Development, 36, 465–472. https://doi.org/10.1111/j.1365-2214.2010.01088.x First citation in articleCrossrefGoogle Scholar

  • Voils, C. I., King, H. A., Maciejewski, M. L., Allen, K. D., Yancy, W. S. & Shaffer, J. A. (2014). Approaches for informing optimal dose of behavioral interventions. Annals of Behavioral Medicine, 48, 392–401. https://doi.org/10.1007/s12160-014-9618-7 First citation in articleCrossrefGoogle Scholar

  • Wang, J., Sereika, S. M., Chasens, E. R., Ewing, L. J., Matthews, J. T. & Burke, L. E. (2012). Effect of adherence to self-monitoring of diet and physical activity on weight loss in a technology-supported behavioral intervention. Patient Preference and Adherence, 6, 221–226. https://doi.org/10.2147/PPA.S28889 First citation in articleCrossrefGoogle Scholar

  • Wangberg, S. C., Bergmo, T. S. & Johnsen, J. A. (2008). Adherence in Internet-based interventions. Patient Preference and Adherence, 2, 57–65. First citation in articleGoogle Scholar

  • Webb, T., Joseph, J., Yardley, L. & Michie, S. (2010). Using the Internet to promote health behavior change: A systematic review and meta-analysis of the impact of theoretical basis, use of behavior change techniques, and mode of delivery on efficacy. Journal of Medical Internet Research, 12, e4. https://doi.org/10.2196/jmir.1376 First citation in articleCrossrefGoogle Scholar

  • Yardley, L., Spring, B. J., Riper, H., Morrison, L. G., Crane, D. H., Curtis, K., … Blandford, A. (2016). Understanding and promoting effective engagement with digital behavior change interventions. American Journal of Preventive Medicine, 51, 833–842. https://doi.org/10.1016/j.amepre.2016.06.015 First citation in articleCrossrefGoogle Scholar

  • Zarski, A. C., Lehr, D., Berking, M., Riper, H., Cuijpers, P. & Ebert, D. D. (2016). Adherence to Internet-based mobile-supported stress management: A pooled analysis of individual participant data from three randomized controlled trials. Journal of Medical Internet Research, 18, e146. https://doi.org/10.2196/jmir.4493 First citation in articleCrossrefGoogle Scholar