Skip to main content
Research Trends

Evaluation of the Safety and Design of Community Internet Resources for Veteran Suicide Prevention

Published Online:https://doi.org/10.1027/0227-5910/a000590

Abstract.Background: Recent data show many veterans who die by suicide are not currently engaged in mental health care. Veterans frequently use the Internet for health information and may look online for community resources when in distress. However, little is known about their design characteristics. Aim: To evaluate the design and content of community, veteran suicide prevention websites. Method: Community websites focused on veteran suicide prevention were gathered through Internet searches using standardized search terms. Websites that met the inclusion criteria (n = 9) were evaluated for adherence to suicide safe messaging, usability, readability, and credibility heuristics. Interrater reliability was evaluated using kappa statistics. Descriptive statistics were used to describe website features. Results: Community websites tended to provide help-seeking information, safe messaging, and community activities. However, no websites provided information on lethal means safety or references to signal credibility. Limitations: The sample was small and only included English-language websites, and focused on veteran-oriented, community websites. Conclusion: Community suicide prevention websites focused on veterans could be improved through increased readability, credibility, and provision of lethal means safety information.

References

  • Ayers, J. W., Althouse, B. M., Leas, E. C., Dredze, M., & Allem, J. (2017). Internet searches for suicide following the release of 13 Reasons Why. JAMA Internal Medicine, 177(10), 1527–1529. 10.1001/jamainternmed.2017.3333 First citation in articleCrossref MedlineGoogle Scholar

  • Bell, J., Bailey, L., & Kennedy, D. (2015). 'We do it to keep him alive': Bereaved individuals' experiences of online suicide memorials and continuing bonds. Mortality, 20(4), 375–389. 10.1080/13576275.2015.1083693 First citation in articleCrossref MedlineGoogle Scholar

  • Bohanna, I., & Wang, X. (2012). Media guidelines for the responsible reporting of suicide: A review of effectiveness. Crisis, 33(4), 190–198. 10.1027/0227-5910/a000137 First citation in articleLinkGoogle Scholar

  • Capó-Aponte, J. E., Urosevich, T. G., Temme, L. A., Tarbett, A. K., & Sanghera, N. K. (2012). Visual dysfunctions and symptoms during the subacute stage of blast-induced mild traumatic brain injury. Military Medicine, 177(7), 804–813. 10.7205/MILMED-D-12-00061 First citation in articleCrossref MedlineGoogle Scholar

  • Chiu, T. M., & Eysenbach, G. (2010). Stages of use: Consideration, initiation, utilization, and outcomes of an internet-mediated intervention. BMC Medical Informatics and Decision Making, 10(1), 73. 10.1186/1472-6947-10-73 First citation in articleCrossref MedlineGoogle Scholar

  • Clement, S., Schauman, O., Graham, T., Maggioni, F., Evans-Lacko, S., Bezborodovs, N., … Thornicroft, G. (2014). What is the impact of mental health-related stigma on help-seeking? A systematic review of quantitative and qualitative studies. Psychological Medicine, 45(1), 11–27. 10.1017/S00​33291714000129 First citation in articleCrossref MedlineGoogle Scholar

  • Cohen, J. (1968). Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit. Psychological Bulletin, 70(4), 213–220. 10.1037/h0026256 First citation in articleCrossref MedlineGoogle Scholar

  • Crutzen, R., Roosjen, J. L., & Poelman, J. (2013). Using Google Analytics as a process evaluation method for Internet-delivered intervention: An example on sexual health. Health Promotion International, 28(1), 36–42. 10.1093/heapro/das008 First citation in articleCrossref MedlineGoogle Scholar

  • Fleming, C. J. E., Crawford, E. F., Calhoun, P. S., Kudler, H., & Straits-Troster, K. A. (2016). Veterans' preferences for receiving information about VA services: Is getting the information you want related to increased healthcare utilization? Military Medicine, 181(2), 106–110. 10.7205/MILMED-D-14-00685 First citation in articleCrossref MedlineGoogle Scholar

  • Freeman, K. S., & Spyridakis, J. H. (2004). An examination of factors that affect the credibility of online health information. Technical Communication, 51(2), 239–263. First citation in articleGoogle Scholar

  • Frost, M., Casey, L., & Rando, N. (2015). Self-injury, help-seeking, and the Internet. Crisis, 37(1), 68–76. 10.1027/0227-5910/a000346 First citation in articleLinkGoogle Scholar

  • Gould, M., Jamieson, P., & Romer, D. (2003). Media contagion and suicide among the zoung. American Behavioral Scientist, 46(9), 1269–1284. 10.1177/0002764202250670 First citation in articleCrossrefGoogle Scholar

  • Gralton, E., Sher, M., & Lopez, C. D. (2010). Information and readability issues for psychiatric patients: E-learning for users. The Psychiatrist, 34(9), 376–380. 10.1192/pb.​bp.109.027102 First citation in articleCrossrefGoogle Scholar

  • Hersher, R. (Writer). (2017, March 30). "The VA is on a path toward recovery, Secretary of Veterans Affairs says" [Radio]. In Morning Edition. National Public Radio. First citation in articleGoogle Scholar

  • Ivanitskaya, L., O'Boyle, I., & Casey, A. M. (2006). Health information literacy and competencies of information age students: Results from the Interactive Online Research Readiness Self-Assessment (RRSA). (Writer)Journal of Medical Internet Research, 8(2), e6. 10.2196/jmir.8.2.e6 First citation in articleCrossrefGoogle Scholar

  • Kincaid, J. P., Fishburne, R. P., Jr., Rogers, R. L., & Chissom, B. S. (1975). Derivation of new readability formulas (automated readability index, fog count and flesch reading ease formula) for navy enlisted personnel. Retrieved from http://www.dtic.mil/docs/citations/ADA006655 First citation in articleGoogle Scholar

  • Knoepke, C. E., Allen, A., Ranney, M. L., Wintemute, G. J., Matlock, D. D., & Betz, M. E. (2017). Loaded questions: Internet commenters' opinions on physician–patient firearm safety conversations. Western Journal of Emergency Medicine, 18(5), 903–912. 10.5811/westjem.2017.6.34849 First citation in articleCrossref MedlineGoogle Scholar

  • Loranger, H. (2017). Plain language is for everyone, even experts. Writing for the web. Retrieved from https://www.nngroup.com/articles/plain-language-experts/ First citation in articleGoogle Scholar

  • McClellan, C., Ali, M. M., Mutter, R., Kroutil, L., & Landwehr, J. (2017). Using social media to monitor mental health discussions: Evidence from Twitter. Journal of the American Medical Informatics Association, 24(3), 496–502. First citation in articleMedlineGoogle Scholar

  • Miller, R., Weaver, L. K., Bahraini, N., Churchill, S., Price, R. C., Skiba, V., … Brenner, L. A. (2015). Effects of hyperbaric oxygen on symptoms and quality of life among service members with persistent postconcussion symptoms: A randomized clinical trial. JAMA Internal Medicine, 175(1), 43–52. 10.1001/jamainternmed.2014.5479 First citation in articleCrossref MedlineGoogle Scholar

  • National Action Alliance for Suicide Prevention: Research Prioritization Task Force. (2014). A prioritized research agenda for suicide prevention: An action plan to save lives. Rockville, MD: National Institute of Mental Health and the Research Prioritization Task Force. First citation in articleGoogle Scholar

  • Nelson, H. D., Denneson, L. M., Low, A. R., Bauer, B. W., O'Neil, M., Kansagara, D., & Teo, A. R. (2017). Suicide risk assessment and prevention: A systematic review focusing on veterans. Psychiatric Services, 68(10), 1003–1015. 10.1176/appi.ps.201600384 First citation in articleCrossref MedlineGoogle Scholar

  • Niederkrotenthaler, T., Haider, A., Till, B., Mok, K., & Pirkis, J. (2016). Comparison of suicidal people who use the Internet for suicide-related reasons and those who do not. Crisis, 38(2), 131–135. 10.1027/0227-5910/a000432 First citation in articleLinkGoogle Scholar

  • Nielsen, J. (1994a, April). Enhancing the explanatory power of usability heuristics. Paper presented at the Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Boston, Massachusetts, USA. First citation in articleGoogle Scholar

  • Office of Mental Health & Suicide Prevention. (2016). Suicide among veterans and other Americans, 2001–2014. Retrieved from http://www.mentalhealth.va.gov/docs/2016suicidedatareport.pdf First citation in articleGoogle Scholar

  • Pleasant, A. (2014). Advancing health literacy measurement: A pathway to better health and health system performance. Journal of Health Communication, 19(12), 1481–1496. 10.1080/10810730.2014.954083 First citation in articleCrossref MedlineGoogle Scholar

  • Resnik, L. J., & Allen, S. M. (2007). Using International Classification of Functioning, Disability and Health to understand challenges in community reintegration of injured veterans. Journal of Rehabilitation Research & Development, 44(7), 991–1005. First citation in articleCrossref MedlineGoogle Scholar

  • Rodríguez, V., Andrade, A. D., García-Retamero, R., Anam, R., Rodríguez, R., Lisigurski, M., … Ruiz, J. G. (2013). Health literacy, numeracy, and graphical literacy among veterans in primary care and their effect on shared decision making and trust in physicians. Journal of Health Communication, 18(Suppl.), 273–289. 10.1080/10810730.2013.829137 First citation in articleCrossref MedlineGoogle Scholar

  • Sayer, N. A., Noorbaloochi, S., Frazier, P., Carlson, K., Gravely, A., & Murdoch, M. (2010). Reintegration problems and treatment interests among Iraq and Afghanistan combat veterans receiving VA medical care. Psychiatric Services, 61(6), 589–597. 10.1176/ps.2010.61.6.589 First citation in articleCrossref MedlineGoogle Scholar

  • Serpstat. (2018). Serpstat. Retrieved from https://serpstat.com First citation in articleGoogle Scholar

  • Singaravelu, V., Stewart, A., Adams, J., Simkin, S., & Hawton, K. (2015). Information-seeking on the Internet: An investigation of websites potentially accessed by distressed or suicidal adolescents. Crisis, 36(3), 211–219. 10.1027/0227-5910/a000307 First citation in articleLinkGoogle Scholar

  • The Plain Language Action and Information Network. (2017). Plain language makes it easier for the public to read, understand, and use government communications. Retrieved from https://plain​language.gov/ First citation in articleGoogle Scholar

  • Tools for Entertainment and Media [TEAM UP]. (2017). Social media guidelines for mental health promotion and suicide prevention. Retrieved from http://www.eiconline.org/teamup/wp-content/files/teamup-mental-health-social-media-guidelines.pdf First citation in articleGoogle Scholar

  • Trickett, E. J., Beehler, S., Deutsch, C., Green, L. W., Hawe, P., McLeroy, K., … Trimble, J. E. (2011). Advancing the science of community-level interventions. American Journal of Public Health, 101(8), 1410–1419. 10.2105/AJPH.2010.300113 First citation in articleCrossref MedlineGoogle Scholar

  • Tsai, J., & Rosenheck, R. A. (2012). Use of the Internet and an online personal health record system by US veterans: Comparison of Veterans Affairs mental health service users and other veterans nationally. Journal of the American Medical Informatics Association, 19(6), 1089–1094. 10.1136/amiajnl-​2012-000971 First citation in articleCrossref MedlineGoogle Scholar

  • Whealin, J. M., Seibert-Hatalsky, L. A., Howell, J. W., & Tsai, J. (2015). E-mental health preferences of Veterans with and without probable posttraumatic stress disorder. Journal of Rehabilitation Research and Development, 52(6), 725–738. 10.1682/jrrd.2014.04.0113 First citation in articleCrossref MedlineGoogle Scholar

  • Witt, K., Spittal, M. J., Carter, G., Pirkis, J., Hetrick, S., Currier, D., … Milner, A. (2017). Effectiveness of online and mobile telephone applications ('apps') for the self-management of suicidal ideation and self-harm: A systematic review and meta-analysis. BMC Psychiatry, 17, 297. 10.1186/s12888-017-1458-0 First citation in articleCrossref MedlineGoogle Scholar

  • Yip, P. S. F., Caine, E., Yousuf, S., Chang, S.-S., Wu, K. C.-C., & Chen, Y.-Y. (2012). Means restriction for suicide prevention. Lancet, 379(9834), 2393–2399. 10.1016/S0140-6736(12)60521-2 First citation in articleCrossref MedlineGoogle Scholar