Skip to main content
Multistudy Report

Detecting Feigned Cognitive Impairment With Schretlen’s Malingering Scale Vocabulary and Abstraction Test

Published Online:https://doi.org/10.1027/1015-5759/a000438

Abstract. Schretlen’s Malingering Scale Vocabulary and Abstraction test (MSVA) differs from the majority of performance validity tests in that it focuses on the detection of feigned impairments in semantic knowledge and perceptual reasoning rather than feigned memory problems. We administered the MSVA to children (n = 41), forensic inpatients with intellectual disability (n = 25), forensic inpatients with psychiatric symptoms (n = 57), and three groups of undergraduate students (n = 30, n = 79, and n = 90, respectively), asking approximately half of each of these samples to feign impairment and the other half to respond genuinely. With cutpoints chosen so as to keep false-positive rates below 10%, detection rates of experimentally feigned cognitive impairment were high in children (90%) and inpatients with intellectual disability (100%), but low in adults without intellectual disability (46%). The rates of significantly below-chance performance were low (4%), except in children (47%) and intellectually disabled inpatients (50%). The reliability of the MSVA was excellent (Cronbach’s α = .93–.97) and the MSVA proved robust against coaching (i.e., informed attempts to evade detection while feigning). We conclude that the MSVA is not ready yet for clinical use, but that it shows sufficient promise to warrant further validation efforts.

References

  • American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Arlington, VA: American Psychiatric Publishing. First citation in articleCrossrefGoogle Scholar

  • Binder, L. M. (2002). The Portland Digit Recognition Test: A review of validation data and clinical use. Journal of Forensic Neuropsychology, 2, 27–41. https://doi.org/10.1300/J151v02n03_02 First citation in articleCrossrefGoogle Scholar

  • Binder, L. M., Larrabee, G. J. & Millis, S. R. (2014). Intent to fail: Significance testing of forced choice test results. The Clinical Neuropsychologist, 28, 1366–1375. https://doi.org/10.1080/13854046.2014.978383 First citation in articleCrossrefGoogle Scholar

  • Boone, K. B. (2007). A reconsideration of the Slick et al. (1999) criteria for malingered neurocognitive dysfunction. In K. B. BooneEd., Assessment of feigned cognitive impairment: A neuropsychological perspective (pp. 29–49). New York, NY: Guilford Press. First citation in articleGoogle Scholar

  • Boone, K. B. (2009). The need for continuous and comprehensive sampling of effort/response bias during neuropsychological examinations. The Clinical Neuropsychologist, 23, 729–741. https://doi.org/10.1080/13854040802427803 First citation in articleCrossrefGoogle Scholar

  • Brooks, B. L., Ploetz, D. M. & Kirkwood, M. W. (2016). A survey of neuropsychologists’ use of validity tests with children and adolescents. Child Neuropsychology, 22, 1001–1020. https://doi.org/10.1080/09297049.2015.1075491 First citation in articleCrossrefGoogle Scholar

  • Clegg, C., Fremouw, W. & Mogge, N. (2009). Utility of the Structured Inventory of Malingered Symptomatology (SIMS) and the Assessment of Depression Inventory (ADI) in screening for malingering among outpatients seeking to claim disability. Journal of Forensic Psychiatry & Psychology, 20, 239–254. https://doi.org/10.1080/14789940802267760 First citation in articleCrossrefGoogle Scholar

  • Dandachi-FitzGerald, B. & Merckelbach, H. (2013). Feigning ≠ feigning a memory deficit: The Medical Symptom Validity Test as an example. Journal of Experimental Psychopathology, 4, 46–63. https://doi.org/10.5127/jep.025511 First citation in articleCrossrefGoogle Scholar

  • Frederick, R. I. & Speed, F. M. (2007). On the interpretation of below-chance responding in forced choice tests. Assessment, 14, 3–11. https://doi.org/10.1177/1073191106292009 First citation in articleCrossrefGoogle Scholar

  • Green, P. (2004). Manual for the Medical Symptom Validity Test. Edmonton, Alberta, Canada: Green’s Publishing. First citation in articleGoogle Scholar

  • Greve, K. W., Bianchini, K. J. & Doane, B. M. (2006). Classification accuracy of the Test of Memory Malingering in traumatic brain injury: Results of a known-groups analysis. Journal of Clinical and Experimental Neuropsychology, 28, 1176–1190. https://doi.org/10.1080/13803390500263550 First citation in articleCrossrefGoogle Scholar

  • Greve, K. W., Binder, L. M. & Bianchini, K. J. (2009). Rates of below-chance performance in forced-choice symptom validity tests. The Clinical Neuropsychologist, 23, 534–544. https://doi.org/10.1080/13854040802232690 First citation in articleCrossrefGoogle Scholar

  • Heilbronner, R. L., Sweet, J. J., Morgan, J. E., Larrabee, G. J., & Millis, S. R., Conference Participants. (2009). American Academy of Clinical Neuropsychology Consensus Conference Statement on the neuropsychological assessment of effort, response bias, and malingering. The Clinical Neuropsychologist, 23, 1093–1129. https://doi.org/10.1080/13854040903155063 First citation in articleCrossrefGoogle Scholar

  • Jelicic, M., Ceunen, E., Peters, M. J. V. & Merckelbach, H. (2011). Detecting coached feigning using the Test of Memory Malingering (TOMM) and the Structured Inventory of Malingered Symptomatology (SIMS). Journal of Clinical Psychology, 67, 850–855. https://doi.org/10.1002/jclp.20805 First citation in articleCrossrefGoogle Scholar

  • Kirkwood, M. W., Yeates, K. O., Randolph, C. & Kirk, J. W. (2012). The implications of symptom validity test failure for ability-based test performance in a pediatric sample. Psychological Assessment, 24, 36. https://doi.org/10.1037/a0024628 First citation in articleCrossrefGoogle Scholar

  • Larrabee, G. J. (2012). Performance validity and symptom validity in neuropsychological assessment. Journal of the International Neuropsychological Society, 18, 625–631. https://doi.org/10.1017/s1355617712000240 First citation in articleCrossrefGoogle Scholar

  • Martin, P. K., Schroeder, R. W. & Odland, A. P. (2015). Neuropsychologists’ validity testing beliefs and practices: A survey of North American professionals. The Clinical Neuropsychologist, 29, 1–36. https://doi.org/10.1080/13854046.2015.1087597 First citation in articleCrossrefGoogle Scholar

  • Merckelbach, H. & Collaris, J. (2012). Mother Theresa doesn’t help here: Lack of moral priming effects on malingered symptom reports and what we can learn from it. Psychologica Belgica, 52, 201–215. https://doi.org/10.5334/pb-52-2-3-271 First citation in articleCrossrefGoogle Scholar

  • Merckelbach, H., Smeets, T. & Jelicic, M. (2009). Experimental simulation: Type of malingering scenario makes a difference. The Journal of Forensic Psychiatry & Psychology, 20, 378–386. https://doi.org/10.1080/14789940802456686 First citation in articleCrossrefGoogle Scholar

  • Merten, T. & Merckelbach, H. (2013). Forced-choice tests as single-case experiments in the differential diagnosis of intentional symptom distortion. Journal of Experimental Psychopathology, 4, 1–21. https://doi.org/10.5127/jep.023711 First citation in articleCrossrefGoogle Scholar

  • Powell, M. R., Gfeller, J. D., Hendricks, B. L. & Sharland, M. (2004). Detecting symptom- and test-coached simulators with the Test of Memory Malingering. Archives of Clinical Neuropsychology, 19, 693–702. https://doi.org/10.1016/j.acn.2004.04.001 First citation in articleCrossrefGoogle Scholar

  • Reynolds, C. R. & Horton, A. M. Jr. (2012). Clinical acumen, common sense, and data-based decision making in the assessment of dissimulation during head injury litigation. In C. R. ReynoldsA. M. Horton Jr.Eds., Detection of malingering during head injury litigation (pp. 351–370). New York, NY: Springer. First citation in articleGoogle Scholar

  • Rienstra, A., Spaan, P. E. J. & Schmand, B. (2010). Validation of symptom validity tests using a “child model” of adult cognitive impairments. Archives of Clinical Neuropsychology, 25, 371–382. https://doi.org/10.1093/arclin/acq035 First citation in articleCrossrefGoogle Scholar

  • Rogers, R. (2008a). An introduction to response styles. In R. RogersEd., Clinical assessment of malingering and deception (3rd ed., pp. 3–13). New York, NY: Guilford Press. First citation in articleGoogle Scholar

  • Rogers, R. (2008b). Detection strategies for malingering and defensiveness. In R. Rogers (Ed.), Clinical assessment of malingering and deception (3rd ed., pp. 14–35). New York, NY: Guilford Press. First citation in articleGoogle Scholar

  • Schagen, S., Schmand, B., de Sterke, S. & Lindeboom, J. (1997). Amsterdam Short-Term Memory test: A new procedure for the detection of feigned memory deficits. Journal of Clinical and Experimental Neuropsychology, 19, 43–51. https://doi.org/10.1080/01688639708403835 First citation in articleCrossrefGoogle Scholar

  • Schmand, B. & Lindeboom, J. (2005). Amsterdam Short-Term Memory test manual. Leiden, The Netherlands: PITS. First citation in articleGoogle Scholar

  • Schretlen, D. (1986). Malingering: Use of a psychological test battery to detect two kinds of simulation. Ann Arbor, MI: University Microfilms International. First citation in articleGoogle Scholar

  • Schretlen, D. & Arkowitz, H. (1990). A psychological test battery to detect prison inmates who fake insanity or mental retardation. Behavioral Sciences and the Law, 8, 75–84. https://doi.org/10.1002/bsl.2370080109 First citation in articleCrossrefGoogle Scholar

  • Schretlen, D., Neal, J. & Lesikar, S. (2000). Screening for malingered mental illness in a court clinic. American Journal of Forensic Psychology, 18, 5–16. First citation in articleGoogle Scholar

  • Schretlen, D., Wilkins, S. S., Van Gorp, W. G. & Bobholz, J. H. (1992). Cross-validation of a psychological test battery to detect faked insanity. Psychological Assessment, 4, 77–83. https://doi.org/10.1037//1040-3590.4.1.77 First citation in articleCrossrefGoogle Scholar

  • Schroeder, R. W., Buddin, W. H. Jr., Hargrave, D. D., VonDran, E. J., Campbell, E. B., Brockman, C. J., … Baade, L. E. (2013). Efficacy of Test of Memory Malingering Trial 1, Trial 2, the Retention Trial, and the Albany Consistency Index in a criterion group forensic neuropsychological sample. Archives of Clinical Neuropsychology, 28, 21–29. https://doi.org/10.1093/arclin/acs094 First citation in articleCrossrefGoogle Scholar

  • Smith, G. P. & Burger, G. K. (1997). Detection of malingering: Validation of the Structured Inventory of Malingered Symptomatology (SIMS). Journal of the Academy of Psychiatry and the Law, 25, 180–183. https://doi.org/10.1037/t04573-000 First citation in articleGoogle Scholar

  • Suhr, J. A. & Gunstad, J. (2000). The effects of coaching on the sensitivity and specificity of malingering measures. Archives of Clinical Neuropsychology, 15, 415–424. https://doi.org/10.1093/arclin/15.5.415 First citation in articleCrossrefGoogle Scholar

  • Swets, J. A. (1988). Measuring the accuracy of diagnostic systems. Science, 240, 1285–1293. https://doi.org/10.1126/science.3287615 First citation in articleCrossrefGoogle Scholar

  • Tombaugh, T. N. (1996). Test of Memory Malingering. Toronto, Ontario, Canada: Multi-Health Systems. First citation in articleGoogle Scholar

  • Van Dyke, S. A., Millis, S. R., Axelrod, B. N. & Hanks, R. A. (2013). Assessing effort: Differentiating performance and symptom validity. The Clinical Neuropsychologist, 27, 1234–1246. https://doi.org/10.1080/13854046.2013.835447 First citation in articleCrossrefGoogle Scholar

  • van Impelen, A., Merckelbach, H., Jelicic, M. & Merten, T. (2014). The Structured Inventory of Malingered Symptomatology (SIMS): A systematic review and meta-analysis. The Clinical Neuropsychologist, 28, 1336–1365. https://doi.org/10.1080/13854046.2014.984763 First citation in articleCrossrefGoogle Scholar

  • Victor, T. L. & Boone, K. B. (2007). Identification of feigned mental retardation. In K. B. BooneEd., Assessment of feigned cognitive impairment (pp. 310–345). New York, NY: Guilford Press. First citation in articleGoogle Scholar

  • Wechsler, D. (2008). Wechsler Adult Intelligence Scale – Fourth Edition. San Antonio, TX: Pearson. First citation in articleGoogle Scholar