Validity Issues in Cognitive-Behavioral Case Formulation
Abstract
Despite considerable interest and growth in methods to develop or generate cognitive behavioral case formulations (CBCFs), relatively little conceptual and empirical work has focused on the validation or testing of these formulations. A case formulation can be regarded as an idiographic theory of the person and his or her life situation. This complex set of clinical judgments consists of a measurement model including the behavior problems or distress constructs and how they are measured; and a causal model involving variables such as thoughts or beliefs hypothesized to trigger and maintain this person’s distress or dysfunction. This article describes four types of validity issues in CBCF and how these validity issues can be evaluated using person-specific, intraindividual data collected daily or multiple times a day. Specific topics include the evaluation of content and construct (convergent and discriminant) validity for the measurement model, and the evaluation of predictive and treatment-related validity for the causal model. One goal of the person-specific evaluation of CBCF validity is to develop an intraindividual statistical prediction model that has the advantages of actuarial prediction yet is fine-grained and tailored to the specific issues and life circumstances of greatest relevance for a particular individual. Greater attention to evaluation of validity issues in CBCF is important for future research comparing formulation-based to manualized treatment. Implications and applications to clinical practice and training are discussed.
References
1962). The general and the unique in psychological science. Journal of Personality, 30, 405–422.
(1988). Structural equation modeling in practice: A review and recommended two-step approach. Psychological Bulletin, 3, 411–423.
(1981). Impediments to accurate clinical judgment and possible ways to minimize their impact. Journal of Consulting and Clinical Psychology, 49, 323–330.
(2009). A literature review exploring the efficacy of case formulations in clinical practice. What are the themes and pertinent issues? Cognitive Behavior Therapist, 2, 63–74.
(1995). Cognitive therapy: Basics and beyond. New York: Guilford.
(2003). Is cognitive case formulation science or science fiction? Clinical Psychology: Science and Practice, 10, 52–69.
(2006). Confirmatory factor analysis for applied research. New York: Guilford.
(2006). Clinical psychology: Construct validation with multiple sources of information and multiple settings. In , Handbook of multimethod measurement in psychology. Washington, DC: American Psychological Association.
(1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81–105.
(2003). Impact of case formulation in cognitive behavior therapy for psychosis. Behavior, Research and Therapy, 41, 671–680.
(1996). In defense of dissemination of empirically supported psychological interventions. Clinical Psychology: Science and Practice, 3, 230–235.
(1999). Scientific foundations of cognitive theory and therapy of depression. New York: Wiley.
(2010). Cognitive therapy of anxiety disorders: Science and practice. New York: Guilford.
(1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
(2003). Testing mediational models with longitudinal data: Questions and tips in the use of structural equation modeling. Journal of Abnormal Psychology, 112, 558.
(1979). Quasiexperimentation: Design & analysis issues for field settings. Chicago: Rand McNally.
(1988). The accuracy of therapists’ interpretations and the outcome of dynamic psychotherapy. Journal of Consulting and Clinical Psychology, 56, 490–495.
(1974). Linear models in decision making. Psychological Bulletin, 81, 95–106.
(2005). The quality of psychotherapy case formulations: A comparison of expert, experienced, and novice cognitive-behavioral and psychodynamic therapists. Journal of Consulting and Clinical Psychology, 73, 579–589.
(2006). Structural equation models for multitrait-multimethod data. In , Multimethod measurement in psychology (pp. 283–300). Washington, DC: American Psychological Association.
(1994). Individualized versus standardized therapy: A comparative evaluation with obsessive-compulsive patients. Clinical Psychology and Psychotherapy, 1, 95–100.
(2003). Modeling affective processes in dyadic relations via dynamic factor analysis. Emotion, 3, 344–360.
(1998). Studying the clinician: Judgment research and psychological assessment. Washington, DC: American Psychological Association.
(2006). Does individualization matter? A randomized trial of standardized (focused) versus individualized (broad) cognitive behavior therapy for bulimia nervosa. Behavior Research and Therapy, 44, 273–288.
(2000). Clinical versus mechanical prediction: A meta-analysis. Psychological Assessment, 12, 19–30.
(1992). Models of causality in psychopathology: Toward dynamic, synthetic, and nonlinear models of behavior disorders. New York: Macmillan.
(1999). The idiographic application of nomothetic, empirically based treatments. Clinical Psychology: Science and Practice, 6, 456–461.
(2003). Incremental validity of new clinical assessment measures. Psychological Assessment, 15, 456–466.
(2009). Idiographic assessment: Conceptual and psychometric foundations of individualized behavioral assessment. Clinical Psychology Review, 29, 179–191.
(1990). Functional analysis in behavior therapy. Clinical Psychology Review, 10, 649–668.
(2000). Principles and practice of behavioral assessment. New York: Plenum.
(2005). Refining functional behavioral assessment: Analyzing the separate and combined effects of hypothesized controlling variables during ongoing classroom routines. School Psychology Review, 34(1), 45–57.
(1994). Illustration of concomitant time series analyses in a case of somatoform disorder. Cognitive Therapy and Research, 18, 413–437.
(2007). Configurational analysis: States of mind, person schemas, and the control of ideas and affect. In , Handbook of psychotherapy case formulation (2nd ed., pp. 136–163). New York: Guilford.
(1994). The function of self-injurious behavior: An experimental-epidemiological analysis. Journal of Applied Behavior Analysis, 27, 215–240.
(1989). Research-structured vs. clinically flexible versions of social learning-based marital therapy. Behavior Research and Therapy, 27, 173–180.
(2008). A transtheoretical approach to case formulation. Cognitive and Behavioral Practice, 15, 212–222.
(2003). Research design in clinical psychology (4th ed.). Boston: Allyn and Bacon.
(1999). Functionally based prescriptive and nonprescriptive treatment for children and adolescents with school refusal behavior. Behavior Therapy, 30, 673–695.
(1976). Modern clinical psychology. New York: Basic.
(2006). Evidence-based case formulation. In , Case formulation in cognitive behavior therapy. New York: Rutledge.
(2005). The reliability and quality of cognitive case formulation. Behavior Research and Therapy, 43, 1187–1201.
(2009). Collaborative case conceptualization: Working effectively with clients in cognitive-behavioral therapy. New York: Guilford.
(1981). The Core Conflictual Relationship Theme: A demonstration of reliable clinical inference by the method of mismatched cases. In , Object and self: A developmental approach (pp. 501–520). Madison, CT: International Universities Press.
(1995). The first trial of the P technique in psychotherapy research – A still lively legacy. Journal of Consulting and Clinical Psychology, 63, 6–14.
(1986). Advent of objective measures of the transference concept. Special issue: Psychotherapy research. Journal of Consulting and Clinical Psychology, 54, 39–47.
(1984). Importance of treating individually assessed response classes in the amelioration of depression. Behavior Therapy, 15, 315–335.
(1999). Parent training. In , Handbook of psychotherapies with children and families (pp. 153–180). New York: Kluwer.
(1954). Clinical versus statistical prediction. Minneapolis: University of Minnesota Press.
(1986). Causes and effects of my disturbing little book. Journal of Personality Assessment, 50, 370–375.
(1992). Taking context seriously in psychotherapy research: Relating therapist interventions to patient progress in brief psychodynamic therapy. Journal of Consulting and Clinical Psychology, 60, 678–688.
(1985). A dynamic factor model for the analysis of multivariate time series. Psychometrica, 50, 181–202.
(2004). A manifesto on psychology as idiographic science: Bringing the person back into scientific psychology, this time forever. Measurement, 2, 201–218.
(2008). Discussion of the special issue on growth models for longitudinal data in education. Educational Research and Evaluation, 14, 377–390.
(2005). How generalization works through the single case: A simple idiographic process analysis of an individual psychotherapy. International Journal of Idiographic Science, 1. Retrieved from www.valsiner.com/articles/molenvals.htm.
(1998). Improving cognitive case formulations and treatment planning in clinical practice and research. Journal of Cognitive Psychotherapy, 12, 251–274.
(2001). Increasing accuracy in clinical decision making: Toward an integration of nomothetic-aggregate and intraindividual-idiographic approaches. The Behavior Therapist, 24, 77–94.
(2004). Validation of idiosyncratic cognitive schema in cognitive case formulations: An intraindividual idiographic approach. Psychological Assessment, 16, 211–230.
(in press). Current issues in case formulation. In , Forensic case formulation. UK: Wiley.
(2010). Validity evaluation in cognitive-behavioral case formulation: A practical, clinician-friendly approach. Unpublished manuscript under review.
(2007a). Comparing the validity of alternative cognitive case formulations: A latent variable, multivariate time series approach. Cognitive Therapy and Research, 31, 451–481.
(2007b). Incremental validity of cognitions in a clinical case formulation: An Intraindividual test in a case example. Journal of Psychopathology and Behavioral Assessment, 29, 17–28.
(2001). Cognitive-behavioral interpersonal scenarios: Interformulator reliability and convergent validity. Journal of Psychopathology and Behavioral Assessment, 23, 203–221.
(1995). Procedural debiasing of anchoring effects in clinical-like judgments. Journal of Clinical Psychology, 51, 841–853.
(1998). Interpersonal scenarios: An idiographic measure of self-schemas. Psychotherapy Research, 8, 321–333.
(2001). A cognitive-interpersonal case study of the self. Journal of Clinical Psychology, 57, 307–330.
(1992). The development of an idiographic measure of self-schemas: An illustration of the construction and use of self-scenarios. Psychotherapy, 29, 524–535.
(1999). Cognitive case conceptualization. Mahwah, NJ: Erlbaum.
(1996). Treatment outcome measures: Nomothetic or idiographic? Clinical Psychology: Science and Practice, 3, 164–167.
(2003). Treatment utility of psychological assessment. Psychological Assessment, 15, 521–531.
(1989). Effectiveness of matched, mismatched, and package treatments of depression. Journal of Behavior Therapy and Experimental Psychiatry, 20, 281–294.
(2002). Dynamic factor analysis models for representing process in multivariate time-series. In , Modeling intraindividual variability with repeated measures data (pp. 233–265). Mahwah, NJ: Erlbaum.
(2004). Cognitive-behavioral case formulation and treatment design: A problem solving approach. New York: Springer.
(1994). Psychometric theory (3rd ed.). New York: McGraw-Hill.
(2010). Behavioral assessment with adults. In , Handbook of clinical psychology competencies (pp. 343–365). New York: Springer.
(2008). Clients’ experience of case formulation in cognitive behavior therapy for psychosis. British Journal of Clinical Psychology, 47, 127–138.
(1991). Forecasting with dynamic regression models. New York: Wiley.
(1989). Cognitive therapy in practice: A case formulation approach. New York: Norton.
(2008). The case formulation approach to cognitive-behavior therapy. New York: Guilford.
(1999). Interrater reliability of cognitive-behavioral case formulations of depression: A replication. Cognitive Therapy and Research, 23, 271–283.
(2001). Essential components of cognitive-behavior therapy for depression. Washington, DC: American Psychological Association.
(1995). Interrater reliability of cognitive-behavioral case formulations. Cognitive Therapy and Research, 19, 21–34.
(2006). Naturalistic outcome of case formulation-driven cognitive-behavior therapy for anxious depressed outpatients. Behavior Research and Therapy, 44, 1041–1051.
(2007). Cognitive-behavioral case formulation. In , Handbook of psychotherapy case formulation (2nd ed., pp. 290–316). New York: Guilford..
(2001). Clinical psychology and single-case evidence. New York: Wiley.
(2009). Evaluating case formulation and change process/change mechanism hypotheses in cognitive behavioral therapy of adults with comorbid depression and anxiety. Unpublished doctoral dissertation, Texas Tech University.
(2008, November). Using EMA to test cognitive-behavioral case formulation hypotheses. Presented at the 42nd Annual Convention of the Association of Behavioral and Cognitive Therapies, Orlando, FL.
(1992). Tailor-made versus standardized therapy of phobic patients. Advances in Behavioral Research and Therapy, 14, 67–92.
(2002). Experimental and quasiexperimental designs for generalized causal inference. New York: Houghton Mifflin.
(1986). How do interpretations influence the process of psychotherapy? Journal of Consulting and Clinical Psychology, 54, 646–652.
(2006, August). Testing a cognitive case formulation in a clinical training setting. Evaluating cognitive behavioral case formulation hypotheses using repeated measurement. Symposium presented at the 114th Annual Convention of the American Psychological Association, New Orleans, LA.
(1999). Hypersensitivity to social interactions in bulimic syndromes: Relationship to binge eating. Journal of Consulting and Clinical Psychology, 67, 765–775.
(2007). The science of real-time data capture: Self-reports in health research. New York: Oxford.
(2008). Behavioral case formulation and intervention. New York: Wiley.
(1962). Clinical psychology: An introduction to research and practice. New York: Appleton-Century-Crofts.
(2007). Using multivariate statistics (5th ed.). New York: Pearson.
(2006). Case formulation in cognitive behavior therapy: The treatment of challenging and complex cases. New York: Routledge.
(2002). New developments in cognitive-behavioral case formulation. Epidemiological, systemic, and social context: An integrative approach. Behavioral and Cognitive Psychotherapy, 30, 311–328.
(1997). Behavior therapy: Concepts, procedures, and applications (2nd ed.). Boston: Allyn and Bacon.
(1993). Testing the integrity of a psychotherapy protocol: Assessment of adherence and competence. Journal of Consulting and Clinical Psychology, 61, 620–630.
(1989). Clinical judgment and decision making in neuropsychology. Archives of Clinical Neuropsychology, 4, 233–266.
(2006). Cognitive therapy case formulation in anxiety disorders. In , Case formulation in cognitive behavior therapy: The treatment of challenging and complex cases (pp. 52–80). London: Routledge.
(1996). Manual-based treatments: The clinical application of research findings. Behavior Research and Therapy, 34, 295–314.
(1994). The study of intraindividual differences by means of dynamic factor models: Rationale, implementation, and interpretation. Psychological Bulletin, 116, 166–186.
(2007). Cognitive-behavioral therapy for PTSD: A case formulation approach. New York: Guilford.
(