Skip to main content
Original Article

Psychometric Properties of the Generalized Pliance Questionnaire in Spain

Published Online:https://doi.org/10.1027/1015-5759/a000614

Abstract. Rule-governed behavior is a central concept to explain complex human behavior from a functional-analytic standpoint. Recently, a self-report measure of a functional type of rule-following called generalized pliance has been developed – the Generalized Pliance Questionnaire (GPQ). The GPQ has two versions with 18 and 9 items, respectively. This study aimed to analyze the factor structure and psychometric properties of both GPQ versions in a Spanish online sample (N = 846). Confirmatory factor analyses showed that the one-factor model obtained an acceptable fit in the GPQ-18, but an inadequate fit in the GPQ-9. The GPQ-18 showed measurement invariance across gender, excellent internal consistency, and convergent construct validity. According to the results, the GPQ-18 showed good psychometric properties in Spanish samples.

References

  • Atienza, F. L., Pons, D., Balaguer, I., & García-Merita, M. (2000). Propiedades psicométricas de la Escala de Satisfacción con la Vida en adolescentes [Psychometric properties of the Satisfaction with Life Scale in adolescents]. Psicothema, 12, 314–319. First citation in articleGoogle Scholar

  • Barrett, P. (2007). Structural equation modelling: Adjudging model fit. Personality and Individual Differences, 42, 815–824. https://doi.org/10.1016/j.paid.2006.09.018 First citation in articleCrossrefGoogle Scholar

  • Bond, F. W., Hayes, S. C., Baer, R. A., Carpenter, K. M., Guenole, N., Orcutt, H. K., Waltz, T., & Zettle, R. D. (2011). Preliminary psychometric properties of the Acceptance and Action Questionnaire – II: A revised measure of psychological inflexibility and experiential avoidance. Behavior Therapy, 42, 676–688. https://doi.org/10.1016/j.beth.2011.03.007 First citation in articleCrossrefGoogle Scholar

  • Brown, T. A. (2015). Confirmatory factor analysis for applied research, Guilford Press. First citation in articleGoogle Scholar

  • Browne, M. W., & Cudeck, R. (1992). Alternative ways of assessing model fit. Sociological Methods & Research, 21, 230–258. https://doi.org/10.1177/0049124192021002005 First citation in articleCrossrefGoogle Scholar

  • Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. BollenJ. S. LongEds., Testing structural equation models (pp. 136–162). Sage. First citation in articleGoogle Scholar

  • Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 14, 464–504. https://doi.org/10.1080/10705510701301834 First citation in articleCrossrefGoogle Scholar

  • Diener, E., Emmons, R. A., Larsen, R. J., & Griffin, S. (1985). The Satisfaction with Life Scale. Journal of Personality Assessment, 49, 71–75. https://doi.org/10.1207/s15327752jpa4901_13 First citation in articleCrossrefGoogle Scholar

  • Gillanders, D. T., Bolderston, H., Bond, F. W., Dempster, M., Flaxman, P. E., Campbell, L., Kerr, S., Tansey, L., Noel, P., Ferenbach, C., Masley, S., Roach, L., Lloyd, J., May, L., Clarke, S., & Remington, B. (2014). The development and initial validation of the Cognitive Fusion Questionnaire. Behavior Therapy, 45, 83–101. https://doi.org/10.1016/j.beth.2013.09.001 First citation in articleCrossrefGoogle Scholar

  • Grant, D. A., & Berg, E. A. (1948). A behavioral analysis of degree of reinforcement and ease of shifting to new responses in a Weigl-type card-sorting problem. Journal of Experimental Psychology, 38, 404–411. https://doi.org/10.1037/h0059831 First citation in articleCrossrefGoogle Scholar

  • Greiff, S., & Scherer, R. (2018). Still comparing apples with oranges? Some thoughts on the principles and practices of measurement invariance testing. European Journal of Psychological Assessment, 34(3), 141–144. https://doi.org/10.1027/1015-5759/a000487 First citation in articleLinkGoogle Scholar

  • Harte, C., Barnes-Holmes, D., Barnes-Holmes, Y., McEnteggart, C., Gys, J., & Hasler, C. (2020). Exploring the potential impact of relational coherence on persistent rule-following: The first study. Learning & Behavior, 48, 373–391. https://doi.org/10.3758/s13420-019-00399-0 First citation in articleCrossrefGoogle Scholar

  • Hayes, S. C., Barnes-Holmes, D., & Roche, B. (2001). Relational frame theory: A post-Skinnerian account of human language and cognition, Plenum Press. First citation in articleCrossrefGoogle Scholar

  • Hayes, S. C., & Hayes, L. J. (1989). The verbal action of the listener as a basis for rule-governance. In S. C. HayesEd., Rule-governed behavior (pp. 153–190). Plenum Press. https://doi.org/10.1007/978-1-4757-0447-1_5 First citation in articleGoogle Scholar

  • Hayes, S. C., Strosahl, K. D., & Wilson, K. G. (1999). Acceptance and commitment therapy: An experiential approach to behavior change, Guilford Press. First citation in articleGoogle Scholar

  • Hayes, S. C., Zettle, R., & Rosenfarb, I. (1989). Rule-following. In S. C. HayesEd., Rule-governed behavior (pp. 191–220). Plenum Press. https://doi.org/10.1007/978-1-4757-0447-1_6 First citation in articleGoogle Scholar

  • Hooper, D., Coughlan, J., & Mullen, M. R. (2008). Structural equation modelling: Guidelines for determining model fit. Electronic Journal of Business Research Methods, 6, 53–60. First citation in articleGoogle Scholar

  • Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55. https://doi.org/10.1080/10705519909540118 First citation in articleCrossrefGoogle Scholar

  • Jöreskog, K. G. (2005). Structural equation modeling with ordinal variables using LISREL, Scientific Software International. First citation in articleGoogle Scholar

  • Lenhard, W., & Lenhard, A. (2016). Calculation of effect sizes. https://www.psychometrica.de/effect_size.html First citation in articleGoogle Scholar

  • Lovibond, P. F., & Lovibond, S. H. (1995). The structure of negative emotional states: Comparison of the Depression Anxiety Stress Scales (DASS) with the Beck Depression and Anxiety Inventories. Behaviour Research and Therapy, 33, 335–343. https://doi.org/10.1016/0005-7967(94)00075-U First citation in articleCrossrefGoogle Scholar

  • Luciano, C., Valdivia-Salas, S., Cabello, F., & Hernández, M. (2009). Developing self-directed rules. In R. A. RehfeldtY. Barnes-HolmesEds., Derived relational responding: Applications for learners with autism and other developmental disabilities (pp. 335–352). New Harbinger. First citation in articleGoogle Scholar

  • Luciano, C., Valdivia-Salas, S., & Ruiz, F. J. (2012). The self as the context for rule-governed behavior. In L. McHughI. StewartEds., The self and perspective taking: Research and applications (pp. 143–160). Context Press. First citation in articleGoogle Scholar

  • MacCallum, R. C., Browne, M. W., & Sugawara, H. M. (1996). Power analysis and determination of sample size for covariance structure modeling. Psychological Methods, 1, 130–149. First citation in articleCrossrefGoogle Scholar

  • Marsh, H. W., Hau, K. T., & Wen, Z. (2004). In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralising Hu and Bentler’s (1999) findings. Structural Equation Modeling, 11, 320–341. https://doi.org/10.1207/s15328007sem1103_2 First citation in articleCrossrefGoogle Scholar

  • Millsap, R. E., & Yun-Tein, J. (2004). Assessing factorial invariance in ordered-categorical measures. Multivariate Behavioral Research, 39, 479–515. https://doi.org/10.1207/S15327906MBR3903_4 First citation in articleCrossrefGoogle Scholar

  • O’Connor, M., Byrne, P., Ruiz, F. J., & McHugh, L. (2019). Generalised pliance in relation to contingency insensitivity and mindfulness. Mindfulness, 10, 833–840. https://doi.org/10.1007/s12671-018-1046-5 First citation in articleCrossrefGoogle Scholar

  • Ruiz, F. J., García-Martín, M. B., Suárez-Falcón, J. C., & Odriozola-González, P. (2017). The hierarchical factor structure of the Spanish version of Depression Anxiety and Stress Scale-21. International Journal of Psychology and Psychological Therapy, 17, 97–105. First citation in articleGoogle Scholar

  • Ruiz, F. J., Langer, A. I., Luciano, C., Cangas, A. J., & Beltrán, I. (2013). Measuring experiential avoidance and psychological inflexibility: The Spanish translation of the Acceptance and Action Questionnaire. Psicothema, 25, 123–129. https://doi.org/10.7334/psicothema2011.239 First citation in articleGoogle Scholar

  • Ruiz, F. J., Peña-Vargas, A., Ramírez, E. S., Suárez-Falcón, J. C., García-Martín, M. B., García-Beltrán, D. M., Henao, A. M., Monroy-Cifuentes, A., & Sánchez, P. D. (2020). Efficacy of a two-session repetitive negative thinking-focused acceptance and commitment therapy (ACT) protocol for depression and generalized anxiety disorder: A randomized waitlist control trial. Psychotherapy, 57, 444–456. https://doi.org/10.1037/pst0000273 First citation in articleCrossrefGoogle Scholar

  • Ruiz, F. J., Suárez-Falcón, J. C., Barbero-Rubio, A., & Flórez, C. L. (2019). Development and initial validation of the Generalised Pliance Questionnaire. Journal of Contextual Behavioral Science, 12, 189–198. https://doi.org/10.1016/j.jcbs.2018.03.003 First citation in articleCrossrefGoogle Scholar

  • Ruiz, F. J., Suárez-Falcón, J. C., Riaño-Hernández, D., & Gillanders, D. (2017). Psychometric properties of the Cognitive Fusion Questionnaire in Colombia. Revista Latinoamericana de Psicología, 49, 80–87. https://doi.org/10.1016/j.rlp.2016.09.006 First citation in articleCrossrefGoogle Scholar

  • Ruiz, F. J., Suárez-Falcón, J. C., Segura-Vargas, M. A., & Gil-Luciano, B. (2020). Psychometric properties of the Spanish version of the Valuing Questionnaire in Colombia. Manuscript submitted for publication. First citation in articleGoogle Scholar

  • Salazar, D. M., Ruiz, F. J., Flórez, C. L., & Suárez-Falcón, J. C. (2018). Psychometric Properties of the Generalised Pliance Questionnaire-Children. International Journal of Psychology and Psychological Therapy, 18, 273–287. First citation in articleGoogle Scholar

  • Salazar, D. M., Ruiz, F. J., García-Martín, M. B., & Bedoya-Valderrama, L. (2019). Generalized pliance and learning difficulties: An empirical investigation. Manuscript submitted for publication. First citation in articleGoogle Scholar

  • Skinner, B. F. (1966). An operant analysis of problem solving. In B. KleinmuntzEd., Problem solving: Research, method and theory (pp. 133–171). Wiley. First citation in articleGoogle Scholar

  • Smith, G. T., McCarthy, D. M., & Anderson, K. G. (2000). On the sins of short-form development. Psychological Assessment, 12, 102–111. https://doi.org/10.1037/1040-3590.12.1.102 First citation in articleCrossrefGoogle Scholar

  • Smout, M., Davies, M., Burns, N., & Christie, A. (2014). Development of the Valuing Questionnaire (VQ). Journal of Contextual Behavioral Science, 3, 164–172. https://doi.org/10.1016/j.jcbs.2014.06.001 First citation in articleCrossrefGoogle Scholar

  • Stapleton, A., & McHugh, L. (2020). Adolescent correlates of the Generalised Pliance Questionnaire–Children. Journal of Contextual Behavioral Science, 15, 131–134. First citation in articleCrossrefGoogle Scholar

  • Stapleton, A., Ruiz, F. J., & McHugh, L. (in press). Comparative investigation of adolescents’ generalised pliance and psychological inflexibility across cultural contexts. The Psychological Record. First citation in articleGoogle Scholar

  • Törneke, N., Luciano, C., & Valdivia-Salas, S. (2008). Rule-governed behavior and psychological problems. International Journal of Psychology and Psychological Therapy, 8, 141–156. First citation in articleGoogle Scholar

  • Waldeck, D., Pancani, L., & Tyndall, I. (2019). An examination of the construct validity of the Generalised Pliance Questionnaire. Journal of Contextual Behavioral Science, 11, 50–54. https://doi.org/10.1016/j.jcbs.2018.12.003 First citation in articleCrossrefGoogle Scholar

  • Zettle, R. D., & Hayes, S. C. (1982). Rule-governed behavior: A potential theoretical framework for cognitive-behavior therapy. Advances in Cognitive-Behavioral Research and Therapy, 1, 73–118. First citation in articleCrossrefGoogle Scholar