Revisiting the Rybakov Figures
A Classical and Probabilistic Analysis of the Psychometric Properties of a Test of Spatial Visualization
Abstract
The Rybakov Test is a traditional nonverbal spatial ability test for which promising results have been reported in the few validation studies that have been conducted to date. In order to more thoroughly determine the psychometric properties of the test, we subjected it to systematic validation in two samples of 338 participants in total. Our analyses demonstrated that the Rybakov Test is a reliable measure of spatial visualization ability that exhibits convergent associations with other spatial visualization tests (r = .45–.62) and general intelligence tests (r = .43–.44). The Rybakov Figures showed high internal consistency (α = .79–.84) and high retest reliability (rtt = .77) – and even proved to be Rasch scalable. Because of the widely varying item difficulties, the test can be administered even in highly skilled samples without generating ceiling effects.
References
2001). Intelligenz-Struktur-Test 2000 R (I-S-T 2000 R) [
(Intelligence Structure Test 2000 R ]. Göttingen: Hogrefe.1988). Rasch models for measurement. Newbury Park, CA: Sage.
(1984). Visuospatial impairment in Parkinson’s disease: Role of perceptual and motor factors. Archives of Neurology, 41, 485–490. doi 10.1001/archneur.1984. 04050170031011
(1993). NEO-Fünf-Faktoren-Inventar (NEO-FFI) nach Costa und McCrae [
(NEO-Five-Factor-Inventory (NEO-FFI) by Costa and McCrae ]. Göttingen: Hogrefe.2002). Aufmerksamkeits-Belastungstest (d2) [
(d2 Test of Attention ]. Göttingen: Hogrefe.2006). Ist der I-S-T 2000 R Rasch-skalierbar? [
(Is the I-S-T 2000 R Rasch scalable? ] Diagnostica, 52, 119–130. doi 10.1026/0012-1924.52.3.1191993). Human cognitive abilities: A survey of factor-analytic studies. Cambridge, UK: Cambridge University Press. doi 10.1080/00140139508925174
(1997). Reactions to cognitive ability tests: The relationships between race, test performance, face validity perceptions, and test-taking motivation. Journal of Applied Psychology, 82, 300–310. doi 10.1037/0021-9010.82.2.300
(2003). Applied multiple regression / correlation analysis for the behavioral sciences. Mahwah, NJ: Erlbaum.
(2001). Winmira 2001. Kiel, Germany: IPN.
(2010). A comparison of Rasch item-fit and Cronbach’s α item reduction analysis in the development of a Quality of Life scale for children and adolescents. Child: Care, Health and Development, 36, 473–484. doi 10.1111/j.1365-2214.2009.00998.x
(1996). Messung des Selbstwertgefühls: Befunde zu Reliabilität, Validität und Stabilität der Rosenberg-Skala [
(Measurement of self-esteem: Findings on reliability, validity, and stability of the Rosenberg Scale ]. Diagnostica, 42, 284–292.1921). On the probable error of a coefficient of correlation deduced from a small sample. Metron, 1, 1–32.
(1979). Wiener Matrizen-Test: Manual [
(Viennese Matrices Test: Manual] . Weinheim, Germany: Beltz.2005). Individual differences in spatial abilities. In , The Cambridge handbook of visuospatial thinking (pp. 121–169). New York: Cambridge University Press.
(1946). The relation of two bi-factors to achievement in geometry and other subjects. Journal of Educational Psychology, 37, 257–265. doi 10.1037/h0053536
(1983). Leistungs-Prüf-System (LPS) [
(Performance Examination System ]. Göttingen: Hogrefe.1987). Spatio-practical cognitive impairment in patients with cerebellar lesions. In , Proceedings of the German Society of Neurology (Vol. 4, pp. 721–722). Berlin, Germany: German Society of Neurology.
(1999). Mehrfachwahl-Wortschatz-Intelligenztest MWT-B [
(Multiple Choice Vocabulary Test ]. Balingen, Germany: Spitta Verlag.1991). Mehrfachwahl-Wortschatz-Intelligenztest MWT-A [
(Multiple Choice Vocabulary Test ]. Erlangen, Germany: Perimed Fachbuch-Verlagsgesellschaft.1948). The Revised Minnesota Paper Form Board Test. New York: Psychological Corporation.
(1987). Dimensions and components of individual differences in spatial abilities. In , Intelligence and cognition: Contemporary frames of reference (pp. 253–312). Boston, MA: Martinus Nijhoff. doi 10.1007/978-94-010-9437-5_6
(1990). Response bias: Characteristics of detection theory, threshold theory, and “nonparametric” indexes. Psychological Bulletin, 107, 401–413. doi 10.1037/0033-2909.107.3.401
(2009). CHC theory and the human cognitive abilities project: Standing on the shoulders of the giants of psychometric intelligence research. Intelligence, 37, 1–10. doi 10.1016/j.intell.2008.08.004
(1955a). Figuren von Rybakoff [
(Rybakov Figures ]. Bern, Switzerland: Huber.1955b). Würfelabwicklungen [
(Unfolding Cubes ]. Bern, Switzerland: Huber.2011). 10-Minuten-Test [
(10-Minute Test ]. Unpublished test, University of Düsseldorf, Germany.2012). Validating an inventory for the assessment of egoistic bias and moralistic bias as two separable components of social desirability. Journal of Personality Assessment, 94, 620–629. doi 10.1080/ 00223891.2012.672505
(2010). Introduction to the special issue: Current research in Cattell-Horn-Carroll-based assessment. Psychology in the Schools, 47, 621–634. doi 10.1002/pits.20495
(2011). Der “Analytische Test”: Validierung eines neuen eignungsdiagnostischen Instruments zur Erfassung von schlussfolgerndem Denken [
(The “Analytic Test”: Validation of a new personnel selection tool assessing reasoning ]. Zeitschrift für Arbeits- und Organizationspsychologie, 55, 1–16. doi 10.1026/0932-4089/a0000312003). The overclaiming technique: Measuring self-enhancement independent of ability. Journal of Personality and Social Psychology, 84, 890–904. doi 10.1037/0022-3514.84.4.890
(1995). A redrawn Vandenberg & Kuse mental rotations test: Different versions and factors that affect performance. Brain and Cognition, 28, 39–58. doi 10.1006/brcg. 1995.1032
(1987). Visuoperception and visuospatial and visuorotational performance in Parkinson’s disease. Journal of Neurology, 235, 99–101. doi 10.1007/ BF00718018
(1960/1980). Probabilistic models for some intelligence and attainment tests. Chicago, IL: University of Chicago Press.
(1965). Society and the adolescent self-image. Princeton, NJ: Princeton University Press.
(1994). A conditional item-fit index for Rasch models. Applied Psychological Measurement, 18, 171–182. doi 10.1177/014662169401800206
(1910). АТлась длЯ эксперимеНтально-психологическаго изследования личности [
(Atlas for experimental research on personality ]. Moscow, Russia.1998). The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. Psychological Bulletin, 124, 262–274. doi 10.1037/0033-2909.124.2.262
(1992). Wortschatztest (WST) [
(Vocabulary Test ]. Weinheim, Germany: Beltz.1979). Predicting mathematics performance in high school girls and boys. Journal of Educational Psychology, 71, 242–249.
(1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86, 420–428. doi 10.1037/0033-2909.86.2.420
(1980). Tests for comparing elements of a correlation matrix. Psychological Bulletin, 87, 245–251. doi 10.1037/0033-2909.87.2.245
(1983). Schlauchfiguren: Ein Test zur Beurteilung des räumlichen Vorstellungsvermögens [
(Cube Perspectives Test: A test for the assessment of spatial perception ]. Göttingen: Hogrefe.1938). Primary mental abilities. Chicago, IL: University of Chicago Press.
(1995). Magnitude of sex differences in spatial abilities: A meta-analysis and consideration of critical variables. Psychological Bulletin, 117, 250–270.
(2003). Visual-spatial ability correlates with efficiency of hand motion and successful surgical performance. Surgery, 134, 750–757. doi 10.1016/S0039-6060(03)00248-4
(1958). The measurement and appraisal of adult intelligence (4th ed.). Baltimore, MD: Williams & Wilkins. doi 10.1037/11167-000
(1963). Faktorenanalysen von Intelligenztests unter Berücksichtigung des individuellen Lösungsweges [
(Factor analyses of intelligence tests considering the individual approach ] (Unpublished doctoral dissertation). University of Vienna, Vienna, Austria.