Measuring Psychology Students’ Information-Seeking Skills in a Situational Judgment Test Format
Construction and Validation of the PIKE-P Test
Abstract
Abstract. Three studies were conducted to develop a test for academic information-seeking skills in psychology students that measures both procedural and declarative aspects of the concept. A skill decomposition breaking down information-seeking into 10 sub skills was used to create a situational judgment test with 22 items. A scoring key was developed based on expert ratings (N = 14). Subsequently, the test was administered to two samples of N = 78 and N = 81 psychology students. Within the first sample, the scale reached an internal consistency (Cronbach’s Alpha) of α = .75. Scale validity was investigated with data from the second sample. High correlations between the scale and two different information search tasks (r = .42 to .64; p < .001) as well as a declarative information literacy test (r = .51; p < .001) were found. The findings are discussed with regard to their implications for research and practice.
References
(2005). Information literacy: A practitioner’s guide. Oxford, UK: Chandos Publishing.
(2009). Diagnose von Strategiewissen beim Textverstehen
[Assessing knowledge about reading strategies] . Zeitschrift für Entwicklungspsychologie und Pädagogische Psychologie, 41, 96–103.. (2000). Information literacy standards for higher education. Retrieved from http://www.ala.org/acrl/files/standards/standards.pdf
. (2010). Psychology information literacy standards. Retrieved from http://connect.ala.org/files/29837/info_lit_psych_pdf_4a60828636.pdf
. (2013). Information literacy competency standards for nursing. Retrieved from http://crln.acrl.org/content/75/1/34.full.pdf
(2012). Library instruction and academic success: A mixed-methods assessment of a library instruction program. Evidence Based Library and Information Practice, 7, 82–95.
(2005). Information problem solving by experts and novices: Analysis of a complex cognitive skill. Computers in Human Behavior, 21, 487–508.
(2002). Assessing information literacy skills in the California State University: A progress report. Journal of Academic Librarianship, 28, 26–35.
(2014). Diagnostik von ICT-Literacy. Multiple-Choice- vs. simulationsbasierte Aufgaben
[Assessment of ICT literacy: Multiple-choice versus simulation-based tasks] . Diagnostica, 60, 10–21.(2013). Computer-based assessment of Complex Problem Solving: Concept, implementation, and application. Educational Technology Research & Development, 61, 407–421.
(2006). Health information literacy and competencies of information age students: Results from the interactive online Research Readiness Self-Assessment (RRSA). Journal of Medical Internet Research, 8, e6
. (2013). Schulungsstatistik Deutschland 2013
[Instruction statistics Germany 2013] . Retrieved from http://www.informationskompetenz.de/fileadmin/DAM/documents/Tabelle_Details_IKde_2013.pdf(2013). Assessing information literacy among German psychology students. Reference Services Review, 41, 660–674.
(2014). Assessing information literacy using information search tasks. Journal of Information Literacy, 8, 3–20.
(2012). How do scientists select articles in the PubMed database? An empirical study of criteria and strategies. European Review of Applied Psychology, 62, 63–72.
(2006).
A theoretical basis for situational judgment tests . In J. WeekleyR. PloyhartEds., Situational judgment tests (pp. 57–81). San Francisco, CA: Jossey-Bass.(2015).
Fachspezifische Erfassung von Recherchekompetenz durch prozedurale Wissenstests: Psychologie vs. Informatik [Discipline-specific assessment of information-seeking ability with procedural knowledge tests: Psychology vs. computer science] . In A.-K. MayerEd., Informationskompetenz im Hochschulkontext – Interdisziplinäre Forschungsperspektiven. (pp. 103–120. Lengerich, Germany: Pabst Science Publishers.(in press).
Intelligence, academic self-concept, and information literacy: The role of adequate perceptions of academic ability in the acquisition of knowledge about information searching . Information Research.(2014). Combining self-assessments and achievement tests in information literacy assessment: Empirical results and recommendations for practice. Assessment & Evaluation in Higher Education. Assessment & Evaluation in Higher Education. Advance online publication. doi: 10.1080/02602938.2014.950554
(2006).
Using situational judgment tests to measure practical intelligence . In J. WeekleyR. PloyhartEds., Situational judgment tests. (pp. 107–131). San Francisco, CA: Jossey-Bass.(2000). Empirical studies of end‐user information searching. Journal of the American Society for Information Science, 51, 1211–1231.
(2009). Information literacy assessment: Where do we start? Journal of Librarianship and Information Science, 41, 19–28.
(2013). Bundesweite Befragung der Absolventinnen und Absolventen des Jahres 2011 im Studiengang BSc Psychologie?
[German nationwide survey of bachelor’s degree graduates in 2011] . Psychologische Rundschau, 64, 103–112.(2009). The Information Literacy Test (ILT): Test Manual. Harrisonburg, VA: Center for Assessment and Research Studies.
