Abstract
This study focuses on the assessment of educational-psychological teacher competencies regarding generic teaching and learning (TL) components in initial university-based teacher education. Based on the approximations-of-practice (AoP) framework, simulated teaching events (M-Teach) with different formats (tutoring, small group) were developed. In a validation study, it was asked to what extent preservice teachers show teaching skills discriminating students in their teaching quality. Furthermore, the relationship between performances in different M-Teach formats was investigated and compared with teaching in real classrooms. Finally, how preservice teachers experience teaching in M-Teach events and how their subjective experience is related to their performance was analyzed. As a sample, a full cohort of preservice teachers in the fifth semester of a Bachelor teacher education program in Germany (N = 89) participated. All participants taught two M-Teach formats of tutoring and small group teaching based on a standardized instruction and research design procedure. Video analysis of M-Teach event performance revealed that preservice teachers show relevant teaching skills with variations in teaching quality. The performance scores show a quite high stability between different formats (tutoring, small group) and are systematically related to performance in classroom teaching. Participants judge self-efficacy as high and the challenge of implementation as medium to low. The findings indicate that M-Teach events show a high fidelity for formative assessment purposes and can be used in further studies as measures for assessing the acquisition of relevant teaching skills in the area of educational-psychological competencies.
Diese Studie fokussiert auf die Erfassung pädagogisch-psychologischer Kompetenzen mit dem Schwerpunkt auf lernwirksame Unterrichtsbedingungen in universitärer Lehrerausbildung. Basierend auf dem theoretischen Modell der Approximation-of-Practice (AoP) wurden simulierte Lehrsituationen (M-Teach) unterschiedlicher Formate (Tutorensituation, Kleingruppensituation) entwickelt. In einer Validierungsstudie wurde überprüft inwiefern Lehramtsstudierende unterrichtliches Handeln zeigen, welches es ermöglicht Studierenden qualitativ in ihrem Unterrichten zu unterscheiden. Weiter wurden Zusammenhänge des unterrichtlichen Handelns in den verschiedenen Formaten untersucht und mit dem tatsächlichen Unterrichten im Klassenzimmer verglichen. Abschließend wurde untersucht wie Lehramtsstudierenden die Unterrichtserfahrung in den M-Teach Situationen wahrnahmen und wie dies mit ihrer Performanz zusammenhängt. An der Studie nahm eine vollständige Kohorte eines Bachelor Studiengangs im fünften Semester (N = 89) teil. Alle Teilnehmer unterrichteten jeweils in den beiden M-Teach Formaten Tutorensituation und Kleingruppensituation, welche standardisiert angeleitet wurden. Videoanalysen der Performanz in den M-Teach Situationen legen nahe, dass die Lehramtsstudierenden relevantes unterrichtliches Handeln zeigen, welches in seiner Qualität variiert. Die Performanz zeigt eine hohe Stabilität zwischen den verschiedenen Formaten und hängt systematisch mit dem Unterrichten im Klassenzimmer zusammen. Die Teilnehmer schätzen ihre Selbstwirksamkeitserwartung als hoch sowie die Herausforderung erfolgreich in den M-Teach Situationen zu agieren als mittel bis niedrig ein. Die Ergebnisse zeigen, dass die M-Teach Situationen eine hohe Genauigkeit für die Erfassung unterrichtlichen Handelns aufweisen und somit in weiteren Studien genutzt werden können, um die Aneignung pädagogisch-psychologischer Kompetenzen zu untersuchen.
References
2012). Lehramtsstudium in Deutschland: Wie groß ist die strukturelle Vielfalt? [Teacher education in Germany: How high is the structural variety?] Unterrichtswissenschaft, 40, 101 – 120.
(2006). Stichwort: Professionelle Kompetenz von Lehrkräften. [Keyword: Teachers’ professional competence] Zeitschrift für Erziehungswissenschaft, 9, 469 – 520.
(2010). Teachers mathematical knowledge, cognitive activation in the classroom, and student progress. American Educational Research Journal, 47, 133 – 180.
(2014). Understanding video as a tool for teacher education: Investigating Instructional strategies integrating video to promote reflection. Instructional Science, 42, 443 – 463. doi: 10.1007/s11251 – 013 – 9281 – 6
(2014). International perspectives on teacher knowledge, beliefs and opportunities to learn. Dordrecht, The Netherlands: Springer.
(2006). Learning to teach mathematics–Teacher education and development study (TEDS-M). Berlin, Germany: Humboldt-Universität.
(2004). Professional development and teacher learning: Mapping the terrain. Educational Researcher, 33(8), 3 – 15. doi: 10.3102/0013189x033008003
(1995). Knowledge development and restructuring in the domain of medicine : The role of theory and practice. Learning and Instruction, 5, 269 – 289.
(1997). Kompetenzen, Funktionen und unterrichtliches Handeln des Lehrers. In F. E. WeinertEd., Enzyklopädie der Psychologie. Serie I, Bd.3. Psychologie des Unterrichts und der Schule [Competence, function and teaching practice of teachers.] (pp. 177 – 212). Göttingen, Germany: Hogrefe.
(2010). Determining long term effects of teacher education. In P. PetersonE. BakerB. McGawEds., International encyclopedia of education (Vol. 7(7), pp. 503 – 510). Oxford, UK: Elsevier.
(1975). Microteching: A programme of teaching skills. London, UK: Methuen.
(2003). Assessing assessment in teacher education. Journal of Teacher Education, 54, 187 – 191.
(2003). Resources, instruction, and research. Educational Evaluation and Policy Analysis, 25, 119 – 142.
(2010). Teacher education and the American future. Journal of Teacher Education, 61(1 – 2), 35 – 47. doi: 10.1177/0022487109348024
(2005). Preparing teachers for a changing world: What teachers should learn and be able to do. San Francisco,CA: Jossey-Bass.
(1970). Analyzing teaching behavior. Michigan: Addison-Wesley.
(1987). Syntheses of educational productivity research. International Journal of Educational Research, 11, 145 – 252.
(2013). Motivational, personal and cognitive prerequisites of pre-service teacher candidates–a systematic analysis of application documents. In L. OsternK. SmithR. R., T. KrügerM. B. PostholmEds., Teacher education research between national identy and global trends (pp. 139 – 162). Trondheim, Norway: Akademika.
(2012). Effects of autonomy-supportive teaching on student learning and motivation. The Journal of Experimental Education, 80, 284 – 316. doi: 10.1080/00220973.2011.573019
(1978). Microteaching: Developing the concept for practical training. Bristish Journal of Educational Technology, 2(9), 142 – 149.
(2013). Evaluation eines videobasierten Trainingsseminars zur Förderung der professionellen Wahrnehmung von Klassenführung im Grundschulunterricht. Zeitschrift für Pädagogische Psychologie, 27, 141 – 155.
(2013). Veränderung subjektiver Kompetenzeinschätzungen von Lehramtsstudierenden im Praxissemester. [Changes in subjective competence perceptions of preservice teachers in the course of internships.] Zeitschrift für Pädagogische Psychologie, 27, 77 – 86. doi: 10.1024/1010-0652/a000090
(2012). Lernbegleitung im Praktikum. Befunde und Innovationen im Kontext der Reform der Lehrerbildung. [Teaching support within internships. Findings and Innovations in the context of teacher education reform.]. In W. SchubarthK. PeckA. SeidelC. GottmannC. KammM. KrohnEds., Studium nach Bologna: Praxisbezüge stärken?! Praktika als Brücke zwischen Hochschule und Arbeitsmarkt [Study after Bologna: strengthen practice relation?! Internships as bridge between university and vocation] (pp. 171 – 183). Wiesbaden, Germany: Springer VS.
(2005). Research on pedagogical approaches in teacher education. In M. Cochran-SmithK. M. ZeichnerEds., Studying teacher education (pp. 425 – 476). Mahwah, NJ: Lawrence Erlbaum Associates.
(2009). Teaching practice: A cross-professional perspective. Teachers College Record, 111, 2055 – 2100.
(2013). Measure for measure: The relationship between measures of instructional practice in middle school English language arts and teachers’ value-added scores. American Journal of Education, 119, 445 – 470.
(2008). Back to the future: Directions for research in teaching and teacher education. American Educational Research Journal, 45 (1), 184 – 205. doi: 10.3102/0002831207312906
(2012). Handbook of inter-rater reliability: The definitive guide to measuring the extent of agreement among multiple raters (3rd Edition). Advanced Analytics, LLC. Maryland, USA.
(2012). A course on effective teacher-child interactions: Effects on teacher beliefs, knowledge, and observed practice. American Educational Research Journal, 49 (1), 88 – 123.
(2008). Visible learning. A synthesis of over 800 meta-analyses relating to achievement. London & New York: Routledge.
(2007). The power of feedback. Review of Educational Research, 77 (1), 81 – 112. doi: 10.3102/003465430298487
(2012). Unterrichtsqualität und Lehrerprofessionalität: Diagnose, Evaluation und Verbesserung des Unterrichts (4th ed.) [Instructional quality and teachers’ professional development: diagnose, evaluation and improvement of instrcution]. Seelze-Velber, Germany: Kallmeyer.
(2011). Stayers and leavers: Early-career teacher effectiveness and attrition. Educational Researcher, 40, 271 – 280. doi: 10.3102/0013189X11419042
(2002). A knowledge base for the teaching profession: What would it look like and how can we get one? Educational Researcher, 31(5), 3 – 15. doi: 10.3102/0013189X031005003
(1998). Problem-based learning: Effects on the early acquisition of cognitive skill in medicine. The Journal of the Learning Sciences, 7, 173 – 208.
(2012). Measuring usable knowledge: Teachers analyses of mathematics classroom videos predict teaching quality and student learning. American Educational Research Journal, 49, 568 – 589. doi: Doi 10.3102/0002831212437853
(2014). Is teachers general pedagogical knowledge a premise for noticing and interpreting classroom situations? A video-based assessment approach. Teaching and Teacher Education, 38, 76 – 88.
(2013). Pädagogisches Wissen und berufsspezifische Motivation am Anfang der Lehrerausbildung. Zum Verhältnis von kognitiven und nicht-kognitiven Eingangsmerkmalen von Lehramtsstudierenden [Pedagogical knowledge and profession-related motivation at the beginning of teacher preparation. The relationship of cognitive and non-cognitive entry characteristics of students]. Zeitschrift für Pädagogik, 59 (1), 43 – 65.
(2005). Quality requirements for teacher educators. Teaching and Teacher Education, 21 (2), 157 – 176.
(2011). Professionelle Kompetenz von Lehrkräften: Ergebnisse des Forschungsprogramms COACTIV [Professional competencies of teachers. Findings of the research program COACTIV]. Münster, New York, NY, München, Berlin: Waxmann.
(2007). Effective classroom management and the development of subject-related interest. Learning and Instruction, 17, 494 – 509.
(1999). Developing practice, developing practitioners–Toward a practice-based theory of professional education. In G. SykesL. Darling-HammondEds., Teaching as the learning profession: Handbook of policy and practice. San Francisco, CA: Jossey Bass.
(2010). The analysis of classroom talk: Methods and methodologies. British Journal of Educational Psychology, 80 (1), 1 – 14. doi: 10.1348/000709909x479853
(2008). Theres more to it than instructional design: The role of individual learner characteristics for hypermedia learning. Berlin, Germany: Logos.
(1993). Reliability an predictive validity of the motivated strategies for learning questionnaire (MSLQ). Educational and Psychological Measurement, 53, 801 – 813.
(2011). Lehrerbildung an der TUM School of Education [Teacher education at TUM School of Education]. Erziehungswissenschaften, 22 (43), 47 – 56.
(2000). What do new views of knowledge and thinking have to say about research on teacher learning? Educational Researcher, 29 (1), 4 – 15.
(2010). Strukturierung, kognitive Aktivität und Leistungsentwicklung im Mathematikunterricht [Structure, cognitive activation and development of achievement in math lessons]. Unterrichtswissenschaft, 38, 229 – 246.
(2010). Using video to teach future teachers to learn from teaching. ZDM The International Journal on Mathematics Education. 43, 1, 133 – 145. doi: 10.1007/s11858-010-0292-3
(2006). The role of student characteristics in studying micro teaching-learning environments. Learning Environments Research, 9, 253 – 271.
(2012). Implementing competence assessment in university education Empirical Research in Vocational Education and Training, 4 (1), 91 – 94.
(2010). “Observer”–Validierung eines videobasierten Instruments zur Erfassung der professionellen Wahrnehmung von Unterricht [Observer–Validation of a video-based instrument assessing professional vision]. In E. KliemeD. LeutnerM. KenkEds., Kompetenzmodellierung. Zwischenbilanz des DFG-Schwerpunktprogramms und Perspektiven des Forschungsansatzes [Modeling competencies. Interim result of the DFG program and perspectives of the research approach] (Vol. Beiheft 56, pp. 296 – 306).
(2005). How to run a video study: Technical report of the IPN Video Study. Münster, Germany: Waxmann.
(2005). Clarity and Coherence of lesson goals as a scaffold for student learning. Learning and Instruction, 15, 539 – 556. doi: 10.1016/j.learninstruc.2005.08.004
(2007). Teaching effectiveness research in the past decade: The role of theory and research design in disentangling meta-analysis results. Review of Educational Research, 77, 454 – 499. doi: 10.3102/0034654307310317
(2014). Modeling and measuring the structure of professional vision in pre-service teachers. American Educational Research Journal. Advance online publication, 51, 739 – 771. doi: 10.3102/0002831214531321
(1991). Performance assessment for the workplace. Washington, DC: National Academy Press.
(2012). Assessing business-planning competence using the Collegiate Learning Assessment as a prototype. Empirical Research in Vocational Education and Training, 4 (1), 77 – 90.
(1987). Knowledge and teaching: Foundations of the new reform. Harvard Educational Review, 57 (1), 1 – 22.
(2013). Declarative knowledge and professional vision in teacher education: Effect of courses in teaching and learning. British Journal of Educational Psychology, 83, 467 – 483. doi: 10.1111/j.2044-8279.2012.02075.x
(2011). Pädagogisch-psychologisches Wissen von Lehrkräften. In M. KunterJ. BaumertW. BlumU. KlusmannS. KraussM. NeubrandEds., Professionelle Kompetenz von Lehrkräften–Ergebnisse des Forschungsprogramms COACTIV [Teachers’ pedagogical knowledge. Teachers’ Professional Competencies–Findings of the research program COACTIV] (pp. 193 – 214). Münster, Germany: Waxmann.
(2013). Using a standardized video-based assessment in a university teacher education program to examine preservice teachers knowledge related to effective teaching. Teaching and Teacher Education, 33, 24 – 33. doi: 10.1016/j.tate.2013.01.010
(2005). A research agenda for teacher education. In M. Cochran-SmithK. M. ZeichnerEds., Studying teacher education (pp. 737 – 760). Mahwah, NJ: Lawrence Erlbaum Associates.
(