Abstract
Abstract. This meta-analysis (25 articles, k = 44 independent data sources, N = 2,323) examines the effectiveness of flipped classroom on student achievement in secondary education. The flipped classroom model refers to an instructional approach in which students watch educational videos at home and homework assignments are done in class. Effect sizes were calculated for the research designs “post-test only”, “pre-test-post-test (time)” and “pre-test-post-test with control group (treatment)”. The meta-analytical findings for the condition “treatment” confirm the effectiveness of flipped classroom on student achievement in comparison to traditional instruction (Cohen's d = 0.42, 95 % CI [0.20 – 0.63], Z = 3.81, p < .001). Moderator analyses on the effect sizes “time” show stronger effects for subjects in the STEM area (science, technology, engineering, mathematics) than for foreign languages and humanities. The effect sizes were also higher for shorter intervention studies than for longer ones and if quiz at home had been left out. Moderator analyses on the effect sizes “post-test only” and “treatment” make clear that the effect sizes for intervention studies without a learning management system are higher than with a learning management system. Findings are discussed in terms of their implications for educational practice.
Zusammenfassung. In einer Metaanalyse (25 Artikel, k = 44 unabhängige Datenquellen, N = 2,323) wurde die Wirksamkeit des Unterrichtskonzepts „Flipped Classroom“ für Schülerleistungen in der Sekundarstufe untersucht. Flipped Classroom steht für einen Unterrichtsansatz, bei dem sich Schülerinnen und Schüler zuhause mithilfe von Erklärvideos neue Lerninhalte aneignen und im Unterricht anschließend dazu passende Aufgaben bearbeiten. Es wurden Effektstärken für die Forschungsdesigns „Nur Nachtest“, „Vortest-Nachtest (Zeit)“ und „Vortest-Nachtest mit Kontrollgruppe (Treatment)“ berechnet. Die meta-analytische Effektstärke für die Bedingung „Treatment“ bestätigt die Effektivität des Flipped Classroom-Konzepts im Vergleich zum traditionellen Unterricht (Cohen's d = 0.42, 95 % CI [0.20 – 0.63], Z = 3.81, p < .001). Moderatoranalysen der Effektstärken„Zeit“ zeigen stärkere Wirkungen für Fächer im MINT-Bereich (Mathematik, Informatik, Naturwissenschaften, Technik) als für fremdsprachliche und geisteswissenschaftliche Fächer. Die Effektstärken waren zudem bei kürzeren Interventionsstudien höher als bei längeren und wenn auf ein Lernquiz zuhause verzichtet wurde. Moderatoranalysen der Effektstärken „Nur Nachtest“ und „Treatment“ verdeutlichen, dass die Effektstärken bei Interventionsstudien ohne Lernmanagement-System höher ausfallen als mit Lernmanagement-System. Die Ergebnisse werden im Hinblick auf Implikationen für die Unterrichtspraxis diskutiert.
ReferencesReferences marked with an * were included in the meta-analysis.
(2017). Flipped learning for ESL writing in a Sudanese school. The Turkish Online Journal of Educational Technology, 16 (3), 60 – 70.*
(2015). Motivation and cognitive load in the flipped classroom: Definition, rationale and a call for research. Higher Education Research & Development, 34 (1), 1 – 14. https://doi.org/10.1080/07294360.2014.934336
(2017). An action research study from implementing the flipped classroom model in primary school history teaching and learning. Educational Technology & Society, 20 (1), 237 – 247.*
(2018). The flipped classroom: A review of its advantages and challenges. Computers & Education, 126, 334 – 345. https://doi.org/10.1016/j.compedu.2018.07.021
(2016). The flipped classroom impact in grammar class on EFL Saudi secondary school students' performances and attitudes. English Language Teaching, 9 (10), 60 – 80. https://doi.org/10.5539/elt.v9n10p60 *
(2012). Flip your classroom: Reach every student in every class every day. Washington: International Society for Technology in Education.
(2015). The flipped classroom: Fertile ground for nursing education research. International Journal of Nursing Education Scholarship, 12 (1), 33 – 43. https://doi.org/10.1515/ijnes-2015-0005
(2016). The evidence for “flipping out”: A systematic review of the flipped classroom in nursing education. Nurse Education Today, 38, 15 – 21. https://doi.org/10.1016/j.nedt.2015.12.010
(2016). The impact of the flipped classroom on mathematics concept learning in high school. Educational Technology & Society, 19 (3), 134 – 142.*
(2013). The flipped classroom: A survey of the research. In 120th ASEE national conference and exposition, Atlanta, GA (paper ID 6219). Washington, DC: American Society for Engineering Education.
(2007). Clickers in the large classroom: Current research and best-practice tips. CBE – Life Sciences Education, 6 (1), 9 – 20. https://doi.org/10.1187/cbe.06-12-0205
(2016). Effects of flipped instruction on the performance and attitude of high school students in mathematics. European Journal of STEM Education, 1 (2), 37 – 44. https://doi.org/10.20897/lectito.201620 *
(2015). Exploring students' learning attitude and achievement in flipped learning supported computer aided design curriculum: A study in high school engineering education. Computer Applications in Engineering Education, 23 (4), 514 – 526. https://doi.org/10.1002/cae.21622 *
(2017). A systematic review of the effectiveness of flipped classrooms in medical education. Medical Education, 51 (6), 585 – 597. https://doi.org/10.1111/medu.13272
(2018). Academic outcomes of flipped classroom learning: A meta-analysis. Medical Education, 52 (9), 910 – 924. https://doi.org/10.1111/medu.13616
(2018). Effects of the flipped classroom instructional strategy on students' learning outcomes: A meta-analysis. Educational Technology Research and Development. https://doi.org/10.1007/s11423-018-9633-7
(1983). Reconsidering research on learning from media. Review of Educational Research, 53 (4), 445 – 459. https://doi.org/10.2307/1170217
(2015). The effects of the flipped model of instruction on student engagement and performance in the secondary mathematics classroom. Journal of Educators Online, 12 (1), 91 – 115. https://doi.org/10.9743/JEO.2015.1.5 *
(2016). Flipped classrooms: a review of key ideas and recommendations for practice. Educational Psychology Review, 29 (1), 141 – 151. https://doi.org/10.1007/s10648-015-9356-9
(2017). The effect of the flipped classroom on urban high school students' motivation and academic achievement in a high school science course (doctoral dissertation). Retrieved from https://digitalcommons.liberty.edu/doctoral/1369/ *
(2000). Trim and fill: a simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics, 56 (2), 455 – 463. https://doi.org/10.1111/j.0006-341X.2000.00455.x
(1997). Bias in meta-analysis detected by a simple, graphical test. British Medical Journal, 315, 629 – 634. https://doi.org/10.1136/bmj.315.7109.629
(2013). A systematic review of the testing effect in learning. Paideia, 23 (56), 397 – 406. https://doi.org/10.1590/1982-43272356201314
(2016).
Flipped classroom model: effects on performance, attitudes and perceptions in high school algebra . In K. VerbertM. SharplesT. Klobucar (Eds.), Adaptive and adaptable learning: Lecture notes in computer science (Vol. 9891, pp. 85 – 97). Cham: Springer. https://doi.org/10.1007/978-3-319-45153-4_7 *(2016). Determining the effects of LMS learning behaviors on academic achievement in a learning analytic perspective. Journal of Information Technology Education: Research, 15, 75 – 87. https://doi.org/10.28945/3405
(2014).
Reviewing the flipped classroom research: Reflections for computer science education . In Proceedings of the Computer Science Education Research Conference (pp. 23 – 29). New York, NY: ACM. https://doi.org/10.1145/2691352.2691354(1981). Meta-analysis in social research. Beverly Hills, CA: Sage.
(2017). Flipping math in a secondary classroom. Journal of Computers in Mathematics and Science Teaching, 36 (1), 5 – 16. *
(2012). Visible learning for teachers. Maximizing impact on learning. New York: Routledge.
(2014). What the flip: impact of flipped instruction on self-regulated learning. International Journal of Social Media and Interactive Learning Environments, 2 (4), 303 – 325. https://doi.org/10.1504/IJSMILE.2014.067638
(2003). Measuring inconsistency in meta-analysis. British Medical Journal, 327 (7414), 557 – 560. https://doi.org/10.1136/bmj.327.7414.557
(2013). Effects of an inverted instructional delivery model on achievement of ninth-grade physical science honors (doctoral dissertation). Retrieved from https://digitalcommons.gardner-webb.edu/education_etd/35/ *
(2016). The effects of a flipped English classroom intervention on students' information and communication technology and English reading comprehension. Educational Technology Research and Development, 64 (2), 175 – 193. https://doi.org/10.1007/s11423-015-9412-7 *
(1980). Robust statistics. New York: John Wiley.
(2016).
A review of the literature on flipping the STEM classroom: Preliminary findings . In S. BarkerS. DawsonA. PardoC. Colvin (Eds.), Show me the learning (pp. 267 – 274). Adelaide: University of South Australia.(2017). Empowering students in the process of social inquiry learning through flipping the classroom. Educational Technology & Society, 20 (1), 306 – 322.*
(2016, October). Investigating the potential of the flipped classroom model in K-12 mathematics teaching and learning. Paper presented at 13th International conference on Cognition and Exploratory Learning in Digital Age (CELDA 2016), Mannheim, Germany.*
(2015). Flipping an algebra classroom: Analyzing, modeling and solving systems of linear equations. Computers in the Schools, 32 (3 – 4), 201 – 223. https://doi.org/10.1080/07380569.2015.1093902 *
(2014). Developing information literacy and critical thinking skills through domain knowledge learning in digital classrooms: An experience of practicing flipped classroom strategy. Computers & Education, 78, 160 – 173. https://doi.org/10.1016/j.compedu.2014.05.009
(2017). Investigating the potential of the flipped classroom model in K-12 ICT teaching and learning: An action research study. Educational Technology & Society, 20 (1), 261 – 273.*
(1983). Effects of computer-based teaching on secondary school students. Journal of Educational Psychology, 75 (1), 19 – 26. https://doi.org/10.1037/0022-0663.75.1.19
(2000). Inverting the classroom: A gateway to creating an inclusive learning environment. The Journal of Economic Education, 3 (1), 30 – 43. https://doi.org/10.2307/1183338
(2016). A self-regulated flipped classroom approach to improving students' learning performance in a mathematics course. Computers & Education, 100, 126 – 140. https://doi.org/10.1016/j.compedu.2016.05.006
(2018). Grounding the flipped classroom approach in the foundations of educational technology. Educational Technology Research and Development, 66 (3), 793 – 811. https://doi.org/10.1007/s11423-018-9578-x
(2017). Toward a set of design principles for mathematics flipped classrooms: A synthesis of research in mathematics education. Educational Research Review, 22 (1), 50 – 73. https://doi.org/10.1016/j.edurev.2017.08.002
(2017a). A critical review of flipped classroom challenges in K-12 education: possible solutions and recommendations for future research. Research and Practice in Technology Enhanced Learning, 12 (4), 1 – 22. https://doi.org/10.1186/s41039-016-0044-2
(2017b). Using “first principles of instruction” to design secondary school mathematics flipped classroom: The findings of two exploratory studies. Educational Technology & Society, 20 (1), 222 – 236.*
(2018). Applying “first principles of instruction” as a design theory of the flipped classroom: findings from a collective study of four secondary school subjects. Computers & Education, 118 (1), 150 – 165. https://doi.org/10.1016/j.compedu.2017.12.003 *
(2002). Multimedia learning. Psychology of Learning and Motivation: Advances in Research and Theory, 41, 85 – 139. https://doi.org/10.1016/S0079-7421(02)80005-6
(2018). Implementing flipped classroom that used an intelligent tutoring system into learning process. Computers & Education, 124, 62 – 76. https://doi.org/10.1016/j.compedu.2018.05.011
(2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLOS Medicine, 6 (7), e1000097. https://doi.org/10.1371/journal.pmed.1000097
(2015). The use of flipped classrooms in higher education: A scoping review. Internet and Higher Education, 25, 85 – 95. https://doi.org/10.1016/j.iheduc.2015.02.002
(2017). The effects of a flipped classroom model of instruction on students' performance and attitudes towards chemistry. Journal of Science Education and Technology, 26(1), 127 – 137. https://doi.org/10.1007/s10956-016-9657-x *
(2018). Learning management system and the underlying learning theories: towards a new modeling of an LMS. International Journal of Information Science & Technology, 2 (1), 25 – 33. https://doi.org/10.1007/978-3-319-74500-8_67
(2003). Cognitive load theory and instructional design: recent developments. Educational Psychologist, 38 (1), 1 – 4. https://doi.org/10.1207/S15326985EP3801_1
(2014). Flipped classroom as educational technique to teach math on a competencies-based approach: Case study. In Proceedings of the Latin American Conference on Learning Objects and Technologies (pp. 166 – 176). Manizales: LACLO.*
(2006). The power of testing memory: Basic research and implications for educational practice. Perspectives on Psychological Science, 1 (3), 181 – 210. https://doi.org/10.1111/j.1745-6916.2006.00012.x
(2015). Methods of meta-analysis (3rd ed.). Thousand Oaks: Sage.
(2014). Effects of the flipped classroom model on student performance for advanced placement high school chemistry students. Journal of Chemical Education, 91 (9), 1334 – 1339. https://doi.org/10.1021/ed400868x *
(2015). Flipped learning in higher education chemistry: emerging trends and potential directions. Chemistry Education Research and Practice, 16 (4), 758 – 768. https://doi.org/10.1039/C5RP00136F
(2017). The effectiveness of a technology-enhanced flipped science classroom. Journal of Educational Computing Research, 55 (4), 471 – 494. https://doi.org/10.1177/0735633116671325 *
(2015). The efficacy of a flipped learning classroom (doctoral dissertation). Retrieved from https://kenanaonline.com/files/0102/102661/THE%20EFFICACY%20OF%20A%20FLIPPED%20LEARNING%20CLASSROOM.pdf *
(1960).
A survey of sampling from contaminated contributions . In I. OlkinJ. G. GhuryeW. HoeffdingW. G. MadooH. Mann (Eds.), Contributions to probability and statistics (pp. 448 – 485). Stanford, CA: Stanford University Press.(2010). Conducting meta-analyses in R with the metafor package. Journal of Statistical Software, 36 (3), 1 – 48. https://doi.org/10.18637/jss.v036.i03
(2010). Outlier and influence diagnostics for meta-analysis. Research Synthesis Methods, 1 (2), 112 – 125. https://doi.org/10.1002/jrsm.11
-L.(2010, August 10). Meta-analysis macros for SAS, SPSS, and STATA. Retrieved from http://mason.gmu.edu/~dwilsonb/ma.html
(2017). An investigation of the use of the “flipped classroom” pedagogy in secondary English language classrooms. Journal of Information Technology Education: Innovations in Practice, 16, 1 – 20.*
(2018). The effect of the metacognitive support via pedagogical agent on self-regulation skills. Journal of Educational Computing Research, 56 (2), 159 – 180. https://doi.org/10.1177/0735633117707696
(2015). The effect of flipped learning (revised learning) on Iranian students' learning outcomes. Advances in Language and Literary Studies, 6 (5), 209 – 213. https://doi.org/10.7575/aiac.alls.v.6n.5p. 209 *
(2016). The flipped classroom, a review of the literature. Industrial and Commercial Training, 48 (2), 97 – 103. https://doi.org/10.1108/ICT-05-2015-0039