A Deeper Understanding of Metacomprehension: Development of a New Multidimensional Tool

Main Article Content

Christian Soto
Antonio P. Gutierrez de Blume
Rodrigo Asun
Matthew Jacovina
Claudio Vasquez

Abstract

The purpose of this research endeavor was to develop and validate a new measurement tool predicated on previous research to assess learners’ metacomprehension during reading. In two separate studies (N = 923) with Chilean undergraduate students, we demonstrate the versatility and utility of our proposed Metacomprehension Inventory (MI). In Study 1, we provide empirical support for the psychometric soundness and construct validity of the MI. In Study 2, we provide evidence of the measurement invariance of the MI between males and females. Results of Study 1 revealed the hypothesized factor structure of the MI is sound, with high factor loadings, excellent model fit, and moderate-to-strong inter-factor correlations. Study 2 results indicated that the MI is interpreted similarly by both males and females, as factor loadings were largely statistically identical across the two groups. We discuss implications of our proposed MI for theory and applied research.

Article Details

How to Cite
Soto, C., Gutierrez de Blume, A. P., Asun, R., Jacovina, M., & Vasquez, C. (2018). A Deeper Understanding of Metacomprehension: Development of a New Multidimensional Tool. Frontline Learning Research, 6(1), 31–52. https://doi.org/10.14786/flr.v6i1.328
Section
Articles

References

Ackerman, J., Nocera, C., & Bargh, J. (2010). Incidental Haptic Sensations Influence Social Judgments and Decisions. Science, 328, 1712-1715. doi: 10.1126/science.1189993

Asún, R. A., Rdz-Navarro, K., & Alvarado, J. M. (2016).Developing multidimensional Likert scales using item factor analysis: The case of four-point items. Sociological Methods and Research, 45(1), 109-133. doi: 10.1177/0049124114566716

Azevedo, R., & Aleven, V. (2013). International handbook of metacognition and learning technologies. New York: Springer.

Azevedo, R. (2009). Theoretical, methodological and analytical challenges in the research on metacognition and self-regulation: A commentary. Metacognition & Learning, 4, 87-95. doi: 10.1007/s11409-009-9035-7

Baker, L. (2002). Metacognition in comprehension instruction. In Block, C. C. & Pressley, M. (Eds.), Comprehension Instruction: Research-based best Practices (pp. 77-95). New York: The Guil-ford Press.

Beck, I.L. & McKeown, M.G. (1998). Comprehension: The sine qua non of reading. In S. Patton & M. Holmes (Eds.), The keys to literacy (pp. 40-52). Washington, DC: Council for Basic Education.

Beck, I.L. & McKeown, M.G. (2006). Improving comprehension with questioning the author: A fresh and expanded view of a powerful approach. New York, N.Y: Scholastic.

Beck, I.L. & McKeown, M.G. (2009). The role of metacognition in understanding and supporting reading comprehension. In D. J. Hacker, J. Dunlosky, & A. C. Graesser (Eds.), Handbook of Metacognition in Education. The Educational Psychology Series (pp. 7-25). Mahwah, NJ: Lawrence Erlbaum Associates.

Bembenutty, H. (2007). Self-regulation of learning and academic delay of gratification: Gender and ethnic differences among college students. Journal of Advanced Academics, 18(4), 586-616.

Block, C. C., & Pressley, M. (2007) Best practices in teaching comprehension. In L.B. Gambrell, L. M. Morrow, & M. Pressley (Eds.), Best practices in literacy instruction (pp. 220–242). New York: Guilford.

Boekaerts, M. (1999) Self-regulated learning: where we are today. International Journal of Educational Research 31(6), 445-457. doi: 10.1016/S0883-0355(99)00014-2

Bol, L., & Hacker, D. J. (2001). A comparison of the effects of practice tests and traditional review on performance and calibration. The Journal of Experimental Education, 69(2), 133-151. doi: 10.1080/00220970109600653

Bol, L., Hacker, D. J., O’Shea, P., & Allen, D. (2005). The influence of overt practice, achievement level, and explanatory style on calibration accuracy and performance. The Journal of Experimental Education, 73(4), 269-290. doi: 10.3200/JEXE.73.4.269-290

Brown, A. L., Armbruster, B. B. & Baker, L. (1986). The role of metacognition in reading and studying. In Orasanu, J. (Ed.), Reading Comprehension: From Research to Practice. Hillsdale, NJ: Lawrence Erlbaum.

Bussey, K., & Bandura, A. (1999). Social cognitive theory of gender development and differentiation. Psychological Review, 106(4), 676-713.

Chemolli, E. & Gagné, M. (2014). Evidence against the continuum structure underlying motivation measures derived from self-determination theory. Psychological Assessment, 26(2), 575-585. doi: 10.1037/a0036212

Denham S. A., Warren-Khot H. K., Bassett H. H., Wyatt T., Perna A. (2012). Factor structure of self-regulation in preschoolers: testing models of a field-based assessment for predicting early school readiness. Journal of Experimental Child Psychology, 111(3), 386-404. doi: 10.1016/j.jecp.2011.10.002

Dunlosky, J., Rawson, K.A., & McDonald (2002). Influence of practice tests on the accuracy of predicting memory performance for paired associates, sentences, and text material. In T.J. Perfect & B.L. Schwartz (Eds.), Applied Metacognition (pp. 68-92). New York, NY: Cambridge University Press.

Dunlosky, J., Griffin, T., Thiede, K. & Wiley, J. (2005). Understanding the delayed keyword effect on metacomprehension accuracy. Journal of Experimental Psychology: Learning, Memory & Cognition, 31, 1267-1280. doi: 10.1037/0278-7393.31.6.1267

Dunlosky, J., & Lipko, A.R. (2007). Metacomprehension: A brief history and how to improve its accuracy. Current Directions in Psychological Science, 16(4), 228-232. doi: 10.1111/j.1467-8721.2007.00509.x

Flavell, J. (1979). Metacognition and cognitive monitoring: A new area of cognitive–developmental inquiry. American Psychologist, 34(10), 906-911.

Flavell, J. H., & Wellman, H. M. (1977). Metamemory. In R. V. Kail y J. W. Hagen (Eds.), Perspectives on the Development of Memory and Cognition. Hillsdale, N.J.: Erlbaum.

Forero, Maydeu-Olivares and Gallardo-Pujol, (2009). Factor Analysis with Ordinal Indicators: A Monte Carlo study DWLS and ULS estimation. Structural Equation Modeling: A Multidisciplinary Journal, 16, 625-641. doi: 10.1080/10705510903203573

Guay, F., Ratelle, C., Roy, A., & Litalien, D. (2010). Academic self-concept, autonomous academic motivation, and academic achievement: Mediating and additive effects. Learning and Individual Differences, 20 (6), 644-653. doi: 10.1016/j.lindif.2010.08.001

Gutierrez, A. P., & Price, A. F. (2017). Calibration between undergraduate students’ prediction of and actual performance: The role of gender and performance attributions. The Journal of Experimental Education,85, 486-500. doi: 10.1080/00220973.2016.1180278

Gutierrez, A. P., & Schraw, G. (2015). Effects of strategy training and incentives on students’ performance, confidence, and calibration. The Journal of Experimental Education, 83(3) 386-404. doi: 10.1080/2331186X.2017.1314652

Hacker, D., Plumb, C., Butterfield, E., Quathamer, D., & Heineken, E. (1994). Text revision: Detection and corrections of errors. Journal of Educational Psychology, 86, 65-78.

Hacker, D. (1998). Definitions and empirical foundations. In D. Hacker, J. Dunlosky, & A. Graesser (Eds.), Metacognition in educational theory and practice. Mahwah, NJ: Erlbaum.

Hacker, D., Bol, L., & Bahbahani, K. (2008). Explaining calibration in classroom context. The effects of incentives, reflection, and attributional style. Metacognition and Learning, 3, 101-121. doi: 10.1080/2331186X.2017.1314652

Hacker D. J., Dunlosky J., Graesser A. C. (2009), Handbook of metacognition in education. New York: Routledge.

Jacobs, J. E., and Paris, S. G. (1987). Children’s metacognition about reading: Issues in definition, measurement, and instruction. Educational Psychologist. 22 (3&4) 255–278.

Jiménez, V., Puente, A., Alvarado, J., & Arrebillaga, L. (2009) Medición de estrategias metacognitivas mediante la Escala de Conciencia Lectora: ESCOLA. Electronic Journal of Research in Educational Psychology,7(2), 779-804.

Keener, M. C., & Hacker D. J. (2012). Comprehension monitoring. In N. M. Norbert (Ed.), Encyclopedia of the sciences of learning. New York, NY: Springer.

Klaasen, R., & Chiu, M. (2010). Effects on teachers' self-efficacy and job satisfaction: Teacher gender, years of experience, and job stress. Journal of Educational Psychology, 102(3), 741-756. doi: 10.1037/a0019237

Little, R.J. & Rubin, D.B. (1989). The analysis of social science data with missing values. Sociological Methods and Research, 18 (2&3), 292-326.
McDonald, R.P. (1985). Factor analysis and related methods. Hillsdale NJ: Erlbaum.

Mokhtari, K., & Reichard, C. (2002). Assessing students’ metacognitive awareness of reading strategies. Journal of Educational Psychology, 94(2), 249-259. doi: 10.1037/0022-0663.94.2.249

Morin, A., Arens, K., & Marsh, H. (2016). A Bifactor Exploratory Structural Equation Modeling Framework for the Identification of Distinct Sources of Construct-Relevant Psychometric Multidimensionality. Structural Equation Modeling: A Multidisciplinary Journal 23 (1), 116-139. doi: 10.1080/10705511.2014.961800

Morin, A., Arens, K., Tran, A. & Caci, H. (2016) Exploring sources of construct-relevant multidimensionality in psychiatric measurement: A tutorial and illustration using the Composite Scale of Morningness. International Journal of Methods in Psychiatric Research 25 (4), 277–288. doi: 10.1002/mpr.1485

Muthen, L. K., & Muthen, B. O. (1998–2011). Mplus user’s guide (6th ed.). Los Angeles, CA: Muthen & Muthen.

Nietfeld, J., Shores, L., & Hoffman, K. (2014). Self-regulation and gender within a game-based learning environment, Journal of Educational Psychology, 106(4), 961-973. doi:10.1037/a0037116

Özsoy, G. (2012). Investigation of fifth grade students’ mathematical calibration skills. Educational Sciences: Theory and Practice, 12(2), 1190–1194.

Paris, S. G. & Jacobs, J. E. (1984). The benefits of informed strategies for learning: A program to improve children's reading awareness and comprehension. Journal of Educational Psychology, 76 (6), 1239-1252.

Paris, S.G. & Paris, A.H. (2001). Classroom Applications of Research on Self-Regulated Learning. Educational Psychologist, 36(2), 89-101. doi: 10.1207/S15326985EP3602_4

Pintrich P. & De Groot, E. (1990). Motivational and Self-Regulated Learning Components of Classroom Academic Performance. Journal of Educational Psychology 82 (1), 33-40.

Pressley, M., & Afflerbach, P. (1995). Verbal protocols of reading: The nature of constructively responsive reading. Hillsdale NJ: Lawrence Erlbaum Associates Inc.

Pressley, M., & Block, C. C. (2002). Summing up: What comprehension instruction could be. In C. C. Block & M. Pressley (Eds.), Comprehension instruction: Research-based best practices. New York: Guilford Press.

Puente, A., Jiménez, V. & Alvarado, J.M. (2009) Escala de conciencia lectora (ESCOLA). Evaluación e intervención psicoeducativa de procesos y variables metacognitivas durante la lectura. Madrid: EOS.

Redford, J., Thiede, K., Wiley, J. & Griffin, T. (2012).Concept mapping improves metacomprehension accuracy among 7th graders. Learning and Instruction, 22 (4), 262-270. doi: doi:10.1016/j.learninstruc.2011.10.007

Sandora, C., Beck, I., & McKeown, M. (1999). A comparison of two discussion strategies on students' comprehension and interpretation of complex literature. Journal of Reading Psychology, 20 (3), 177-212.

Schaeffer, J. & Graham, J. (2002). Missing Data: Our View of the State of the Art. Psychological Methods, 7 (2), 147-177.

Schmidt, R. (1990). The Role of Consciousness in Second Language Learning. Applied Linguistics, 11 (2), 129-158.

Schraw, G., & Dennison, R. S. (1994). Assessing metacognitive awareness. Contemporary Educational Psychology, 19 (4), 460-475.

Schraw, G., & Moshman, D. (1995). Metacognitive theories. Educational Psychology Review, 7 (4), 351-371.

Sharma, M. D & Bewes, J. (2011). Self-monitoring: confidence, academic achievement and gender differences in physics. Journal of Learning Design, 4, (3), 1-13.

Sheldrake, R., Mujtaba, T., & Reiss, M. (2014). Calibration of self-evaluations of mathematical ability for students in England aged 13 and 15, and their intentions to study non-compulsory mathematics after age 16. International Journal of Educational Research, 64, 49-61. doi: 10.1016/j.ijer.2013.10.008

Swanson, H. L. (1990). Influence of metacognitive knowledge and aptitude on problem solving. Journal of Educational Psychology, 82 (2), 306-314.

Tabachnick, B. G., & Fidell, L. S. (2013). Using multivariate statistics (6th ed.). Boston: Pearson.

Thiede, K., Griffin, T., Wiley, J. & Redford, J. (2009). Metacognitive Monitoring During and After Reading. In J. Dunlosky, A. Graesser & J. Hacker (Eds.), Handbook of Metacognition in Education. New York: Routledge.