Students’ observed engagement in lessons, instructional activities, and learning experiences

Article Sidebar

HTML PDF Listen
Published: Sep 16, 2020
DOI: https://doi.org/10.14786/flr.v8i6.613

Main Article Content

Christina Hubertina Helena Maria Heemskerk
University of Oxford, United Kingdom
Lars-Erik Malmberg
University of Oxford, United Kingdom

Abstract


In order to expand previous intraindividual studies of student engagement we investigated students' observed engagement (i.e., on- and off-task behaviour), instructional activities (i.e., teacher-led whole class, individual work, pair-work, student-teacher interaction, assessment, and ”other”), and self-reported learning experiences (cognitive engagement, difficulty, competence, emotional engagement, positive and negative emotions), within lessons during one calendar week. Eighteen fourth and fifth grade target students (Mage=10.1, SD=0.44) were observed every 30 sec during two to four lessons each day for five school days (engagement and instructional activities), on average 66.05 times per lesson (SD=19.16, Range=15-80, nobs=14,994) between 9-18 lessons during a week. Simultaneously, students provided 1-3 electronic questionnaire self-reports per lesson (Mself_report=35.1, SD=12.6, Range=19-52, nself_report=631). We regressed observed engagement (0 = off-task, 1 = on-task) on self-reported learning experiences using 3-level (time-points nested in lessons, nested in students) Bayesian logistic regression models in brms. Observed engagement diminished during lessons, and was predicted by higher cognitive engagement, and instructional activities. As compared to teacher-led instruction, engagement was higher during individual tasks, teacher-supported tasks, and assessments. Overall self-reported and observed engagement within lessons converged, supporting their use in intraindividual research.


Article Details

How to Cite
Heemskerk, C. H. H. M., & Malmberg, L.-E. (2020). Students’ observed engagement in lessons, instructional activities, and learning experiences. Frontline Learning Research, 8(6), 38–58. https://doi.org/10.14786/flr.v8i6.613
Issue
Vol. 8 No. 6 (2020): Frontline Learning Research
Section
Articles

FLR adopts the Attribution-NonCommercial-NoDerivs Creative Common License (BY-NC-ND). That is, Copyright for articles published in this journal is retained by the authors with, however, first publication rights granted to the journal. By virtue of their appearance in this open access journal, articles are free to use, with proper attribution, in educational and other non-commercial settings.

References

Bandura, A. (1997) Self-efficacy: the exercise of control, New York: W.H. Freeman.

Bandura, A. (2008) Toward an agentic theory of the self. In: Marsh, H.W., Craven, R.G. and McInerney, D.M. (eds) Self-processes, learning, and enabling human potential: dynamic new approaches. Charlotte, NC: Information Age Publishing, pp.15-49.

Barros, R.M., Silver, E.J. and Stein, R.E. (2009) 'School recess and group classroom behavior'. Pediatrics 123(2) pp.431-436. DOI: 10.1542/peds.2007-2825.

Boekaerts, M. and Corno, L. (2005) 'Self‐Regulation in the Classroom: A Perspective on Assessment and Intervention'. Applied Psychology 54(2) pp.199-231. DOI: 10.1111/j.1464-0597.2005.00205.x.

Brincks, A.M., Enders, C.K., Llabre, M.M., Bulotsky-Shearer, R.J., Prado, G. and Feaster, D.J. (2017) 'Centering Predictor Variables in Three-Level Contextual Models'. Multivariate Behavioral Research 52(2) pp.149-163. DOI: 10.1080/00273171.2016.1256753.

Bürkner, P.-C. (2017) 'brms: An R Package for Bayesian Multilevel Models Using Stan'. Journal of Statistical Software 80(1) pp.1-28. DOI: 10.18637/jss.v080.i01.

Bürkner, P.-C. (2018) 'Advanced Bayesian Multilevel Modeling with the R Package brms'. The R Journal 10(1). DOI: 10.32614/RJ-2018-017.

Carlson, J.A., Engelberg, J.K., Cain, K.L., Conway, T.L., Mignano, A.M., Bonilla, E.A., Geremia, C. and Sallis, J.F. (2015) 'Implementing classroom physical activity breaks: Associations with student physical activity and classroom behavior'. Preventive medicine 81 pp.67-72. DOI: 10.1016/j.ypmed.2015.08.006.

Collie, R.J. and Martin, A.J. (2019) Motivation and engagement in learning. Oxford Research Encyclopedia of Education. New York: Oxford University Press.

Den Brok, P., Levy, J., Brekelmans, M. and Wubbels, T. (2005) 'The effect of teacher interpersonal behaviour on students' subject-specific motivation'. The Journal of Classroom Interaction 40.

Dignath, C., Buettner, G. and Langfeldt, H.-P. (2008) 'How can primary school students learn self-regulated learning strategies most effectively?'. Educational Research Review 3(2) pp.101-129. DOI: 10.1016/j.edurev.2008.02.003.

Field, A. (2013) Discovering Statistics Using IBM SPSS Statistics, London: SAGE.

Fredricks, J.A., Blumenfeld, P.C. and Paris, A.H. (2004) 'School Engagement: Potential of the Concept, State of the Evidence'. Review of Educational Research 74(1) pp.59-109. DOI: 10.3102/00346543074001059.

Godwin, K.E., Almeda, M., Petroccia, M., Baker, R.S. and Fisher, A.V. (2013) 'Classroom activities and off-task behavior in elementary school children', 35th Annual Conference of the Cognitive Science Society. Austin, Tx, Cognitive Science Society. pp.2428-2433.

Godwin, K.E. and Fisher, A.V. (2011) 'Allocation of Attention in Classroom Environments: Consequences for Learning', 33rd Annual Conference of the Cognitive Science Society. Austin, Tx, Cognitive Science Society. pp.2806-2811.

Goetz, T., Pekrun, R., Hall, N. and Haag, L. (2006) 'Academic emotions from a social-cognitive perspective: Antecedents and domain specificity of students' affect in the context of Latin instruction'. British Journal of Educational Psychology 76 pp.289-308. DOI: 10.1348/000709905X42860.

Goetz, T., Sticca, F., Pekrun, R., Murayama, K. and Elliot, A.J. (2016) 'Intraindividual relations between achievement goals and discrete achievement emotions: An experience sampling approach'. Learning and Instruction 41(C) pp.115-125. DOI: 10.1016/j.learninstruc.2015.10.007.

Grieco, L.A., Jowers, E.M. and Bartholomew, J.B. (2009) 'Physically active academic lessons and time on task: the moderating effect of body mass index'. Medicine and Science in Sports and Exercise 41(10) pp.1921-1926. DOI: 10.1249/MSS.0b013e3181a61495.

Hamaker, E.L. (2012) Why researchers should think "within-person": A pragmatic rationale. In: Mehl, M.R. and Conner, T.S. (eds) Handbook of research methods for studying daily life. London: Guilford Press, pp.43-61.

Hamaker, E.L., Nesselroade, J.R. and Molenaar, P.C.M. (2007) 'The integrated trait–state model'. Journal of research in personality 41(2) pp.295-315. DOI: 10.1016/j.jrp.2006.04.003.

Hattie, J. (2009) Visible Learning, Abingdon: Routledge.

Hospel, V., Galand, B. and Janosz, M. (2016) 'Multidimensionality of behavioural engagement: Empirical support and implications'. International Journal of Educational Research 77 pp.37-49. DOI: https://doi.org/10.1016/j.ijer.2016.02.007.

Hox, J.J., Van de Schoot, R. and Matthijsse, S. (2012) 'How few countries will do? Comparative survey analysis from a Bayesian perspective'. Survey Research Methods 6(2) pp.87. DOI: 10.18148/srm/2012.v6i2.5033.

Inkinen, M., Lonka, K., Hakkarainen, K., Muukkonen, H., Litmanen, T. and Salmela-Aro, K. (2013) 'The Interface Between Core Affects and the Challenge– Skill Relationship'. Journal of Happiness Studies 15 pp.891-913. DOI: 10.1007/s10902-013-9455-6.

Jarrett, O.S., Maxwell, D.M., Dickerson, C., Hoge, P., Davies, G. and Yetley, A. (1998) 'Impact of Recess on Classroom Behavior: Group Effects and Individual Differences'. The Journal of Educational Research 92(2) pp.121-126. DOI: 10.1080/00220679809597584.

La Paro, K.M. and Pianta, R.C. (2000) 'Predicting Children's Competence in the Early School Years: A Meta-Analytic Review'. Review of Educational Research 70(4) pp.443-484. DOI: 10.3102/00346543070004443.

Little, T.D. (1998) Sociocultural influences on the development of children’s action-control beliefs. In: Heckhausen, J. and Dweck, C.S. (eds) Motivation and self-regulation across the life span. Cambridge, USA: Cambridge University Press, pp.281-315.

Malmberg, L.-E., Hagger, H., Burn, K., Mutton, T. and Colls, H. (2010) 'Observed classroom quality during teacher education and two years of professional practice'. Journal of Educational Psychology 102(4) pp.916-932. DOI: 10.1037/a0020920.

Malmberg, L.-E. and Martin, A.J. (2019) 'Processes of students’ effort exertion, competence beliefs and motivation: Cyclic and dynamic effects of learning experiences within school days and school subjects'. Contemporary Educational Psychology 58 pp.299-309. DOI: 10.1016/j.cedpsych.2019.03.013.

Malmberg, L.-E., Walls, T.A., Martin, A.J., Little, T.D. and Lim, W.H.T. (2013a) 'Primary school students' learning experiences of, and self-beliefs about competence, effort, and difficulty: Random effects models'. Learning and Individual Differences 28 pp.54-65. DOI: https://doi.org/10.1016/j.lindif.2013.09.007.

Malmberg, L.-E., Woolgar, C. and Martin, A.J. (2013b) 'Quality of measurement of the learning experience questionnaire for personal digital assistants'. International journal of quantitative research in education 1(3) pp.275-296.

Martin, A.J. (2007) 'Examining a multidimensional model of student motivation and engagement using a construct validation approach'. The British journal of educational psychology 77(2) pp.413-440. DOI: 10.1348/000709906X118036.

Martin, A.J., Ginns, P. and Papworth, B. (2017) 'Motivation and engagement: Same or different? Does it matter?'. Learning and Individual Differences 55 pp.150-162. DOI: 10.1016/j.lindif.2017.03.013.

Martin, A.J., Papworth, B., Ginns, P., Malmberg, L.-E., Collie, R.J. and Calvo, R.A. (2015) 'Real-time motivation and engagement during a month at school: Every moment of every day for every student matters'. Learning and Individual Differences 38(Supplement C) pp.26-35. DOI: https://doi.org/10.1016/j.lindif.2015.01.014.

McDonald, R.P. (1999) Test theory: A unified treatment, Hillsdale: Erlbaum.

Merlo, J., Chaix, B., Ohlsson, H., Beckman, A., Johnell, K., Hjerpe, P., Råstam, L. and Larsen, K. (2006) 'A brief conceptual tutorial of multilevel analysis in social epidemiology: using measures of clustering in multilevel logistic regression to investigate contextual phenomena'. Journal of Epidemiology and Community Health 60(4) pp.290. DOI: 10.1136/jech.2004.029454.

Moineddin, R., Matheson, F. and Glazier, R.H. (2007) 'A simulation study of sample size for multilevel logistic regression models'. BMC Med. Res. Methodol. 7(1). DOI: 10.1186/1471-2288-7-34.

Mood, C. (2010) 'Logistic Regression: Why We Cannot Do What We Think We Can Do, and What We Can Do About It'. European Sociological Review 26(1) pp.67-82. DOI: 10.1093/esr/jcp006.

Newton, D.P. (2013) 'Moods, emotions and creative thinking: A framework for teaching'. Thinking Skills and Creativity 8(Supplement C) pp.34-44. DOI: https://doi.org/10.1016/j.tsc.2012.05.006.

Patall, E.A., Vasquez, A.C., Steingut, R.R., Trimble, S.S. and Pituch, K.A. (2016) 'Daily interest, engagement, and autonomy support in the high school science classroom'. Contemporary Educational Psychology 46 pp.180-194. DOI: 10.1016/j.cedpsych.2016.06.002.

Patall, E.A., Vasquez, A.C., Steingut, R.R., Trimble, S.S. and Pituch, K.A. (2017) 'Supporting and Thwarting Autonomy in the High School Science Classroom'. Cognition and Instruction 35(4) pp.337-362. DOI: 10.1080/07370008.2017.1358722.

Pekrun, R. (2006) 'The Control-Value Theory of Achievement Emotions: Assumptions, Corollaries, and Implications for Educational Research and Practice'. Educational Psychology Review 18(4) pp.315-341. DOI: 10.1007/s10648-006-9029-9.

Pellegrini, A.D. and Davis, P. (1993) 'Relations between children's playground and classroom behaviour'. British Journal of Educational Psychology 63(1) pp.88-95. DOI: 10.1111/j.2044-8279.1993.tb01043.x.

Pellegrini, A.D., Huberty, P.D. and Jones, I. (1995) 'The Effects of Recess Timing on Children's Playground and Classroom Behaviors'. American Educational Research Journal 32(4) pp.845-864. DOI: 10.3102/00028312032004845.

Pietarinen, J., Soini, T. and Pyhältö, K. (2014) 'Students’ emotional and cognitive engagement as the determinants of well-being and achievement in school'. International Journal of Educational Research 67 pp.40-51. DOI: https://doi.org/10.1016/j.ijer.2014.05.001.

Pöysä, S., Vasalampi, K., Muotka, J., Lerkkanen, M.-K., Poikkeus, A.-M. and Nurmi, J.-E. (2017) 'Variation in situation-specific engagement among lower secondary school students'. Learning and Instruction 53(Supplement C) pp.64-73. DOI: https://doi.org/10.1016/j.learninstruc.2017.07.007.

Pöysä, S., Vasalampi, K., Muotka, J., Lerkkanen, M.K., Poikkeus, A.M. and Nurmi, J.E. (2019) 'Teacher–student interaction and lower secondary school students’ situational engagement'. British Journal of Educational Psychology 89(2) pp.374-392. DOI: 10.1111/bjep.12244.

Praetorius, A.-K., Lenske, G. and Helmke, A. (2012) 'Observer ratings of instructional quality: Do they fulfill what they promise?'. Learning and Instruction 22(6) pp.387-400. DOI: 10.1016/j.learninstruc.2012.03.002.

Rock, M.L. (2005) 'Use of Strategic Self-Monitoring to Enhance Academic Engagement, Productivity, and Accuracy of Students With and Without Exceptionalities'. Journal of Positive Behavior Interventions 7(1) pp.3-17. DOI: 10.1177/10983007050070010201.

Roorda, D.L., Koomen, H.M.Y., Spilt, J.L. and Oort, F.J. (2011) 'The Influence of Affective Teacher–Student Relationships on Students’ School Engagement and Achievement'. Review of Educational Research 81(4) pp.493-529. DOI: 10.3102/0034654311421793.

Rozi, S., Mahmud, S., Lancaster, G., Hadden, W. and Pappas, G. (2017) 'Multilevel Modeling of Binary Outcomes with Three-Level Complex Health Survey Data'. Open Journal of Epidemiology 7(1) pp.17. DOI: 10.4236/ojepi.2017.71004.

Ryan, R. and Deci, E. (2000) 'Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being'. American Psychologist 55(1) pp.68-78. DOI: 10.1037/0003-066x.55.1.68.

Schmitz, B. (2006) 'Advantages of studying processes in educational research'. Learning and Instruction 16(5) pp.433-449. DOI: 10.1016/j.learninstruc.2006.09.004.

Schmitz, B. and Skinner, E. (1993) 'Perceived Control, Effort, and Academic Performance: Interindividual, Intraindividual, and Multivariate Time-Series Analyses'. Journal of Personality and Social Psychology 64(6) pp.1010. DOI: 10.1037/0022-3514.64.6.1010.

Shernoff, D.J., Kelly, S., Tonks, S.M., Anderson, B., Cavanagh, R.F., Sinha, S. and Abdi, B. (2016) 'Student engagement as a function of environmental complexity in high school classrooms'. Learning and Instruction 43(C) pp.52-60. DOI: 10.1016/j.learninstruc.2015.12.003.

Skinner, E.A., Zimmer-Gembeck, M.J. and Connell, J.P. (1998) 'Individual differences and the development of perceived control - Introduction and overview'. Monographs of the Society for Research in Child Development 63(254). DOI: 10.2307/1166220.

Tsai, Y.-M., Kunter, M., Lüdtke, O. and Trautwein, U. (2008) Day-to-day variation in competence beliefs: How autonomy support predicts young adolescents’ felt competence. In: Marsh, H.W., Craven, R.G. and McInerney, D.M. (eds) Self-processes, learning, and enabling human potential: dynamic new approaches. Charlotte, NC: Information Age Pub., pp.119-120.

Valentine, J.C., Dubois, D.L. and Cooper, H. (2004) 'The Relation Between Self-Beliefs and Academic Achievement: A Meta-Analytic Review'. Educational Psychologist 39(2) pp.111-133. DOI: 10.1207/s15326985ep3902_3.

Wang, M.-T., Willett, J.B. and Eccles, J.S. (2011) 'The assessment of school engagement: Examining dimensionality and measurement invariance by gender and race/ethnicity'. Journal of School Psychology 49(4) pp.465-480. DOI: 10.1016/j.jsp.2011.04.001.

Watson, A., Timperio, A., Brown, H., Hinkley, T. and Hesketh, K.D. (2019) 'Associations between organised sport participation and classroom behaviour outcomes among primary school-aged children'. PLoS One 14(1). DOI: 10.1371/journal.pone.0209354.

Watson, D. and Tellegen, A. (1985) 'Toward a consensual structure of mood'. Psychological Bulletin 98(2) pp.219. DOI: 10.1037/0033-2909.98.2.219.

Wilhelm, P., Perrez, M. and Pawlik, K. (2012) Conducting research in daily life. In: Mehl, M.R. and Conner, T.S. (eds) Handbook of research methods for studying daily life. London: Guilford Press, pp.62-86.

Wubbels, T., Brekelmans, M., Den Brok, P., Wijsman, L., Mainhard, T. and Van Tartwijk, J. (2015) Teacher-student relationships and classroom management. In: Emmer, E.T. and Sabornie, E.J. (eds) Handbook of classroom management. Second edition ed. New York: Routledge, pp.363-386.

Zakszeski, B.N., Hojnoski, R.L. and Wood, B.K. (2017) 'Considerations for Time Sampling Interval Durations in the Measurement of Young Children's Classroom Engagement'. Topics In Early Childhood Special Education 37(1) pp.42-53. DOI: 10.1177/0271121416659054.

Zitzmann, S., Lüdtke, O., Robitzsch, A. and Marsh, H.W. (2016) 'A Bayesian Approach for Estimating Multilevel Latent Contextual Models'. Structural Equation Modeling: A Multidisciplinary Journal 23(5) pp.661-679. DOI: 10.1080/10705511.2016.1207179.