Analysis of person-situation interactions in educational settings via cross-classified multilevel longitudinal modeling: illustrated with the example of students’ stress experience

Main Article Content

Tobias Kärner
Detlef Sembill
Christian Aßmann
Edgar Friederichs
Claus H. Carstensen

Abstract

The investigation of learning processes by assessing students’ experience along with objective characteristics within a classroom context has a long tradition in empirical learning process research (e.g. Sembill, 1984 et passim; Wild & Krapp, 1996). However, most of the existing studies confine themselves to psychological variables that seem to be too narrowly considered, as there is theoretical and empirical evidence proving the involvement of somatic and psychological processes in learning and in stress reactions. Furthermore there is a lack of studies that investigate situation-related experience (states) as an outcome of interactions between relatively stable characteristics (traits) and continuously changing “objective” context conditions. Against this background, we will present an approach for cross-classified multilevel longitudinal modelling of person-situation interactions in naturalistic educational settings. We illustrated our model with the example of students’ stress experience referring to empirical data that we measured within a multidisciplinary research project (pedagogy, psychology, adolescent medicine). 53 students at a public German vocational school were investigated during 9 lessons. There are up to 38 state measurements per person, resulting in 2,014 measurements in total. Taking into account that states are nested within persons and within situations we applied a cross-classified multilevel model to analyse effects on students’ stress experience. The analysis shows significant person-situation interactions between academic self-concept and classroom demands and between baseline cortisol concentration and classroom demands: the relation between classroom demands and stress experience depends on relatively stable person-related characteristics. A deeper knowledge about the complex interrelations between traits, states, and continuously changing context conditions seems to be essential for a more holistic understanding of learning at school and for the identification of crucial aspects for an evidence-based design and implementation of teaching and learning arrangements.

Article Details

How to Cite
Kärner, T., Sembill, D., Aßmann, C., Friederichs, E., & Carstensen, C. H. (2017). Analysis of person-situation interactions in educational settings via cross-classified multilevel longitudinal modeling: illustrated with the example of students’ stress experience. Frontline Learning Research, 5(1), 16–42. https://doi.org/10.14786/flr.v5i1.137
Section
Articles

References

Achtenhagen, F. (1978). Beanspruchung von Schülern. Methodisch-didaktische Aspekte. [Students´stress. Methodical and didactical aspects.] BMBW Werkstattberichte, Bundesminister für Bildung und Wissenschaft (ed). Regensburg: Aumüller Druck KG.
Adam, E. K. (2006). Transactions among adolescent trait and state emotion and diurnal and momentary cortisol activity in naturalistic settings. Psychoneuroendocrinology, 31, 664-679. doi: 10.1016/j.psyneuen.2006.01.010.
Agelink, M. W., Malessa, R., Baumann, B., Majewski, Th., Akila, F., Zeit, Th., Ziegler D. (2001). Standardized tests of heart rate variability: normal ranges obtained from 309 healthy humans, and effects of age, gender, and heart rate. Clinical Autonomic Research, 11, 99-108. doi: 10.1007/BF02322053.
Baert S., Casier A., De Raedt R. (2012). The effects of attentional training on physiological stress recovery after induced social threat. Anxiety, Stress, & Coping: An International Journal, 25, 365-379. doi: 10.1080/10615806.2011.605122.
Baron, R. M., & Kenny, D. A. (1986). The Moderator-Mediator Variable Distinction in Social Psychological Research: Conceptual, Strategic, and Statistical Considerations. Journal of Personality and Social Psychology, 51, 1173-1182. doi: 10.1037/0022-3514.51.6.1173.
Bryk, A. S., Raudenbush, S. W. (1992). Hierarchical Linear Models: Applications and Data Analysis Methods. London: Sage Publications.
Buchanan, T. W., Lovallo W. R. (2001). Enhanced memory for emotional material following stress-level cortisol treatment in humans. Psychoneuroendocrinology, 26, 307–317. doi: 10.1016/S0306-4530(00)00058-5.
Caplan, R. D., Cobb, S., French, J. R. P. Jr. (1979). White collar work load and cortisol: Disruption of a circadian rhythm by job stress? Journal of Psychosomatic Research, 23, 181-192. doi: 10.1016/0022-3999(79)90003-5.
Carver, Ch. S. & Scheier, M. F. (2008). Perspectives on Personality. Boston, a. o.: Pearson.
Cobas (2010). Leistungsdaten von Elecsys® und cobas e® Geräten hinsichtlich der Bestimmung des Cortisolwertes [Performance data for Elecsys® and cobas e® equipment concerning the identification of salvia cortisol concentration]. (W. Mayer, Immumed GmbH, Karlstrasse 46, 80333 Munich, Germany). Technical manuscript.
Cornelisse, S., van Stegeren, A. H., Joëls, M. (2011). Implications of psychosocial stress on memory formation in a typical male versus female student sample. Psychoneuroendocrinology, 36, 569-578. doi: 10.1016/j.psyneuen.2010.09.002.
Cronbach, L. J., & Snow, R. E. (1977). Aptitudes and Instructional Methods. A Handbook for Research on Interactions. New York: Irvington Publishers.
Csíkszentmihályi, M., Larson R. (1987). Validity and Reliability of the Experience-Sampling Method. The Journal of Nervous and Mental Diseases, 175, 526-536. doi: 10.1097/00005053-198709000-00004.
Danev, S. (2010). QHRV-Lite System Guide & User’s Manual. Medeia Ltd.
Deci, E. L., Ryan, R. M. (1985). Intrinsic Motivation and Self-Determination in Human Behavior. New York: Plenum Press.
Dickerson, S. S., Kemeny, M. E. (2004). Acute Stressors and Cortisol Responses: A Theoretical Integration and Synthesis of Laboratory Research. Psychological Bulletin, 130, 355-391. doi: 10.1037/0033-2909.130.3.355.
Dickhäuser, O. (2006). Fähigkeitsselbstkonzepte: Entstehung, Auswirkung, Förderung. [Academic Self-Concepts – Formation, Effects, Enhanceme.] Zeitschrift für Pädagogische Psychologie, 20, 5-8. doi: 10.1024/1010-0652.20.12.5.
Ellenbogen, M. A. (2012). Introduction to the special section on biopsychosocial moderators of the stress response. Anxiety, Stress, & Coping: An International Journal, 25, 359-364. doi: 10.1080/10615806.2012.691621.
Fekedulegn, D. B., Andrew, M. E., Burchfiel, C. M., Violanti, J. M., Hartley, T. A., Charles, L. E., Miller, D. B. (2007). Area under the curve and other summary indicators of repeated waking cortisol measurements. Psychosomatic Medicine, 69, 651-659, doi: 10.1097/PSY.0b013e31814c405c.
Frankenhaeuser, M., Lundberg, U. (1977). The Influence of Cognitive Set on Performance and Arousal under Different Noise Loads. Motivation and Emotion, 1, 139-149. doi: 10.1007/BF00998516.
Goetz, Th., Preckel, F., Zeidner, M., Schleyer, E. (2008). Big fish in big ponds: A multilevel analysis of test anxiety and achievement in special gifted classes. Anxiety, Stress, & Coping: An International Journal, 21, 185-198. doi: 10.1080/10615800701628827.
Goldstein, H., Healy, M. J., Rasbash, J. (1994). Multilevel time series models with applications to repeated measures data. Statistics in Medicine, 13, 1643-1655. doi: 10.1002/sim.4780131605.
Hall, J. E. (2011). Guyton and Hall Textbook of Medical Physiology. Philadelphia: Saunders Elisever.
Hattie, J. (2009). Visible Learning: A Synthesis of Over 800 Meta-Analyses Relating to Achievement. London: Routledge.
Hayes, A. F., Matthes, J. (2009). Computational procedures for probing interactions in OLS and logistic regression: SPSS and SAS implementations. Behavior Research Methods, 41, 924-936. doi: 10.3758/BRM.41.3.924.

Hebb, D. O. (1955). Drives and the C.N.S (Conceptual Nervous System). Psychological Review, 62, 243-254. doi: 10.1037/h0041823.
Heck, R. H., Thomas, S. L. (2009). An Introduction to Multilevel Modeling Techniques. New York: Routledge.
Heck, R. H., Thomas, S. L., Tabata, L. N. (2010). Multilevel and Longitudinal Modeling with IBM SPSS. New York: Routledge.
Hjortskov, N., Rissén, D., Blangsted, A. K., Fallentin, N., Lundberg, U., Søgaard, K. (2004). The effect of mental stress on heart rate variability and blood pressure during computer work. European Journal of Applied Physiology, 92, 84-89. doi: 10.1007/s00421-004-1055-z.
Hormuth, S. E. (1986). The sampling of experience in situ. Journal of Personality, 54, 262-293. doi: 10.1111/j.1467-6494.1986.tb00395.x.
Hox, J. (2002). Multilevel Analysis. Techniques and Applications. London: Lawrence Erlbaum Associates.
Isowa, T., Ohira, H., Murashima, S. (2006). Immune, endocrine and cardiovascular responses to controllable and uncontrollable acute stress. Biological Psychology, 71, 202-213. 10.1016/j.biopsycho.2005.04.002.
Kärner, T. (2014). Erwartungswidrige Minderleistung und Belastung im kaufmännischen Unterricht – Analyse pädagogischer, psychologischer und physiologischer Aspekte [Underachievement and stress in vocational business education – analysis of pedagogical, psychological, and physiological aspects]. PhD Thesis, University of Bamberg, Germany.
Kemeny, M. E. (2003). The Psychobiology of Stress. Current Directions in Psychological Science, 12, 124-129. doi: 10.1111/1467-8721.01246.
Kouzma, N. M., Kennedy, G. A. (2004). Self-Reported Sources of Stress in Senior High School Students. Psychological Reports, 94, 314-316. doi: 10.2466/pr0.94.1.314-316.
Lazarus, R. S. (1966). Psychological Stress and Coping Process. New York: McGraw-Hill Book Company.
Lazarus, R. S. (1984). On the Primacy of Cognition. American Psychologist, 39, 124-129. doi: 10.1037/0003-066X.39.2.124.
Lazarus, R. S. (1999). Stress and Emotion. A New Synthesis. New York: Springer.
Lazarus, R. S., Folkman, S. (1984). Stress, Appraisal, and Coping. New York: Springer.
Leech, N. L., Barrett, K. C., Morgan, G. A. (2008). SPSS for Intermediate Statistics. Use and Interpretation. New York: Psychology Press Taylor & Francis Group.
Lohaus, A., Eschenbeck, H., Kohlmann, C.-W., Klein-Heßling, J. (2006). Fragebogen zur Erhebung von Stress und Stressbewältigung bei Kindern und Jugendlichen (SSKJ 3–8) [The German Stress and Coping Questionnaire for Children and Adolescents]. Göttingen: Hogrefe.
Looser, R. R., Metzenthin, P., Helfricht, S., Kudielka, B. M., Loerbroks, A., Thayer, J. F., Fischer, J. E. (2010). Cortisol Is Significantly Correlated With Cardiovascular Responses During High Levels of Stress in Critical Care Personnel. Psychosomatic Medicine, 72, 281-289. doi: 10.1097/PSY.0b013e3181d35065.
Malik, M., Bigger, J. T., Camm, A. J., Kleiger, R. E., Malliani, A., Moss, A. J., Schwartz, P. J. (1996). Heart rate variability: Standards of measurement, physiological interpretation, and clinical use. European Heart Journal, 17, 354-381. doi: 10.1161/01.cir.93.5.1043.
McClelland, D. C. (1973). Testing for competence rather than for "intelligence". American Psychologist, 28, 1-14. doi: 10.1037/h0034092.
McEwen, B. S., Sapolsky, R. M. (1995). Stress and cognitive function. Current Opinion in Neurobiology, 5, 205-216. doi: 10.1016/0959-4388(95)80028-X.
Michaud, K., Matheson, K., Kelly, O., Anisman, H. (2008). Impact of Stressors in a natural context on release of cortisol in healthy adult humans: A meta-analysis. Stress, 11, 177-197. doi: 10.1080/10253890701727874.
Nezlek, J. B. (2007). A Multilevel Framework for Understanding Relationships Among Traits, States, Situations and Behaviours. European Journal of Personality, 21, 789-810. doi: 10.1002/per.640

Pekrun, R. (1987). Die Entwicklung leistungsbezogener Identität bei Schülern. In Frey, H. P., Haußer, K. (eds.), Identität. Entwicklungen psychologischer und soziologischer Forschung [Identity. Development of psychological and sociological research.], (pp. 43-57). Stuttgart: Ferdinand Enke Verlag.
Pekrun, R., Schiefele, U. (1996). Emotions- und motivationspsychologische Bedingungen der Lernleistung [Emotional and motivational conditions of learning performance]. In Weinert, F. E. (ed.) Psychologie des Lernens und der Instruktion, (pp 153-180). Göttingen: Hogrefe.
Peugh, J. L., Enders, C. K. (2005). Using the SPSS Mixed Procedure to Fit Cross-Sectional and Longitudinal Multilevel Models. Educational and Psychological Measurement, 65, 717-741. doi: 10.1177/0013164405278558.
Pruessner, J. C., Kirschbaum C., Meinlschmid G., Hellhammer D. H. (2003). Two formulas for computation of the area under the curve represent measures of total hormone concentration versus time-dependent change. Psychoneuroendocrinology, 28, 916-931. doi: 10.1016/S0306-4530(02)00108-7.
Qhrv Assessment [Computer software]. Toronto, ON, Canada: Medeia Ltd. http://www.qhrv.de/index_de.htm.
Raudenbush, S. W., Bryk, A. S. (2002). Hierarchical Linear Models. Applications and Data Analysis Methods, Second Edition. London: Sage Publications.
Rost, D. H., Sparfeldt, J. R., Schilling, S. R. (2007). DISK-GITTER mit SKSLF-8. Differentielles Schulisches Selbstkonzept-Gitter mit Skala zur Erfassung des Selbstkonzepts schulischer Leistungen und Fähigkeiten [Scale for assessing Self-concept of School related Achievement and Skills]. Göttingen: Hogrefe.
Roubinov, D., Hagan M. J., Luecken L. J. (2012). If at first you don't succeed: the neuroendocrine impact of using a range of strategies during social conflict. Anxiety, Stress, & Coping: An International Journal, 25, 397-410. doi: 10.1080/10615806.2011.613459.
Schunk, D. H., Zimmerman, B. J. (eds.) (1994). Self-Regulation of Learning and Performance. Issues and Edicational Applications. Hillsdale: Lawrence Erlbaum Associates.
Scollon, Ch. N., Kim-Prieto, Ch., Diener, E. (2003). Experience Sampling: Promises and Pitfalls, Strengths and Weaknesses. Journal of Happiness Studies, 4, 5-34. doi: 10.1023/A:1023605205115.
Seidel, T., Dalehefte, I. M., Meyer, L. (2001). Videoanalysen - Beobachtungs-schemata zur Erfassung von „Sicht-Strukturen“ im Physikunterricht [Video-based analysis - observation patterns for assessing conditions in classroom in physics education]. In M. Prenzel, R. Duit, M. Euler, M. Lehrke and T. Seidel (eds.), Erhebungs- und Auswertungsverfahren des DFG-Projekts „Lehr-Lern-Prozesse im Physikunterricht - eine Videostudie“, (pp. 41-58). Kiel: IPN-Materialien.
Seifried, J. (2004). Fachdidaktische Variationen in einer selbstorganisationsoffenen Lernumgebung. Eine empirische Untersuchung im Rechnungswesenunterricht [Subject-didactical variations in a self-organized learning environment. An empirical study in accounting education]. Wiesbaden: Deutscher Universitäts-Verlag.
Sembill, D. (1984). Modellgeleitete Interaktionsanalysen im Rahmen einer forschungsorientierten Lehrerausbildung - am Beispiel von Untersuchungen zum „Kaufvertrag“ [Modell-driven interaction analysis within the scope of research oriented teacher education by the example of the topic "purchase agreement"]. Dissertation, Georg-August-Universität Göttingen, Germany.
Sembill, D. (2004). Abschlussbericht an die Deutsche Forschungsgemeinschaft im Rahmen des Schwerpunktprogramms „Lehr-Lern-Prozesse in der kaufmännischen Erstausbildung“ [Final report to the German Research Foundation within the scope of the priority programme "Teaching and Learning Processes in Business Education"]. http://www.uni-
bamberg.de/fileadmin/uni/fakultaeten/sowi_lehrstuehle/wirtschaftspaedagogik/Dateien/Forschung/Forschungsprojekte/Prozessanalysen/DFG-Abschlussbericht_sole.pdf. Accessed 10 July 2013.
Sembill, D., Rausch, A., Kögler, K. (2013). Non-cognitive facets of competence – Theoretical foundations and implications for measurement. In Beck, K., Zlatkin-Troitschanskaia, O. (eds.), From Diagnostics to Learning Success: Proceedings in Vocational Education and Training, (pp. 199-212). Rotterdam: Sense.
Sembill, D., Seifried, J., Dreyer, K. (2008). PDAs als Erhebungsinstrument in der beruflichen Lehr-Lern-Forschung – Ein neues Wundermittel oder bewährter Standard? Eine Replik auf Henning Pätzold. [PDAs as a tool for data collection in adult education research - New panacea or approved standard? A reply to Henning Pätzold.] Empirische Pädagogik, 22, 64-77.
Sembill, D., Wolf, K. D., Wuttke, E., Schumacher, L. (2002). Self-Organized Learning in Vocational Education – Foundation, Implementation, and Evaluation. In Beck, K. (ed.), Teaching-Learning Processes in Vocational Education. Foundations of Modern Training Programms, (pp. 267-295). Frankfurt a.M.: Peter Lang.
Shavelson, R. J., Hubner, J. J., Stanton, G. C. (1976). Self-Concept: Validation of Construct Interpretations. Review of Educational Research, 46, 407-441. doi: 10.1037/0022-3514.45.1.173.
Sleight, P., Bernardi, L. (1998). Sympathovagal Balance. Circulation, 98, 2640. doi: 10.1161/01.CIR.98.23.2640.
Smeets, T. (2011). Acute stress impairs memory retrieval independent of time of day. Psychoneuroendocrinology, 36, 495-501. doi: 10.1016/j.psyneuen.2010.08.001.
Snow, R. (1989). Aptitude-Treatment Interaction as a framework for research on individual differences in learning. In Ackerman, P., Sternberg, R. J., Glaser, R. (eds.), Learning and Individual Differences, (pp. 13-59). New York: W. H. Freeman.
Spangler G., Pekrun, R., Kramer, K., Hofmann, H. (2002). Students' Emotions, Physiological Reactions, and Coping in Academic Exams. Anxiety, Stress, & Coping: An International Journal, 15, 413-432. doi: 10.1080/1061580021000056555.
SPSS (2005). Linear Mixed-Effects Modeling in SPSS: An Introduction to the MIXED Procedure [PDF file]. Retrieved from http://www.spss.ch/upload/1126184451_Linear%20Mixed%20-Effects%20Modeling%20in%20SPSS.pdf. Armonk, New York: IBM.
Stadler, T., Evans, Ph., Hucklebridge, F., Clow, A. (2011). Associations between the cortisol awaking response and heart rate variability. Psychoneuroendocrinology, 36, 454-462. doi: 10.1016/j.psyneuen.2010.07.020.
Takahashi, T., Ikeda, K., Ishikawa, M., Kitamura, N., Tsukasaki, T., Nakama, D., Kameda, T. (2005). Anxiety, reactivity, and social stress-induced cortisol elevation in humans. Neuroendocrinology Letters, 26, 351-354.
Twisk, J. W. R. (2006). Applied Multilevel Analysis. A Practical Guide. Cambridge: Cambridge University Press.
Wild, K. P. (2001). Die Optimierung von Videoanalysen durch zeitsynchrone Befragungsdaten aus dem Experience Sampling. In Aufschnaiter, S. v., Wenzel, M. (eds.), Nutzung von Videodaten zur Untersuchung von Lehr-Lern-Prozessen. Aktuelle Methoden empirischer pädagogischer Forschung [Using videodata for investigating teaching and learning processes. Current methods of empirical pedagogical research], (pp. 61-74). Münster: Waxmann.
Wild, K. P., Krapp, A. (1996). Die Qualität subjektiven Erlebens in schulischen und betrieblichen Lernumwelten. Untersuchungen mit der Erlebens Stichproben Methode. [The quality of emotional experiences in vocational and company learning environments: Studies with the experience-sampling-method.] Unterrichtswissenschaft. 24, 195-216.
Wolf, K. D., Schumacher, L. (2010). Heterogene Erlebensprozesse im kaufmännischen Unterricht – Resultat individueller Dispositionen und Prädiktor von Erfolgsmaßen? [Heterogeneous experience processes in business education - results of individual dispositions and predictor of measures of success?] In Seifried, J., Wuttke, E., Nickolaus, R., Sloane, P. F. E. (eds), Lehr-Lern-Forschung in der kaufmännischen Berufsbildung - Ergebnisse und Gestaltungsaufgaben. ZBW, Beiheft 23, pp 173-191.
Wüst, S., Federenko, I., Hellhammer, D. H., Kirschbaum, C. (2000). Genetic factors, perceived chronic stress, and the free cortisol response to awakening. Psychoneuroendocrinology, 25, 707-720. doi: 10.1016/S0306-4530(00)00021-4.
Yeh, Yu-chu (2012). Aptitude-Treatment Interaction. In Seel, N. M. (ed.), Encyclopedia of the Sciences of Learning, (pp. 295-298). New York: Springer.
Yerkes, R. M., Dodson, J. D. (1908). The Relation of Strength of Stimulus to Rapidity of Habit-Formation. Journal of Comparative Neurology and Psychology, 18, 459-482. doi: 10.1002/cne.920180503.