Regulating distance to the screen while engaging in difficult tasks

Main Article Content

Fang Zhao
Robert Gaschler
Wolfgang Schnotz
Inga Wagner


Regulation of distance to the screen (i.e., head-to-screen distance, fluctuation of head-to-screen distance) has been proved to reflect the cognitive engagement of the reader. However, it is still not clear (a) whether regulation of distance to the screen can be a potential parameter to infer high cognitive load and (b) whether it can predict the upcoming answer accuracy. Configuring tablets or other learning devices in a way that distance to the screen can be analyzed by the learning software is in close reach. The software might use the measure as a person-specific indicator of need for extra scaffolding. In order to better gauge this potential, we analyzed eye-tracking data of children (N = 144, Mage = 13 years, SD = 3.2 years) engaging in multimedia learning, as distance to the screen is estimated as a by-product of eye tracking. Children were told to maintain a still seated posture while reading and answering questions at three difficulty levels (i.e., easy vs. medium vs. difficult). Results yielded that task difficulty influences how well the distance to the screen can be regulated, supporting that regulation of distance to the screen is a promising measure. Closer head-to-screen distance and larger fluctuation of head-to-screen distance can reflect that participants are engaging in a challenging task. Only large fluctuation of head-to-screen distance can predict the future incorrect answers. The link between distance to the screen and processing of cognitive task can obtrusively embody reader’s cognitive states during system usage, which can support adaptive learning and testing.

Article Details

How to Cite
Zhao, F., Gaschler, R., Schnotz, W., & Wagner, I. (2020). Regulating distance to the screen while engaging in difficult tasks. Frontline Learning Research, 8(6), 59 - 76.


Atkinson, R. C., & Shiffrin, R. M. (1968). Human memory: A proposed system and its control processes. In R. J. Sternberg, K. W. Spence, & J. T. Spence (Eds.), The psychology of learning and motivation: Advances in research and theory (Vol. 2, pp. 89–195). Academic Press.

Baddeley, A. (1986). Working memory. Oxford University Press.

Balaban, C. D., Cohn, J., Redfern, M. S., Prinkey, J., Stripling, R., & Hoffer, M. (2004). Postural control as a probe for cognitive state: Exploiting human information processing to enhance performance. International Journal of Human-Computer Interaction, 17(2), 275–286.

Bayer, M., Sommer, W., & Schacht, A. (2012). Font size matters—Emotion and attention in cortical responses to written words. PLOS ONE, 7(5), e36042.

Blanchard, Y., Carey, S., Coffey, J., Cohen, A., Harris, T., Michlik, S., & Pellecchia, G. L. (2005). The influence of concurrent cognitive tasks on postural sway in children. Pediatric Physical Therapy, 17(3), 189–193.

Bonnet, C. T., Szaffarczyk, S., & Baudry, S. (2017). Functional synergy between postural and visual behaviors when performing a difficult precise visual task in upright stance. Cognitive Science, 41(6), 1675–1693.

Chen, Y., Yu, Y., Niu, R., & Liu, Y. (2018). Selective effects of postural control on spatial vs. nonspatial working memory: A functional near-infrared spectral imaging study. Frontiers in Human Neuroscience, 12, 243.

Chong, R. K., Mills, B., Dailey, L.-, Lane, E., Smith, S., & Lee, H. (2010). Specific interference between a cognitive task and sensory organization for stance balance control in healthy young adults: Visuospatial effects. Neuropsychologia, 48(9), 2709–2718.

Debue, N., & van de Leemput, C. (2014). What does germane load mean? An empirical contribution to the cognitive load theory. Frontiers in Psychology, 5, 1099.

Donath, L., Roth, R., Lichtenstein, E., Elliot, C., Zahner, L., & Faude, O. (2015). Jeopardizing Christmas: Why spoiled kids and a tight schedule could make Santa Claus fall? Gait & Posture, 41(3), 745–749.

Doumas, M., Morsanyi, K., & Young, W. R. (2018). Cognitively and socially induced stress affects postural control. Experimental Brain Research, 236(1), 305–314.

Faul, F., Erdfelder, E., Buchner, A., & Lang, A. G. (2009). Statistical power analyses using G*Power 3.1: Tests for correlation and regression analyses. Behaviour Research Methods, 41(4), 1149–1160.

Fritz, J., Fischer, R., & Dreisbach, G. (2015). The influence of negative stimulus features on conflict adaption: Evidence from fluency of processing. Frontiers in Psychology, 6, 185.

Fuhrman, S. I., Redfern, M. S., Jennings, J. R., & Furman, J. M. (2015). Interference between postural control and spatial vs non-spatial auditory reaction time tasks in older adults. Journal of Vestibular Research: Equilibrium & Orientation, 25(2), 47–55.

Garcia-Barrios, V., Gütl, C., Preis, A. M., Andrews, K., Pivec, M., Mödritscher, F., & Trummer, C. (2004). AdELE: A framework for adaptive e-learning through eye tracking. I-Know’04, 609–616.

Gaschler, R., Zhao, F., Röttger, E., Panzer, S., & Haider, H. (2019). More than hitting the correct key quickly: Spatial variability in touch screen response location under multitasking in the serial reaction time task. Experimental Psychology, 66(3), 207–220.

Gentner, D. (1989). The mechanisms of analogical learning. In S. Vosniadou & A. Ortony (Eds.), Similarity and analogical reasoning (pp. 199–241). Cambridge University Press.

Gyselinck, V., Cornoldi, C., Dubois, V., De Beni, R., & Ehrlich, M.-F. (2002). Visuospatial memory and phonological loop in learning from multimedia. Applied Cognitive Psychology, 16(6), 665–685.

Gyselinck, V., Ehrlich, M.-F., Cornoldi, C., De Beni, R., & Dubois, V. (2000). Visuospatial working memory in learning from multimedia systems. Journal of Computer Assisted Learning, 16(2), 166–176.

Huestegge, L., & Koch, I. (2014). When two actions are easier than one: How inhibitory control demands affect response processing. Acta Psychologica, 151, 230–236.

Hyönä, J., & Niemi, P. (1990). Eye movements during repeated reading of a text. Acta Psychologica, 73(3), 259–280.

Igarashi, G., Karashima, C., & Hoshiyama, M. (2016). Effect of cognitive load on seating posture in children. Occupational Therapy International, 23(1), 48–56.

Johnson-Laird, P. N. (1983). Mental models: Towards a cognitive science of language, inference, and consciousness. Oxford University Press.

Kaakinen, J. K., Ballenghein, U., Tissier, G., & Baccino, T. (2018). Fluctuation in cognitive engagement during reading: Evidence from concurrent recordings of postural and eye movements. Journal of Experimental Psychology: Learning, Memory, and Cognition, 44(10), 1671–1677.

Kaakinen, J. K., & Hyönä, J. (2014). Task relevance induces momentary changes in the functional visual field during reading. Psychological Science, 25(2), 626–632.

Kaltwasser, L., Moore, K., Weinreich, A., & Sommer, W. (2017). The influence of emotion type, social value orientation and processing focus on approach-avoidance tendencies to negative dynamic facial expressions. Motivation and Emotion, 41(4), 532–544.

Kerr, B., Condon, S. M., & McDonald, L. A. (1985). Cognitive spatial processing and the regulation of posture. Journal of Experimental Psychology: Human Perception and Performance, 11(5), 617–622.

Kintsch, W., & van Dijk, T. A. (1978). Toward a model of text comprehension and production. Psychological Review, 85(5), 363–394.

Knauff, M., & Johnson-Laird, P. N. (2002). Visual imagery can impede reasoning. Memory & Cognition, 30(3), 363–371.

Kruley, P., Sciama, S. C., & Glenberg, A. M. (1994). On-line processing of textual illustrations in the visuospatial sketchpad: Evidence from dual-task studies. Memory & Cognition, 22(3), 261–272.

Lajoie, Y., Teasdale, N., Bard, C., & Fleury, M. (1993). Attentional demands for static and dynamic equilibrium. Experimental Brain Research, 97(1), 139–144.

Langhanns, C., & Müller, H. (2018). Effects of trying ‘not to move’ instruction on cortical load and concurrent cognitive performance. Psychological Research, 82(1), 167–176.

Lindner, M. A., Eitel, A., Strobel, B., & Köller, O. (2017). Identifying processes underlying the multimedia effect in testing: An eye-movement analysis. Learning and Instruction, 47, 91–102.

Mayer, R. E. (2009). Multimedia learning. Cambridge University Press.

Maylor, E. A., & Wing, A. M. (1996). Age differences in postural stability are increased by additional cognitive demands. The Journals of Gerontology Series B: Psychological Sciences and Social Sciences, 51(3), 143–154.

McCrudden, M. T., & Schraw, G. (2007). Relevance and goal-focusing in text processing. Educational Psychology Review, 19, 113–139.

O’Sullivan, P. B., Dankaerts, W., Burnett, A. F., Farrell, G. T., Jefford, E., Naylor, C. S., & O’Sullivan, K. J. (2006). Effect of different upright sitting postures on spinal-pelvic curvature and trunk muscle activation in a pain-free population. Spine (Phila Pa 1976), 31(19), E707-712.

O’Sullivan, P. B., Grahamslaw, K. M., Kendell, M., Lapenskie, S. C., Möller, N. E., & Richards, K. V. (2002). The effect of different standing and sitting postures on trunk muscle activity in a pain-free population. Spine (Phila Pa 1976), 27(11), 1238–1244.

Paivio, A. (1986). Mental representations: A dual coding approach. Oxford University Press, Clarendon Press.

Patel, P. J., & Bhatt, T. (2015). Attentional demands of perturbation evoked compensatory stepping responses: Examining cognitive-motor interference to large magnitude forward perturbations. Journal of Motor Behavior, 47(3), 201–210.

Pellecchia, G. L. (2003). Postural sway increases with attentional demands of concurrent cognitive task. Gait & Posture, 18(1), 29–34.

Qiu, J., & Helbig, R. (2012). Body posture as an indicator of workload in mental work. Human Factors, 54(4), 626–635.

Rankin, J. K., Woollacott, M. H., Shumway-Cook, A., & Brown, L. A. (2000). Cognitive influence on postural stability: A neuromuscular analysis in young and older adults. The Journals of Gerontology: Series A: Biological Sciences and Medical Sciences, 55(3), M112–M119.

Reilly, D. S., van Donkelaar, P., Saavedra, S., & Woollacott, M. H. (2008). Interaction between the development of postural control and the executive function of attention. Journal of Motor Behavior, 40(2), 90–102.

Rival, C., Ceyte, H., & Olivier, I. (2005). Developmental changes of static standing balance in children. Neuroscience Letters, 376(2), 133–136.

Roig-Maimó, M. F., MacKenzie, I. S., Manresa-Yee, C., & Varona, J. (2018). Head-tracking interfaces on mobile devices: Evaluation using Fitts’ law and a new multi-directional corner task for small displays. International Journal of Human-Computer Studies, 112, 1–15.

Sakaguchi, M., Taguchi, K., Miyashita, Y., & Katsuno, S. (1994). Changes with aging in head and center of foot pressure sway in children. International Journal of Pediatric Otorhinolaryngology, 29(2), 101–109.

Schaefer, S., Schellenbach, M., Lindenberger, U., & Woollacott, M. H. (2015). Walking in high-risk settings: Do older adults still prioritize gait when distracted by a cognitive task? Experimental Brain Research, 233(1), 79–88.

Scheiter, K., Schubert, C., Schüler, A., Schmidt, H., Zimmermann, G., Wassermann, B., Krebs, M.-C., & Eder, T. (2019). Adaptive multimedia: Using gaze-contingent instructional guidance to provide personalized processing support. Computers & Education, 139, 31–47.

Schmid, M., Conforto, S., Lopez, L., & D’Alessio, T. (2007). Cognitive load affects postural control in children. Experimental Brain Research, 179(3), 375–385.

Schmid, M., Conforto, S., Lopez, L., Renzi, P., & D’Alessio, T. (2005). The development of postural strategies in children: A factorial design study. Journal of Neuro Engineering and Rehabilitation, 2(1), 29.

Schnotz, W., & Bannert, M. (2003). Construction and interference in learning from multiple representation. Learning and Instruction, 13(2003), 141–156.

Schnotz, W., & Wagner, I. (2018). Construction and elaboration of mental models through strategic conjoint processing of text and pictures. Journal of Educational Psychology, 110(6), 850–863.

Sims, V. K., & Hegarty, M. (1997). Mental animation in the visuospatial sketchpad: Evidence from dual-task studies. Memory & Cognition, 25(3), 321–332.

Stelmach, G. E., Populin, L., & Müller, F. (1990). Postural muscle onset and voluntary movement in the elderly. Neuroscience Letters, 117(1), 188–193.

Stelzel, C., Schauenburg, G., Rapp, M. A., Heinzel, S., & Granacher, U. (2017). Age-related interference between the selection of input-output modality mappings and postural control - A pilot study. Frontiers in Psychology, 8, 613.

Sweller, J. (1988). Cognitive load during problem solving: Effects on learning. Cognitive Science, 12(2), 257–285.

Theeuwes, J., & Belopolsky, A. (2010). Top-down and bottom-up control of visual selection controversies and debate. In V. Coltheart, Tutorials in Visual Cognition. Psychology Press, Taylor & Francis Group.

VanderVelde, T. J., Woollacott, M. H., & Shumway-Cook, A. (2005). Selective utilization of spatial working memory resources during stance posture. NeuroReport, 16(7), 773–777.

Wainer, H. (1992). Understanding graphs and tables. Educational Testing Service.

Wainer, H., Dorans, N. J., Green, B. F., Steinberg, L., Flaugher, R., Mislevy, R. J., & Thissen, D. (1990). Computerized adaptive testing: A primer. Lawrence Erlbaum Associates Publisher.

Wickens, C. D. (2002). Multiple resources and performance prediction. Theoretical Issues in Ergonomics Science, 3(2), 159–177.

Wickens, C. D., Vidulich, M., & Sandry-Garza, D. (1984). Principles of S-C-R compatibility with spatial and verbal tasks: The role of display-control location and voice-interactive display-control interfacing. Human Factors, 26(5), 533–543.

Woollacott, M. H., & Shumway-Cook, A. (2002). Attention and the control of posture and gait: A review of an emerging area of research. Gait & Posture, 16(1), 1–14.

Woollacott, M. H., & VanderVelde, T. J. (2008). Non-visual spatial tasks reveal increased interactions with stance postural control. Brain Research, 1208, 95–102.

Zhao, F., Schnotz, W., Wagner, I., & Gaschler, R. (2014). Eye tracking indicators of reading approaches in text-picture comprehension. Frontline Learning Research, 2(4), 46–66.

Zhao, F., Schnotz, W., Wagner, I., & Gaschler, R. (2020). Texts and pictures serve different functions in conjoint mental model construction and adaptation. Memory & Cognition, 48(1), 69–82.