Regulating distance to the screen while engaging in difficult tasks

Article Sidebar

HTML PDF Listen
Published: Nov 4, 2020
DOI: https://doi.org/10.14786/flr.v8i6.663

Main Article Content

Fang Zhao
University of Hagen, Germany
https://orcid.org/0000-0001-9363-2581
Robert Gaschler
University of Hagen, Germany
Wolfgang Schnotz
University of Koblenz-Landau, Germany
Inga Wagner
University of Koblenz-Landau, Germany

Abstract

Regulation of distance to the screen (i.e., head-to-screen distance, fluctuation of head-to-screen distance) has been proved to reflect the cognitive engagement of the reader. However, it is still not clear (a) whether regulation of distance to the screen can be a potential parameter to infer high cognitive load and (b) whether it can predict the upcoming answer accuracy. Configuring tablets or other learning devices in a way that distance to the screen can be analyzed by the learning software is in close reach. The software might use the measure as a person-specific indicator of need for extra scaffolding. In order to better gauge this potential, we analyzed eye-tracking data of children (N = 144, Mage = 13 years, SD = 3.2 years) engaging in multimedia learning, as distance to the screen is estimated as a by-product of eye tracking. Children were told to maintain a still seated posture while reading and answering questions at three difficulty levels (i.e., easy vs. medium vs. difficult). Results yielded that task difficulty influences how well the distance to the screen can be regulated, supporting that regulation of distance to the screen is a promising measure. Closer head-to-screen distance and larger fluctuation of head-to-screen distance can reflect that participants are engaging in a challenging task. Only large fluctuation of head-to-screen distance can predict the future incorrect answers. The link between distance to the screen and processing of cognitive task can obtrusively embody reader’s cognitive states during system usage, which can support adaptive learning and testing.

Article Details

How to Cite
Zhao, F., Gaschler, R., Schnotz, W., & Wagner, I. (2020). Regulating distance to the screen while engaging in difficult tasks. Frontline Learning Research, 8(6), 59–76. https://doi.org/10.14786/flr.v8i6.663
Issue
Vol. 8 No. 6 (2020): Frontline Learning Research
Section
Articles

FLR adopts the Attribution-NonCommercial-NoDerivs Creative Common License (BY-NC-ND). That is, Copyright for articles published in this journal is retained by the authors with, however, first publication rights granted to the journal. By virtue of their appearance in this open access journal, articles are free to use, with proper attribution, in educational and other non-commercial settings.

References

Atkinson, R. C., & Shiffrin, R. M. (1968). Human memory: A proposed system and its control processes. In R. J. Sternberg, K. W. Spence, & J. T. Spence (Eds.), The psychology of learning and motivation: Advances in research and theory (Vol. 2, pp. 89–195). Academic Press.

Baddeley, A. (1986). Working memory. Oxford University Press.

Balaban, C. D., Cohn, J., Redfern, M. S., Prinkey, J., Stripling, R., & Hoffer, M. (2004). Postural control as a probe for cognitive state: Exploiting human information processing to enhance performance. International Journal of Human-Computer Interaction, 17(2), 275–286. https://doi.org/10.1207/s15327590ijhc1702_9

Bayer, M., Sommer, W., & Schacht, A. (2012). Font size matters—Emotion and attention in cortical responses to written words. PLOS ONE, 7(5), e36042. https://doi.org/10.1371/journal.pone.0036042

Blanchard, Y., Carey, S., Coffey, J., Cohen, A., Harris, T., Michlik, S., & Pellecchia, G. L. (2005). The influence of concurrent cognitive tasks on postural sway in children. Pediatric Physical Therapy, 17(3), 189–193. https://doi.org/10.1097/01.pep.0000176578.57147.5d

Bonnet, C. T., Szaffarczyk, S., & Baudry, S. (2017). Functional synergy between postural and visual behaviors when performing a difficult precise visual task in upright stance. Cognitive Science, 41(6), 1675–1693. https://doi.org/10.1111/cogs.12420

Chen, Y., Yu, Y., Niu, R., & Liu, Y. (2018). Selective effects of postural control on spatial vs. nonspatial working memory: A functional near-infrared spectral imaging study. Frontiers in Human Neuroscience, 12, 243. https://doi.org/10.3389/fnhum.2018.00243

Chong, R. K., Mills, B., Dailey, L.-, Lane, E., Smith, S., & Lee, H. (2010). Specific interference between a cognitive task and sensory organization for stance balance control in healthy young adults: Visuospatial effects. Neuropsychologia, 48(9), 2709–2718. https://doi.org/10.1016/j.neuropsychologia.2010.05.018

Debue, N., & van de Leemput, C. (2014). What does germane load mean? An empirical contribution to the cognitive load theory. Frontiers in Psychology, 5, 1099. https://doi.org/10.3389/fpsyg.2014.01099

Donath, L., Roth, R., Lichtenstein, E., Elliot, C., Zahner, L., & Faude, O. (2015). Jeopardizing Christmas: Why spoiled kids and a tight schedule could make Santa Claus fall? Gait & Posture, 41(3), 745–749. https://doi.org/10.1016/j.gaitpost.2014.12.010

Doumas, M., Morsanyi, K., & Young, W. R. (2018). Cognitively and socially induced stress affects postural control. Experimental Brain Research, 236(1), 305–314. https://doi.org/10.1007/s00221-017-5128-8

Faul, F., Erdfelder, E., Buchner, A., & Lang, A. G. (2009). Statistical power analyses using G*Power 3.1: Tests for correlation and regression analyses. Behaviour Research Methods, 41(4), 1149–1160. https://doi.org/10.3758/BRM.41.4.1149

Fritz, J., Fischer, R., & Dreisbach, G. (2015). The influence of negative stimulus features on conflict adaption: Evidence from fluency of processing. Frontiers in Psychology, 6, 185. https://doi.org/10.3389/fpsyg.2015.00185

Fuhrman, S. I., Redfern, M. S., Jennings, J. R., & Furman, J. M. (2015). Interference between postural control and spatial vs non-spatial auditory reaction time tasks in older adults. Journal of Vestibular Research: Equilibrium & Orientation, 25(2), 47–55. https://doi.org/10.3233/VES-150546

Garcia-Barrios, V., Gütl, C., Preis, A. M., Andrews, K., Pivec, M., Mödritscher, F., & Trummer, C. (2004). AdELE: A framework for adaptive e-learning through eye tracking. I-Know’04, 609–616.

Gaschler, R., Zhao, F., Röttger, E., Panzer, S., & Haider, H. (2019). More than hitting the correct key quickly: Spatial variability in touch screen response location under multitasking in the serial reaction time task. Experimental Psychology, 66(3), 207–220. https://doi.org/10.1027/1618-3169/a000446

Gentner, D. (1989). The mechanisms of analogical learning. In S. Vosniadou & A. Ortony (Eds.), Similarity and analogical reasoning (pp. 199–241). Cambridge University Press.

Gyselinck, V., Cornoldi, C., Dubois, V., De Beni, R., & Ehrlich, M.-F. (2002). Visuospatial memory and phonological loop in learning from multimedia. Applied Cognitive Psychology, 16(6), 665–685. https://doi.org/10.1002/acp.823

Gyselinck, V., Ehrlich, M.-F., Cornoldi, C., De Beni, R., & Dubois, V. (2000). Visuospatial working memory in learning from multimedia systems. Journal of Computer Assisted Learning, 16(2), 166–176. https://doi.org/10.1046/j.1365-2729.2000.00128.x

Huestegge, L., & Koch, I. (2014). When two actions are easier than one: How inhibitory control demands affect response processing. Acta Psychologica, 151, 230–236. https://doi.org/10.1016/j.actpsy.2014.07.001

Hyönä, J., & Niemi, P. (1990). Eye movements during repeated reading of a text. Acta Psychologica, 73(3), 259–280. https://doi.org/10.1016/0001-6918(90)90026-C

Igarashi, G., Karashima, C., & Hoshiyama, M. (2016). Effect of cognitive load on seating posture in children. Occupational Therapy International, 23(1), 48–56. https://doi.org/10.1002/oti.1405

Johnson-Laird, P. N. (1983). Mental models: Towards a cognitive science of language, inference, and consciousness. Oxford University Press.

Kaakinen, J. K., Ballenghein, U., Tissier, G., & Baccino, T. (2018). Fluctuation in cognitive engagement during reading: Evidence from concurrent recordings of postural and eye movements. Journal of Experimental Psychology: Learning, Memory, and Cognition, 44(10), 1671–1677. https://doi.org/10.1037/xlm0000539

Kaakinen, J. K., & Hyönä, J. (2014). Task relevance induces momentary changes in the functional visual field during reading. Psychological Science, 25(2), 626–632. https://doi.org/10.1177/0956797613512332

Kaltwasser, L., Moore, K., Weinreich, A., & Sommer, W. (2017). The influence of emotion type, social value orientation and processing focus on approach-avoidance tendencies to negative dynamic facial expressions. Motivation and Emotion, 41(4), 532–544. https://doi.org/10.1007/s11031-017-9624-8

Kerr, B., Condon, S. M., & McDonald, L. A. (1985). Cognitive spatial processing and the regulation of posture. Journal of Experimental Psychology: Human Perception and Performance, 11(5), 617–622. https://doi.org/10.1037/0096-1523.11.5.617

Kintsch, W., & van Dijk, T. A. (1978). Toward a model of text comprehension and production. Psychological Review, 85(5), 363–394. https://doi.org/10.1037/0033-295X.85.5.363

Knauff, M., & Johnson-Laird, P. N. (2002). Visual imagery can impede reasoning. Memory & Cognition, 30(3), 363–371. https://doi.org/10.3758/BF03194937

Kruley, P., Sciama, S. C., & Glenberg, A. M. (1994). On-line processing of textual illustrations in the visuospatial sketchpad: Evidence from dual-task studies. Memory & Cognition, 22(3), 261–272. https://doi.org/10.3758/BF03200853

Lajoie, Y., Teasdale, N., Bard, C., & Fleury, M. (1993). Attentional demands for static and dynamic equilibrium. Experimental Brain Research, 97(1), 139–144. https://doi.org/10.1007/BF00228824

Langhanns, C., & Müller, H. (2018). Effects of trying ‘not to move’ instruction on cortical load and concurrent cognitive performance. Psychological Research, 82(1), 167–176. https://doi.org/10.1007/s00426-017-0928-9

Lindner, M. A., Eitel, A., Strobel, B., & Köller, O. (2017). Identifying processes underlying the multimedia effect in testing: An eye-movement analysis. Learning and Instruction, 47, 91–102. https://doi.org/10.1016/j.learninstruc.2016.10.007

Mayer, R. E. (2009). Multimedia learning. Cambridge University Press.

Maylor, E. A., & Wing, A. M. (1996). Age differences in postural stability are increased by additional cognitive demands. The Journals of Gerontology Series B: Psychological Sciences and Social Sciences, 51(3), 143–154. https://doi.org/10.1093/geronb/51B.3.P143

McCrudden, M. T., & Schraw, G. (2007). Relevance and goal-focusing in text processing. Educational Psychology Review, 19, 113–139. https://doi.org/10.1007/s10648-006-9010-7

O’Sullivan, P. B., Dankaerts, W., Burnett, A. F., Farrell, G. T., Jefford, E., Naylor, C. S., & O’Sullivan, K. J. (2006). Effect of different upright sitting postures on spinal-pelvic curvature and trunk muscle activation in a pain-free population. Spine (Phila Pa 1976), 31(19), E707-712. https://doi.org/10.1097/01.brs.0000234735.98075.50

O’Sullivan, P. B., Grahamslaw, K. M., Kendell, M., Lapenskie, S. C., Möller, N. E., & Richards, K. V. (2002). The effect of different standing and sitting postures on trunk muscle activity in a pain-free population. Spine (Phila Pa 1976), 27(11), 1238–1244. https://doi.org/10.1097/00007632-200206010-00019

Paivio, A. (1986). Mental representations: A dual coding approach. Oxford University Press, Clarendon Press.

Patel, P. J., & Bhatt, T. (2015). Attentional demands of perturbation evoked compensatory stepping responses: Examining cognitive-motor interference to large magnitude forward perturbations. Journal of Motor Behavior, 47(3), 201–210. https://doi.org/10.1080/00222895.2014.971700

Pellecchia, G. L. (2003). Postural sway increases with attentional demands of concurrent cognitive task. Gait & Posture, 18(1), 29–34. https://doi.org/10.1016/S0966-6362(02)00138-8

Qiu, J., & Helbig, R. (2012). Body posture as an indicator of workload in mental work. Human Factors, 54(4), 626–635. https://doi.org/10.1177/0018720812437275

Rankin, J. K., Woollacott, M. H., Shumway-Cook, A., & Brown, L. A. (2000). Cognitive influence on postural stability: A neuromuscular analysis in young and older adults. The Journals of Gerontology: Series A: Biological Sciences and Medical Sciences, 55(3), M112–M119. https://doi.org/10.1093/gerona/55.3.M112

Reilly, D. S., van Donkelaar, P., Saavedra, S., & Woollacott, M. H. (2008). Interaction between the development of postural control and the executive function of attention. Journal of Motor Behavior, 40(2), 90–102. https://doi.org/10.3200/JMBR.40.2.90-102

Rival, C., Ceyte, H., & Olivier, I. (2005). Developmental changes of static standing balance in children. Neuroscience Letters, 376(2), 133–136. https://doi.org/10.1016/j.neulet.2004.11.042

Roig-Maimó, M. F., MacKenzie, I. S., Manresa-Yee, C., & Varona, J. (2018). Head-tracking interfaces on mobile devices: Evaluation using Fitts’ law and a new multi-directional corner task for small displays. International Journal of Human-Computer Studies, 112, 1–15. https://doi.org/10.1016/j.ijhcs.2017.12.003

Sakaguchi, M., Taguchi, K., Miyashita, Y., & Katsuno, S. (1994). Changes with aging in head and center of foot pressure sway in children. International Journal of Pediatric Otorhinolaryngology, 29(2), 101–109. https://doi.org/10.1016/0165-5876(94)90089-2

Schaefer, S., Schellenbach, M., Lindenberger, U., & Woollacott, M. H. (2015). Walking in high-risk settings: Do older adults still prioritize gait when distracted by a cognitive task? Experimental Brain Research, 233(1), 79–88. https://doi.org/10.1007/s00221-014-4093-8

Scheiter, K., Schubert, C., Schüler, A., Schmidt, H., Zimmermann, G., Wassermann, B., Krebs, M.-C., & Eder, T. (2019). Adaptive multimedia: Using gaze-contingent instructional guidance to provide personalized processing support. Computers & Education, 139, 31–47. https://doi.org/10.1016/j.compedu.2019.05.005

Schmid, M., Conforto, S., Lopez, L., & D’Alessio, T. (2007). Cognitive load affects postural control in children. Experimental Brain Research, 179(3), 375–385. https://doi.org/10.1007/s00221-006-0795-x

Schmid, M., Conforto, S., Lopez, L., Renzi, P., & D’Alessio, T. (2005). The development of postural strategies in children: A factorial design study. Journal of Neuro Engineering and Rehabilitation, 2(1), 29. https://doi.org/10.1186/1743-0003-2-29

Schnotz, W., & Bannert, M. (2003). Construction and interference in learning from multiple representation. Learning and Instruction, 13(2003), 141–156. https://doi.org/10.1016/S0959-4752(02)00017-8

Schnotz, W., & Wagner, I. (2018). Construction and elaboration of mental models through strategic conjoint processing of text and pictures. Journal of Educational Psychology, 110(6), 850–863. https://doi.org/10.1037/edu0000246

Sims, V. K., & Hegarty, M. (1997). Mental animation in the visuospatial sketchpad: Evidence from dual-task studies. Memory & Cognition, 25(3), 321–332. https://doi.org/10.3758/BF03211288

Stelmach, G. E., Populin, L., & Müller, F. (1990). Postural muscle onset and voluntary movement in the elderly. Neuroscience Letters, 117(1), 188–193. https://doi.org/10.1016/0304-3940(90)90142-V

Stelzel, C., Schauenburg, G., Rapp, M. A., Heinzel, S., & Granacher, U. (2017). Age-related interference between the selection of input-output modality mappings and postural control - A pilot study. Frontiers in Psychology, 8, 613. https://doi.org/10.3389/fpsyg.2017.00613

Sweller, J. (1988). Cognitive load during problem solving: Effects on learning. Cognitive Science, 12(2), 257–285. https://doi.org/10.1207/s15516709cog1202_4

Theeuwes, J., & Belopolsky, A. (2010). Top-down and bottom-up control of visual selection controversies and debate. In V. Coltheart, Tutorials in Visual Cognition. Psychology Press, Taylor & Francis Group.

VanderVelde, T. J., Woollacott, M. H., & Shumway-Cook, A. (2005). Selective utilization of spatial working memory resources during stance posture. NeuroReport, 16(7), 773–777. https://doi.org/10.1097/00001756-200505120-00023

Wainer, H. (1992). Understanding graphs and tables. Educational Testing Service.

Wainer, H., Dorans, N. J., Green, B. F., Steinberg, L., Flaugher, R., Mislevy, R. J., & Thissen, D. (1990). Computerized adaptive testing: A primer. Lawrence Erlbaum Associates Publisher.

Wickens, C. D. (2002). Multiple resources and performance prediction. Theoretical Issues in Ergonomics Science, 3(2), 159–177. https://doi.org/10.1080/14639220210123806

Wickens, C. D., Vidulich, M., & Sandry-Garza, D. (1984). Principles of S-C-R compatibility with spatial and verbal tasks: The role of display-control location and voice-interactive display-control interfacing. Human Factors, 26(5), 533–543. https://doi.org/10.1177/001872088402600505

Woollacott, M. H., & Shumway-Cook, A. (2002). Attention and the control of posture and gait: A review of an emerging area of research. Gait & Posture, 16(1), 1–14. https://doi.org/10.1016/S0966-6362(01)00156-4

Woollacott, M. H., & VanderVelde, T. J. (2008). Non-visual spatial tasks reveal increased interactions with stance postural control. Brain Research, 1208, 95–102. https://doi.org/10.1016/j.brainres.2008.03.005

Zhao, F., Schnotz, W., Wagner, I., & Gaschler, R. (2014). Eye tracking indicators of reading approaches in text-picture comprehension. Frontline Learning Research, 2(4), 46–66. https://doi.org/10.14786/flr.v2i4.98

Zhao, F., Schnotz, W., Wagner, I., & Gaschler, R. (2020). Texts and pictures serve different functions in conjoint mental model construction and adaptation. Memory & Cognition, 48(1), 69–82. https://doi.org/10.3758/s13421-019-00962-0