Neural correlates of visual perceptual expertise: Evidence from cognitive neuroscience using functional neuroimaging

Main Article Content

Andreas Gegenfurtner
Ellen M. Kok
Koos van Geel
Anique B. H. de Bruin
Bettina Sorger

Abstract

Functional neuroimaging is a useful approach to study the neural correlates of visual perceptual expertise. The purpose of this paper is to review the functional-neuroimaging methods that have been implemented in previous research in this context. First, we will discuss research questions typically addressed in visual expertise research. Second, we will describe which kinds of stimuli are employed and which functional-neuroimaging techniques are implemented in this kind of research, with a special focus on electroencephalography (EEG) and functional magnetic resonance imaging (fMRI). Third, we will summarize the outcomes of recent studies that addressed the neural correlates of visual expertise and will particularly focus on studies that examined the neural correlates of visual expertise in medical image diagnosis. Finally, the review closes with a discussion of the benefits, caveats, and future directions of cognitive-neuroscience research for studying visual expertise.

Article Details

How to Cite
Gegenfurtner, A., Kok, E. M., van Geel, K., de Bruin, A. B. H., & Sorger, B. (2017). Neural correlates of visual perceptual expertise: Evidence from cognitive neuroscience using functional neuroimaging. Frontline Learning Research, 5(3), 14–30. https://doi.org/10.14786/flr.v5i3.259
Section
Articles

References

Al Lily, A., Foland, D., Stoloff, D., Gogus, A., Erguvan, I. D., Awshar, M. T., et al. (2017). Academic domains as political battlegrounds: A global enquiry by 99 academics in the fields of education and technology. Information Development. doi:10.1177/0266666916646415
Ansari, D., De Smedt, B., & Grabner, R. (2012). Neuroeducation - a critical overview of an emerging field. Neuroethics, 5, 105-117. doi:10.1007/s12152-011-9119-3
Bartlett, J., Boggan, A. L., & Krawczyk, D. C. (2013). Expertise and processing distorted structure in chess. Frontiers in Human Neuroscience, 7, 825. doi:10.3389/fnhum.2013.00825
Bentin, S., Allison, T., Puce, A., Perez, E., & McCarthy, G. (1996). Electrophysiological studies of face perception in humans. Journal of Cognitive Neuroscience, 8, 551-565. doi:10.1162/jocn.1996.8.6.551
Bilalić, M., Grottenthaler, T., Nägele, T., & Lindig, T. (2016). The faces in radiologic images: Fusiform face area supports radiological expertise. Cerebral Cortex, 26, 1004-1014. doi:10.1093/cercor/bhu272
Bilalić, M., Langner, R., Campitelli, G., Turella, L., & Grodd, W. (2015). Editorial: Neural implementation of expertise. Frontiers in Human Neuroscience. doi:10.3389/fnhum.2015.00545
Bilalić, M., Langner, R., Ulrich, R., & Grodd, W. (2011). Many faces of expertise: Fusiform face area in chess experts and novices. Journal of Neuroscience, 31, 10206-10214. doi:10.1523/JNEUROSCI.5727 -10.2011
Boshuizen, H. P. A., & Schmidt, H. G. (1992). On the role of biomedical knowledge in clinical reasoning by experts, intermediates, and novices. Cognitive Science, 16, 153-184. doi:10.1207/s15516709cog1602_1
Bukach, C. M., Gauthier, I., & Tarr, M. J. (2006). Beyond faces and modularity: the power of an expertise framework. Trends in Cognitive Science, 10, 159-166. doi:10.1016/j.tics.2006.02.004
Curran, T., Tanaka, J. W., & Weiskopf, D. M. (2002). An electrophysiological comparison of visual categorization and recognition memory. Cognitive, Affective, and Behavioral Neuroscience, 2, 1-18. doi:10.3758/CABN.2.1.1
Damşa, C. I., Froehlich, D. E., & Gegenfurtner, A. (2017). Reflections on empirical and methodological accounts of agency at work. In M. Goller & S. Paloniemi (Eds.), Agency at work: An agentic perspective on professional learning and development. New York: Springer.
De Bruin, A. B. H. (2017). The potential of neuroscience for health sciences education: towards convergence of evidence and resisting seductive allure. Advances in Health Sciences Education. doi:10.1007/s10459-016-9733-2
De Smedt, B. (2014). Advances in the use of neuroscience methods in research on learning and instruction. Frontline Learning Research, 6, 7-14. doi:10.14786/flr.v2i4.115
Fan, C., Chen, S., Zhang, L., Qi, Z., Jin, Y., Wang, Q., et al. (2015). N170 changes reflect competition between faces and identifiable characters during early visual processing. NeuroImage, 110, 32-38. doi:10.1016/j.neuroimage.2015.01.047
Fiorio, M., Cesari, P., Bresciani, M. C., & Tinazzi, M. (2010). Expertise with pathological actions modulates a viewer’s motor system. Neuroscience, 167, 691-699. doi:10.1016/j.neuroscience.2010.02.010.
Gauthier, I., & Curby, K. M. (2005). A perceptual traffic jam on highway N170. Current Directions in Psychological Science, 14, 30-33. doi:10.1111/j.0963-7214.2005.00329.x
Gauthier, I., Skudlarski, P., Gore, J. C., Anderson, A. W. (2000). Expertise for cars and birds recruits brain areas involved in face recognition. Nature Neuroscience, 3, 191-197. doi:10.1038/72140
Gauthier, I., Tarr, M. J., Anderson, A. W., Skudlarski, P., & Gore, J. C. (1999). Activation of the middle fusiform ’face area’ increases with expertise in recognizing novel objects. Nature Neurosciences, 2, 568-573. doi:10.1038/9224
Gauthier, I., Williams, P., Tarr, M. J., & Tanaka, J. (1998). Training ’greeble’ experts: a framework for studying expert object recognition processes. Vision Research, 38, 2401-2428. doi:10.1016/S0042-6989(97)00442-2
Gegenfurtner, A. (2013). Transitions of expertise. In J. Seifried & E. Wuttke (Eds.), Transitions in vocational education (pp. 305-319). Opladen: Budrich.
Gegenfurtner, A., Kok, E., Van Geel, K., De Bruin, A., Jarodzka, H., Szulewski, A., & Van Merriënboer, J. J. G. (2017). The challenges of studying visual expertise in medical image diagnosis. Medical Education, 51, 97-104. doi:10.1111/medu.13205
Gegenfurtner, A., Lehtinen, E., & Säljö, R. (2011). Expertise differences in the comprehension of visualizations: A meta-analysis of eye-tracking research in professional domains. Educational Psychology Review, 23, 523-552. doi:10.1007/s10648-011-9174-7
Gegenfurtner, A., Nivala, M., Säljö, R., & Lehtinen, E. (2009). Capturing individual and institutional change: Exploring horizontal versus vertical transitions in technology-rich environments. In U. Cress, V. Dimitrova, & M. Specht (Eds.), Learning in the synergy of multiple disciplines. Lecture Notes in Computer Science (pp. 676-681). Berlin: Springer. doi:10.1007/978-3-642-04636-0_67
Gegenfurtner, A., & Seppänen M. (2013). Transfer of expertise: An eye-tracking and think-aloud study using dynamic medical visualizations. Computers & Education, 63, 393-403. doi:10.1016/j.compedu.2012.12.021
Gegenfurtner, A., Siewiorek, A., Lehtinen, E., & Säljö, R. (2013). Assessing the quality of expertise differences in the comprehension of medical visualizations. Vocations and Learning, 6, 37-54. doi: 10.1007/s12186-012-9088-7
Gegenfurtner, A., & Szulewski, A. (2016). Visual expertise and the Quiet Eye in sports – comment on Vickers. Current Issues in Sport Science, 1, 108. doi:10.15203/CISS_2016.108
Gegenfurtner, A., & Van Merriënboer, J. J. G. (2017). Methodologies for studying visual expertise. Frontline Learning Research.
Gibson, J. (1986). The ecological approach to visual perception. New York: Psychology Press.
Goodwin, C. (1994). Professional vision. American Anthropologist, 96, 606-633. doi:10.1525/aa.1994.96.3. 02a00100
Grill-Spector, K., Knouf, N., & Kanwisher, N. (2004) The fusiform face area subserves face perception, not generic within-category identification. Nature Neuroscience, 7, 555-562. doi:10.1038/nn1224
Gruber, H., Jansen, P., Marienhagen, J., & Altenmüller, E. (2010). Adaptations during the acquisition of expertise. Talent Development & Excellence, 2, 3-15.
Haller, S., & Radue, E. W. (2005). What is different about a radiologist’s brain? Radiology, 236, 983-989. doi:10.1148/radiol.2363041370
Harel, A., Kravitz D., & Baker C. I. (2013). Beyond perceptual expertise: revisiting the neural substrates of expert object recognition. Frontiers in Human Neuroscience, 7, 885. doi:10.3389/fnhum.2013.00885
Harley, E. M., Pope, W. B., Villablanca, J. P., Mumford, J., Suh, R., Mazziotta, J. C., et al. (2009). Engagement of fusiform cortex and disengagement of lateral occipital cortex in the acquisition of radiological expertise. Cerebral Cortex, 19, 2746-2754. doi:10.1093/cercor/bhp051
Helle, L., Nivala, M., Kronqvist, P., Gegenfurtner, A., Björk, P., & Säljö, R. (2011). Traditional microscopy instruction versus process-oriented virtual microscopy instruction: A naturalistic experiment with control group. Diagnostic Pathology, 6, S81-S89. doi:10.1186/1746-1596-6-S1-S8
Hinojosa, J. A., Mercado, F., & Carretié (2015). N170 sensitivity to facial expression: A meta-analysis. Neuroscience & Biobehavioral Reviews, 55, 498-509. doi:10.1016/j.neubiorev.2015.06.002
Holmqvist, K., Nyström, N., Andersson, R., Dewhurst, R., Jarodzka, H., & Van de Weijer, J. (2011). Eye tracking: A comprehensive guide to methods and measures. Oxford: Oxford University Press.
Jarodzka, H., Balslev, T., Holmqvist, K., Nyström, M., Scheiter, K., Gerjets, P., et al. (2012). Conveying clinical reasoning based on visual observation via eye-movement modelling examples. Instructional Science, 40, 813-827. doi:10.1007/s11251-012-9218-5
Jarodzka, H., Jaarsma, T., & Boshuizen, H. P. A. (2015). In my mind: How situation awareness can facilitate expert performance and foster learning. Medical Education, 49, 854-856. doi:10.1111/medu.12791
Kanwisher, N. (2000). Domain specificity in face perception. Nature Neuroscience, 3, 759-763. doi: 10.1038/77664
Kanwisher, N., McDermott, J., & Chun, M. M. (1997). The fusiform face area: A module in human extrastriate cortex specialized for face perception. Journal of Neuroscience, 17, 4302-4311.
Kok, E. M., De Bruin, A. B. H., Robben, S. G. F., & Van Merriënboer, J. J. G. (2012). Looking in the same manner but seeing it differently: Bottom-up and expertise effects in radiology. Applied Cognitive Psychology, 26, 854-862. doi:10.1002/acp.2886
Kok, E. M., Van Geel, K., Van Merriënboer, J. J. G., & Robben, S. G. F. (2017). What we do and do not know about teaching medical image interpretation. Frontiers in Psychology, 8, 309. doi:10.3389/fpsyg.2017.00309
Lehtinen, E. (2012). Learning of complex competences: On the need to coordinate multiple theoretical perspectives. In A. Koskensalo, J. Smeds, R. de Cillia, & Á. Huguet (Eds.), Language: Competencies - change - contact (pp. 13-27). Berlin: LIT.
Maurer, U., Zevin, J. D., & McCandliss, B. D. (2008) Left-lateralized N170 effects of visual expertise in reading: evidence from Japanese syllabic and logographic scripts. Journal of Cognitive Neuroscience 20, 1878-1891. doi:10.1162/ jocn.2008.20125
Melo, M., Scarpin, D. J., Amaro, E., Passos, R. B., Sato, J. R., Friston, K. J., et al. (2011). How doctors generate diagnostic hypotheses: A study of radiological diagnosis with functional magnetic resonance imaging. PLoS ONE, 6, e28752. doi:10.1371/journal.pone.0028752.
Nishimura, M., & Maurer, D. (2008). The effect of categorisation on sensitivity to second-order relations in novel objects. Perception, 37, 584-601. doi:10.1068/p5740
Op de Beeck, H. P., Baker, C. I., DiCarlo, J. J., & Kanwisher, N. G. (2006). Discrimination training alters object representations in human extrastriate cortex. Journal of Neuroscience, 26, 13025-13036. doi:10.1523/JNEUROSCI.2481-06.2006
Qi, Z., Wang, X., Hao, S., Zhu, C., He, W., & Luo, W. (2016). Correlations of electrophysiological measurements with identification levels of ancient Chinese characters. PLoS ONE, 11, e0151133. doi: 10.1371/journal.pone.0151133
Palmeri, T. J., & Gauthier, I. (2004). Visual object understanding. Nature Reviews Neuroscience, 5, 291-303. doi:10.1038/nrn1364
Ribas, L. M., Rocha, F. T., Siqueira Ortega, N. R., Freitas de Rocha, A., & Massad, E. (2013). Brain activity and medical diagnosis: an EEG study. BMC Neuroscience, 14, 109. doi:10.1186/1471-2202-14-109
Richler, J. J., & Gauthier, I. (2014). A meta-analysis and review of holistic face processing. Psychological Bulletin, 140, 1281-1302. doi:10.1037/a0037004
Righi, G. R., Tarr, M., & Kingon, A. (2013). Category-selective recruitment of the fusiform gyrus with chess. In J. Staszewski (Ed.), Expertise and skill acquisition: the impact of William G. Chase (pp. 261-280). New York: Taylor & Francis.
Rossion, B., Gauthier, I., Goffaux, V., Tarr, M. J., & Crommelinck, M. (2002). Expertise training with novel objects leads to left-lateralized facelike electrophysiological responses. Psychological Science, 13, 250-257. doi:10.1111/1467-9280.00446
Rossion, B., Kung, C.-C., & Tarr, M. J. (2004). Visual expertise with nonface objects leads to competition with the early perceptual processing of faces in the human occipitotemporal cortex. Proceedings of the National Academy of Sciences, 101, 14521-14526. doi:10.1073/pnas.0405613101
Säljö, R. (2009). Learning, theories of learning, and units of analysis in research. Educational Psychologist, 44, 202-208. doi:10.1080/00461520903029030
Scott, L. S., Tanaka, J. W., Sheinberg, D. L., & Curran, T. (2006). A reevaluation of electrophysiological correlates of expert object processing. Journal of Cognitive Neuroscience, 18, 1453-1465. doi:10.1162/jocn.2006.18.9.1453
Scott, L. S., Tanaka, J. W., Sheinberg, D. L., & Curran, T. (2008). The role of category learning in the acquisition and retention of perceptual expertise: A behavioral and neurophysiological study. Brain Research, 1210, 204-215. doi:10.1016/j.brainres.2008.02.054
Seppänen, M., & Gegenfurtner, A. (2012). Seeing through a teacher’s eyes improves students’ imaging interpretation. Medical Education, 46, 1113-1114. doi:10.1111/medu.12041
Sergent, J., Ohta, S., & MacDonald, B. (1992). Functional neuroanatomy of face and object processing. A positron emission tomography study. Brain, 115, 15-36. doi:10.1093/brain/115.1.15
Shen, J., Mack, M. L., & Palmeri, T. J. (2014). Studying real-world perceptual expertise. Frontiers in Psychology, 5, 857. doi:10.3389/fpsyg.2014.00857
Siewiorek, A., & Gegenfurtner, A. (2010). Leading to win: The influence of leadership style on team performance during a computer game training. In K. Gomez, L. Lyons, & J. Radinsky (Eds.), Learning in the disciplines (Vol. 1, pp. 524-531). Chicago, IL: International Society of the Learning Sciences.
Squire, L. R., Berg, D., Bloom, F. E., Du Lac, S., Ghosh, A., & Spitzer, N. C. (2013). Fundamental neuroscience (4th ed.). Oxford: Academic Press.
Stern, E., & Schneider, M. (2010). A digital road map analogy of the relationship between neuroscience and educational research. ZDM - The International Journal on Mathematics Education, 42, 511-514. doi:10.1007/s11858-010-0278-1
Szulewski, A., Gegenfurtner, A., Howes, D., Sivilotti, M., & Van Merriënboer, J. J. G. (2017). Measuring physician cognitive load: Validity evidence for a physiologic and a psychometric tool. Advances in Health Sciences Education. doi:10.1007/s10459-016-9725-2
Tanaka, J. W., & Curran, T. (2001). A neural basis for expert object recognition. Psychological Science, 12, 43-47. doi:10.1111/1467-9280.00308
Tarr, M. J., & Gauthier, I. (2000). FFA: a flexible fusiform area for subordinate-level visual processing automatized by expertise. Nature Neuroscience, 3, 764-769. doi:10.1038/77666
Towler, J., Fisher, K., & Eimer, M. (2017). The cognitive and neural basis of developmental prosopagnosia. The Quarterly Journal of Experimental Psychology, 72, 316-344. doi:10.1080/17470218.2016.1165263
Van Geel, K., Kok, E. M., Dijkstra, J., Robben, S. G. F., & Van Merriënboer, J. J. G. (2017). Teaching systematic viewing to final-year medical students improves systematicity but not coverage or detection of radiologic abnormalities. Journal of the American College of Radiology, 14, 235-241. doi:10.1016/j.jacr.2016.10.001
Walsh, V., & Cowey, A. (2000). Transcranial magnetic stimulation and cognitive neuroscience. Nature Reviews Neuroscience, 1, 73-80.
Ward, J. (2006). The student's guide to cognitive neuroscience. New York: Psychology Press.
Wong, A. C.-N., Palmeri, T. J., & Gauthier, I. (2009). Conditions for facelike expertise with objects. Becoming a ziggerin expert—but which type? Psychological Science, 20, 1108-117. doi:10.1111/j.1467-9280.2009.02430.x
Wong, A. C.-N., & Wong, Y. K. (2014). Interaction between perceptual and cognitive processing well acknowledged in perceptual expertise research. Frontiers in Human Neuroscience, 8, 308. doi:10. 3389/fnhum.2014.00308
Xu, Y. (2005). Revisiting the role of the fusiform face area in visual expertise. Cerebral Cortex, 15, 1234-1242. doi:10.1093/cercor/bhi006