Examining expertise using interviews and verbal protocols

Main Article Content

Margje van de Wiel

Abstract

To understand expertise and expertise development, interactions between knowledge, cognitive processing and task characteristics must be examined in people at different levels of training, experience, and performance. Interviewing is widely used in the initial exploration of domain expertise. Work and cognitive task analysis chart the knowledge, skills, and strategies experts employ to perform effectively in representative tasks. Interviewing may also shed light on the learning processes involved in acquiring and maintaining expertise and the way experts deal with critical incidents. Interviews may focus on specific tasks, events, scenarios, and examples, but they do not directly tap the representations involved in task performance. Methods that collect verbal protocols during and immediately after task performance better probe the ongoing processes in representing problems and accomplishing tasks. This article provides practical guidelines and examples to help researchers to prepare, conduct, analyse, and report expertise studies using interviews and verbal protocols that are derived from thinking aloud, dialogues or group discussions, free recall, explanation, and retrospective reports. In a multi-method approach, these methods and other techniques need to be combined to fully grasp the nature of expertise. This article shows how the cognitive processes in data collection constrain data quality and highlights how research questions guide the development of coding schemes that enable meaningful interpretation of the rich data obtained. It focuses on professional expertise and provides examples from medicine including visual tasks. This comprehensive review of qualitative research methods aims to contribute to the advancement of expertise.

Article Details

How to Cite
van de Wiel, M. (2017). Examining expertise using interviews and verbal protocols. Frontline Learning Research, 5(3), 94–122. https://doi.org/10.14786/flr.v5i3.257
Section
Articles
Author Biography

Margje van de Wiel, Maastricht University

Assistant professor

Department of Work and Social Psychology

Faculty of Psychology and Neuroscience

References

Anderson, J. R. (1996). ACT: A simple theory of complex cognition. American Psychologist, 51(4), 355. doi:10.1037/0003-066X.51.4.355
Bartram, D. (2008). Work profiling and job analysis. In N. Chmiel (Ed.), An introduction to work and organizational psychology: A European perspective (2nd ed.) (pp. 3-28). Oxford, UK: Blackwell.
Brooks, J., McCluskey, S., Turley, E., & King, N. (2015). The utility of template analysis in qualitative psychology research. Qualitative Research in Psychology, 12(2), 202-222. doi:10.1080/14780887.2014.955224.
Boshuizen, H. P. A., & van de Wiel, M. W. J. (1998). Multiple representations in medicine: How students struggle with it. In M. W. van Someren, P. Reimann, H. P. A. Boshuizen, & T. de Jong (Eds.). Learning with multiple representations. Amsterdam, the Netherlands: Elsevier.
Boshuizen, H. P. A., van de Wiel, M. W. J., & Schmidt, H. G. (2012). What and how advanced medical students learn from reasoning through multiple cases. Instructional Science, 40(5), 755-768. doi:10.1007/s11251-012-9211-z.
Boshuizen, H. P. A., & van de Wiel, M. W. J. (2014). Expertise development through schooling and work. In A. Littlejohn, & A. Margaryan (Eds.), Technology-enhanced professional learning: Processes, practices and tools (pp. 71-84). New York, NY: Taylor & Francis/Routledge.
Chase, W. G., & Simon, H. A. (1973). Perception in chess. Cognitive Psychology, 4(1), 55-81.
Chi, M. T. H., (1997). Quantifying qualitative analyses of verbal data: A practical guide. The Journal of the Learning Sciences, 6(3), 271-315. doi:10.1207/s15327809jls0603_1
Chi, M. T. H. (2006a). Two approaches to the study of experts’ characteristics. In K. A. Ericsson, N. Charness, P. J. Feltovich, & R. R. Hoffman (Eds.), The Cambridge handbook of expertise and expert performance (pp. 21-30). New York, NY: Cambridge University Press.
Chi, M. T. H. (2006b). Laboratory methods for assessing experts’ and novices’ knowledge. In K. A. Ericsson, N. Charness, P. J. Feltovich, & R. R. Hoffman (Eds.), The Cambridge handbook of expertise and expert performance (pp. 167-184). New York, NY: Cambridge University Press.
Chi, M. T. H., Bassok, M., Lewis, M. W., Reimann, P., & Glaser, R. (1989). Self-explanations: How students study and use examples in learning to solve problems. Cognitive Science, 13(2), 145-182. doi:10.1016/0364-0213(89)90002-5
Chi, M. T. H., Feltovich, P. J., & Glaser, R. (1981). Categorization and representation of physics problems by experts and novices, Cognitive Science, 5, 121-152. doi:10.1207/s15516709cog0502_2
Chi, M. T. H., Glaser R., & Farr, M. J. (1988). The nature of expertise. Hillsdale, NJ: Lawrence Erlbaum.
Chipman, S. F., Schraagen, J. M., & Shalin, V. L. (2000). Introduction to cognitive task analysis. In J. M. Schraagen, S. F. Chipman, & V. L. Shalin (Eds.), Cognitive task analysis (pp. 3-23). Mahwah, NJ: Lawrence Erlbaum.
Claessen, H. F. A., & Boshuizen, H. P. A. (1985). Recall of medical information by students and doctors. Medical Education, 19(1), 61-67. doi:10.1111/j.1365-2923.1985.tb01140.x
Craik, F. I. (2002). Levels of processing: Past, present... and future? Memory, 10(5-6), 305-318. doi:10.1080/09658210244000135
Custers, E. J. (2013). Medical education and cognitive continuum theory: An alternative perspective on medical problem solving and clinical reasoning. Academic Medicine, 88(8), 1074-1080. doi:10.1097/ACM.0b013e31829a3b10
Deakin, H., & Wakefield, K. (2014). Skype interviewing: Reflections of two PhD researchers. Qualitative Research, 14(5), 603-616. doi:10.1177/1468794113488126
de Bruin, A. B. H., van de Wiel, M. W. J.,. Rikers, R. M. J. P, & Schmidt, H. G. (2005). Examining the stability of experts’ clinical case processing: An experimental manipulation. Instructional Science, 33, 251-270. doi:10.1007/s11251-005-3598-8
De Grave, W. S., Boshuizen, H. P. A., & Schmidt, H. G. (1996). Problem based learning: Cognitive and metacognitive processes during problem analysis. Instructional Science, 24(5), 321-341. doi:10.1007/BF00118111
de Groot, A. D. (1978). Thought and choice in chess. (2nd ed). The Hague, The Netherlands: Mouton. (Original work published in 1946)
de Leng, B., Dolmans, D., van de Wiel, M. W. J., Muijtjens, A., & van der Vleuten, C. (2007). How video cases should be used as authentic stimuli in problem-based medical education. Medical Education,41, 181-188. doi:10.1111/j.1365-2929.2006.02671.x
Diemers, A. D., van de Wiel, M. W. J., Scherpbier, A. J., Baarveld, F., & Dolmans, D. H. (2015). Diagnostic reasoning and underlying knowledge of students with preclinical patient contacts in PBL. Medical education, 49(12), 1229-1238. doi:10.1111/medu.12886.
Diemers, A. D., van de Wiel, M. W. J, Heineman, E., Scherpbier, A. J. J. A., & Dolmans D. H. J. M. (2011). Pre-clinical patient contacts and the application of biomedical and clinical knowledge. Medical Education, 45, 280-288. doi:10.1111/j.1365-2923.2010.03861.x.
DuBois, D., & Shalin, V. L. (2000). Describing job expertise using cognitively oriented task analyses (COTA). In J. M. Schraagen, S. F. Chipman, & V. L. Shalin (Eds.), Cognitive task analysis (pp. 41-55). Mahwah, NJ: Lawrence Erlbaum.
Elstein, A. S., & Schwarz, A. (2002). Clinical problem solving and diagnostic decision making: Selective review of the cognitive literature. British Medical Journal, 324, 729-732.
Elstein, A. S., Shulman, L. S., & Sprafka, S. A. (1978). Medical problem solving: An analysis of clinical reasoning. Cambridge, MA: Harvard University Press.
Emans, B. (2004). Interviewing: Theory, techniques and training. Groningen, The Netherlands: Wolters-Noordhoff.
Ericsson, K. A. (1996). The acquisition of expert performance: An introduction to some of the issues. In K. A. Ericsson (Ed.), The road to excellence: The acquisition of expert performance in the arts and sciences, sports and games.Mahwah, NJ: Lawrence Erlbaum.
Ericsson, K. A. (2004). Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains. Academic Medicine, 79(10 Suppl), S70-81. doi:00001888-200410001-00022
Ericsson, K. A. (2006a). An introduction to the Cambridge handbook of expertise and expert performance: Its development, organization, and content. In K. A. Ericsson, N. Charness, P. J. Feltovich, & R. R. Hoffman (Eds.), The Cambridge handbook of expertise and expert performance (pp. 3-19). New York, NY: Cambridge University Press.
Ericsson, K. A. (2006b). Protocol analysis and expert thought: Concurrent verbalisations of thinking during experts’ performance on representative tasks. In K. A. Ericsson, N. Charness, P. J. Feltovich, & R. R. Hoffman (Eds.), The Cambridge handbook of expertise and expert performance (pp. 223-241). New York, NY: Cambridge University Press.
Ericsson, K. A. (2009). Development of professional expertise: Toward measurement of expert performance and design of optimal learning environments. New York, NY: Cambridge University Press.
Ericsson, K. A. (2015). Acquisition and maintenance of medical expertise: A perspective from the expert-performance approach with deliberate practice. Academic Medicine, 90(11), 1471-1486. doi:10.1097/ACM.0000000000000939
Ericsson, K. A. (2014). How to gain the benefits of the expert performance approach in domains where the correctness of decisions are not readily available: A reply to Weiss and Shanteau. Applied Cognitive Psychology, 28(4), 458-463. doi:10.1002/acp.3029
Ericsson, K. A., & Kintsch, W. (1995). Long-term working memory. Psychological Review, 102(2), 211-245. doi:10.1037/0033-295X.102.2.211
Ericsson, K. A., Krampe, R. T., & Tesch-Römer, C. (1993). The role of deliberate practice in the acquisition of expert performance. Psychological Review, 100(3), 363-406. doi:10.1037/0033-295X.100.3.363
Ericsson, K. A., Patel, V., & Kintsch, W. (2000). How experts' adaptations to representative task demands account for the expertise effect in memory recall: Comment on Vicente and Wang (1998). Psychological Review, 107(3), 578-592. doi:10.1037/0033-295X.107.3.578
Ericsson, K. A., & R. Poole (2016). Peak: Secrets from the new science of expertise. London, UK: The Bodley Head.
Ericsson, K. A., & Simon, H. A. (1980). Verbal reports as data. Psychological Review, 87(3), 215-251. doi:10.1037/0033-295X.87.3.215
Ericsson, K. A., & Simon, H. A. (1993). Protocol analysis: Verbal reports as data. Cambridge, MA: MIT Press.
Ericsson, K. A., & Smith, J. (1991). Prospects and limits of the empirical study of expertise: An introduction. In K. A. Ericsson, & J. Smith (Eds.), Toward a general theory of expertise: Prospects and limits (pp. 1-38). Cambridge: Cambridge University Press.
Evetts, J., Mieg, H. A., & Felt, U. (2006). Professionalization, scientific expertise, and elitsm: A sociological perspective. In K. A. Ericsson, N. Charness, P. J. Feltovich, & R. R. Hoffman (Eds.), The Cambridge handbook of expertise and expert performance (pp. 105-123). New York, NY: Cambridge University Press.
Feltovich, P. J., & Barrows, H. S. (1984). Issues of generality in medical problem solving. In H. G. Schmidt, & M. L. De Volder (Eds.), Tutorials in problem-based learning. New directions in training for the health professions, (pp. 128-142). Assen/Maastricht: Van Gorcum.
Feltovich, P. J., Prietula, M. J., & Ericsson, A. (2006). Studies of expertise from psychological perspectives. In K. A. Ericsson, N. Charness, P. J. Feltovich, & R. R. Hoffman (Eds.), The Cambridge handbook of expertise and expert performance (pp. 41-67). New York, NY: Cambridge University Press.
Flanagan, J. C. (1954). The critical incident technique. Psychological Bulletin, 51(4), 327. doi:10.1037/h0061470
Gegenfurtner, A., Siewiorek, A., Lehtinen, E., & Säljö, R. (2013). Assessing the quality of expertise differences in the comprehension of medical visualizations. Vocations and Learning, 6(1), 37-54. doi:10.1007/s12186-012-9088-7.
Gilhooly, K. J., McGeorge, P., Hunter, J., Rawles, J. M., Kirby, I. K., Green, C., &Wynn, V. (1997). Biomedical knowledge in diagnostic thinking: The case of electrocardiogram(ECG) interpretation, European Journal of Cognitive Psychology, 9(2), 199-223. doi:10.1080/713752555.
Hamm, R. M. (1988). Clinical intuition and clinical analysis: Expertise and the cognitive continuum. In J. Dowie, & A. Elstein (Eds.), Professional judgment: A reader in clinical decision making, (pp.78-105). Cambridge, MA: Cambridge University Press.
Hammond, K. R., Hamm, R. M., Grassia, J., & Pearson, T. (1987). Direct comparison of the efficacy of intuitive and analytical cognition in expert judgment. Transactions on Systems, Man and Cybernetics, IEEE, 17(5), 753-770. doi:10.1109/TSMC.1987.6499282
Hashem, A., Chi, M. T., & Friedman, C. P. (2003). Medical errors as a result of specialization. Journal of Biomedical Informatics, 36(1), 61-69. doi:10.1016/S1532-0464(03)00057-1
Hassebrock, F., & Prietula, M. J. (1992). A protocol-based coding scheme for the analysis of medical reasoning. International Journal of Man-Machine Studies, 37(5), 613-652. doi:10.1016/0020-7373(92)90026-H.
Hatala, R., Norman, G. R., & Brooks, L. R. (1999). Impact of a clinical scenario on accuracy of electrocardiogram interpretation. Journal of General Internal Medicine, 14(2), 126-129. doi:10.1111/j.1525-1497.1999.tb00008.x
Helle, L. (2017). Prospects and pitfalls in combining eye-tracking data and verbal reports. Frontline Learning Research, 5(3), 1-12. doi:10.14786/flr.v5i3.254
Hoffman, R. R., & Lintern, G. (2006). Eliciting and representing the knowledge of experts. In K. A. Ericsson, N. Charness, P. J. Feltovich, & R. R. Hoffman (Eds.), The Cambridge handbook of expertise and expert performance (pp. 203-222). New York, NY: Cambridge University Press.
Hoffman, R. R., Shadbolt, N. R., Burton, A. M., & Klein, G. (1995). Eliciting knowledge from experts: A methodological analysis. Organizational behavior and human decision processes, 62(2), 129-158.
Hsieh, H. F., & Shannon, S. E. (2005). Three approaches to qualitative content analysis. Qualitative Health Research, 15(9), 1277-1288. doi:10.1177/1049732305276687
Jaarsma, T., Jarodzka, H., Nap, M., Merrienboer, J. J. G., & Boshuizen, H. P. A. (2014). Expertise under the microscope: Processing histopathological slides. Medical Education, 48(3), 292-300. doi:10.1111/medu.12385.
Kahneman, D., & Klein, G. (2009). Conditions for intuitive expertise: A failure to disagree. American Psychologist, 64(6), 515-526. doi:10.1037/a0016755
King, N., & Horrocks, C. (2010). Interviews in qualitative research. London, UK: Sage.
Klein, G. (2008). Naturalistic decision making. Human Factors, 50(3), 456-460. doi:10.1518/001872008X288385.
Kok, E. M., Jarodzka, H., de Bruin, A. B. H., BinAmir, H. A. N., Robben, S. G. F., & van Merriënboer, J. J. G. (2015). Systematic viewing in radiology: Seeing more, missing less?. Advances in Health Sciences Education, 1-17. doi:10.1007/s10459-015-9624-y.
Kok, E. M., de Bruin, A. B. H., Robben, S. G. F., & van Merriënboer, J. J. G. (2013). Learning radiological appearances of diseases: Does comparison help? Learning and Instruction, 23, 90-97. doi:10.1016/j.learninstruc.2012.07.004.
Krippendorff, K. (2012). Content analysis: An introduction to its methodology (3rd ed.). Newsbury Park, CA: Sage.
Krueger, R. A., & Casey, M. A. (2015). Focus groups: A practical guide for applied research (5th edition). Thousand Oaks, CA: Sage.
Kulatunga-Moruzi, C., Brooks, L. R., & Norman, G. R. (2004). Using comprehensive feature lists to bias medical diagnosis. Journal of Experimental Psychology: Learning, Memory, and Cognition, 30(3), 563-572. doi:10.1037/0278-7393.30.3.563
Lesgold, A., Rubinson, H., Feltovich, P., Glaser, R., Klopfer, D., Wang, Y., et al. (1988). Expertise in a complex skill: Diagnosing x-ray pictures. In M. T. H. Chi, R. Glaser, & M. J. Farr (Eds.), The nature of expertise (pp. 311-342). Hillsdale, NJ: Lawrence Erlbaum.
Lesgold, A. (2000). On the future of cognitive task analysis. In J. M. Schraagen, S. F. Chipman, & V. L. Shalin (Eds.), Cognitive task analysis (pp. 451-465). Mahwah, NJ: Lawrence Erlbaum.
Mieg, H. A. (2006). Social and sociological factors in the development of expertise. In K. A. Ericsson, N. Charness, P. J. Feltovich, & R. R. Hoffman (Eds.), The Cambridge handbook of expertise and expert performance (pp. 743-760). New York, NY: Cambridge University Press.
Morgan, D. L. (1996). Focus groups as qualitative research (2nd ed.). Thousand Oaks, CA: Sage.
Neuendorf, K. A. (2002). The content analysis guidebook. Thousand Oaks, CA: Sage.
Neufeld, V. R., Norman, G. R., Feightner, J. W., & Barrows, H. S. (1981). Clinical problem-solving by medical students: A cross-sectional and longitudinal analysis. Medical Education, 15(5), 315-322. doi:10.1111/j.1365-2923.1981.tb02495.x
Norman, G. R., Brooks, L. R., & Allen, S. W. (1989). Recall by expert medical practitioners and novices as a record of processing attention. Journal of Experimental Psychology: Learning, Memory, and Cognition, 15(6), 1166-1174. doi:10.1037/0278-7393.15.6.1166
Norman, G. R., Eva, K., Brooks, L., & Hamstra, S. (2006). Expertise in medicine and surgery. In K. A. Ericsson, N. Charness, P. J. Feltovich, & R. R. Hoffman (Eds.), The Cambridge handbook of expertise and expert performance (pp. 339-354). New York, NY: Cambridge University Press.
Patel, V. L., & Arocha, J. F. (2001). The nature of constraints on collaborative decision making in health care settings. In E. Salas, & Klein, G. (Eds.), Linking expertise and naturalistic decision making (pp. 383-405).Mahwah, NJ: Lawrence Erlbaum.
Patel, V. L., & Groen, G. J. (1986). Knowledge based solution strategies in medical reasoning. Cognitive Science, 10(1), 91-116. doi:10.1207/s15516709cog1001_4
Patel, V. L., Kaufman, D. R., & Magder, S. A. (1996). The acquisition of medical expertise in complex dynamic environments. In K .A. Ericcson (Ed.), The road to excellence: The acquisition of expert performance in the arts and sciences, sports and games, (pp. 127-165). Mahwah, NJ: Lawrence Erlbaum.
Prince, K. J. A. H., van de Wiel, M. W. J., van der Vleuten, C. P. M., Boshuizen, H. P. A., & Scherpbier, A. J. J. A. (2004). Junior doctors' opinions about the transition from medical school to clinical practice: A change of environment. Education for Health, 17(3), 323-331. doi:10.1080/13576280400002510
Salas, E., & Klein, G. A. (Eds .) (2001). Linking expertise and naturalistic decision making. Mahwah, NJ: Lawrence Erlbaum.
Salas, E., Rosen, M. A., Burke, C. S., Goodwin, G. F., & Fiore, S. M. (2006). The making of a dream team: When expert teams do best. In K. A. Ericsson, N. Charness, P. J. Feltovich, & R. R. Hoffman (Eds.), The Cambridge handbook of expertise and expert performance (pp. 439-453). Cambridge, UK: Cambridge University Press.
Sanchez, J. I., & Levine, E. L. (2012). The rise and fall of job analysis and the future of work analysis. Annual Review of Psychology, 63, 397-425. doi: 10.1146/annurev-psych-120710-100401.
Schmidt, H. G., & Boshuizen, H. P. A. (1993). On the origin of intermediate effects in clinical case recall. Memory and Cognition, 21, 338 - 351. doi:10.3758/BF03208266
Shanteau, J. (1992). Competence in experts: The role of task characteristics. Organizational Behavior and Human Decision Processes, 53(2), 252-266.
Shanteau, J., Weiss, D. J., Thomas, R. P., & Pounds, J. C. (2002). Performance-based assessment of expertise: How to decide if someone is an expert or not. European Journal of Operational Research, 136(2), 253-263.
Skopec, E. W. (1986). Situational interviewing. Prospects Heights, II: Waveland Press.
Stalmeijer, R. E., McNaughton, N., & Van Mook, W. N. K. A. (2014). Using focus groups in medical education research: AMEE Guide No. 91. Medical Teacher, 36(11), 923-939. doi:10.3109/0142159X.2014.917165
Stolper, E., van Bokhoven, M., Houben, P., Van Royen, P., van de Wiel, M. W. J., van der Weijden, T., & Dinant, G. J. (2009). The diagnostic role of gut feelings in general practice. A focus group study of the concept and its determinants.BMC FamilyPractice, 10(1), 17. doi:10.1186/1471-2296-10-17.
Stolper, E., van de Wiel, M. W. J., Hendriks, R. H. M., Van Royen, P., Van Bokhoven, M., Van der Weijden, T., & Dinant, G. J. (2015). How do gut feelings feature in tutorial dialogues on diagnostic reasoning in GP traineeship? Advances in Health Sciences Education, 20, 499-513. doi:10.1007/s10459-014-9543-3.
Stolper, E., van de Wiel, M. W. J., van Bokhoven, M., Van Royen, P., van der Weijden, T., & Dinant, G. J. (2011). Gut feelings as a third track in general practitioners’ diagnostic reasoning. Journal of General Internal Medicine, 26, 197-203. doi:10.1007/s11606-010-1524-5.
Shadbolt, N. R., & Smart, P. R. (2015) Knowledge elicitation. In J. R. Wilson, & S. Sharples (Eds.), Evaluation of Human Work (4th ed.). Boca Raton, FL: CRC Press.
Tracey, T. J., Wampold, B. E., Lichtenberg, J. W., & Goodyear, R. K. (2014). Expertise in psychotherapy: An elusive goal? American Psychologist, 69(3), 218- 229. doi:10.1037/a0035099
van de Wiel, M. W. J., Boshuizen, H. P. A., & Schmidt, H. G. (2000). Knowledge restructuring in expertise development: Evidence from pathophysiological representations of clinical cases by students and physicians. European Journal of Cognitive Psychology, 12(3), 323-355. doi:10.1080/09541440050114543
van de Wiel, M. W. J., Boshuizen, H. P. A., Schmidt, H. G. & Schaper, N. C. (1999). The explanation of medical concepts by expert physicians, clerks and advanced students. Teaching and Learning in Medicine, 11(3), 153-163. doi:10.1207/S15328015TL110306
van de Wiel, M. W. J., Ploegh, K., Boshuizen, H. P. A., & Schmidt, H. G. (2005). The influence of diagnosis and memorization instructions on clinical case processing by students and physicians. Paper presented at the Annual Meeting of the American Educational Research Association 2005. Montreal, Canada, April 11-15.
van de Wiel, M. W. J., Schaper, N. C., Scherpbier, A. J. J. A., Van der Vleuten, C. P. M., & Boshuizen, H. P. A. (1999). Students' experiences with real patient tutorials in a problem-based curriculum. Teaching and Learning in Medicine, 11(1), 12-20. doi:10.1207/S15328015TLM1101_5
van de Wiel, M. W. J., & Schmidt, H. G., Boshuizen, H. P. A. (1998). A failure to reproduce the intermediate effect in clinical case recall. Academic Medicine, 73(8), 894-900.
van de Wiel, M. W. J., & Van den Bossche, P. (2013). Deliberate practice in medicine: The motivation to engage in work-related learning and its contribution to expertise. Vocations and Learning, 6(1), 135-158. doi:10.1007/s12186-012-9085-x.
van de Wiel, M. W. J., Van den Bossche, P., Janssen, S., & Jossberger, H. (2011). Exploring deliberate practice in medicine: How do physicians learn in the workplace? Advances in Health Sciences Education.16(1), 81-95. doi:10.1007/s10459-010-9246-3.
van de Wiel, M. W. J., Van den Bossche, P., & Koopmans, R. P. (2011). Deliberate practice, the high road to expertise: K.A. Ericsson. In Dochy, F., Gijbels, D., Segers, M., & Van den Bossche, P. (Eds.), Theories of learning for the workplace: Building blocks for training and professional development programs (pp. 1-16). London, UK: Routledge.
van Gog, T., Paas, F., Van Merriënboer, J. J., & Witte, P. (2005). Uncovering the problem-solving process: Cued retrospective reporting versus concurrent and retrospective reporting. Journal of Experimental Psychology: Applied, 11(4), 237-244. doi:10.1037/1076-898X.11.4.237
van Someren, M. V., Barnard, Y. F., & Sandberg, J. A. (1994). The think aloud method: A practical approach to modelling cognitive processes. London, UK: Academic Press.
Weiss, D. J., & Shanteau, J. (2003). Empirical assessment of expertise. Human Factors, 45(1), 104-116.
Wimmers, P. F., Schmidt, H. G., Verkoeijen, P. P. J. L., & van de Wiel, M. W. J. (2005). Inducing expertise effects in clinical case recall through the manipulation of processing. Medical Education, 39, 949-957. doi:10.1111/j.1365-2929.2005.02250.x