The Promise and Pitfalls of Self-report Development, research design and analysis issues, and multiple methods

Main Article Content

Luke K. Fryer
Daniel L. Dinsmore

Abstract

As a prelude to this special issue on the promise and pitfalls of self-report, this article addresses three issues critical to its current and future use. The development of self-report is framed in Vertical (improvement) and Horizontal (diversification) terms, making clear the role of both paths for continued innovation. The ongoing centrality of research design and analysis in ensuring that self-reported data is employed effectively is reviewed. Finally, the synergistic use of multiple methods is discussed. This article concludes with an overview of the SI's contributions and a summary of the SI's answers to its three central questions: a) In what ways do self-report instruments reflect the conceptualizations of the constructs suggested in theory related to motivation or strategy use? b) How does the use of self-report constrain the analytical choices made with that self-report data? c) How do the interpretations of self-report data influence interpretations of study findings

Article Details

How to Cite
Fryer, L. K., & Dinsmore, D. L. (2020). The Promise and Pitfalls of Self-report: Development, research design and analysis issues, and multiple methods. Frontline Learning Research, 8(3), 1–9. https://doi.org/10.14786/flr.v8i3.623
Section
Articles

References

Bondarev, A., & Greiner, A. (2019). Endogenous growth and structural change through vertical and horizontal innovations. Macroeconomic Dynamics, 23, 52-79. https://doi.org/10.1017/S1365100516001115

Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81-105.

Chauliac, M; Catrysse, L. ; Gijbels, D. & Donche V. (2020). It is all in the surv-eye: can eye tracking data shed light on the internal consistency in self-report questionnaires on cognitive processing strategies? Frontline Learning Research. 8 (3), 26 – 39. https://doi.org/10.14786/flr.v8i3.48

Chiu, M. H., Liaw, H. L., Yu, Y. R., & Chou, C. C. (2019). Facial micro‐expression states as an indicator for conceptual change in students' understanding of air pressure and boiling points. British Journal of Educational Technology, 50, 469-480. https://doi.org/10.1111/bjet.12597

Dingle, G. A., Hodges, J., & Kunde, A. (2016). Tuned In emotion regulation program using music listening: Effectiveness for adolescents in educational settings. Frontiers in Psychology, 7, 859. https://doi.org/10.3389/fpsyg.2016.00859

Dinsmore, D. L. (2017). Towards a dynamic, multidimensional model of strategic processing. Educational Psychology Review, 29, 235-268. https://doi.org/10.1007/s10648-017-9407-5

Dinsmore, D. L., Alexander, P. A., & Loughlin, S. M. (2008). Focusing the conceptual lens on metacognition, self-regulation, and self-regulated learning. Educational Psychology Review, 20, 391-409. https://doi.org/10.1007/s10648-008-9083-6

Durik, A. M. & Jenkins J. S. (2020). Variability in Certainty of Self-Reported Interest: Implications for Theory and Research. Frontline Learning Research. 8 (3) 85-103. https://doi.org/10.14786/flr.v8i3.491

Fyer, L. & Nakao K. (2020). The Future of Survey Self-report: An experiment contrasting Likert, VAS, Slide, and Swipe touch interfaces. Frontline Learning Research, 8 (3),10-25. https://doi.org/10.14786/flr.v8i3.501

Gillet, N., Morin, A. J., Huyghebaert, T., Burger, L., Maillot, A., Poulin, A., & Tricard, E. (2019). University students' need satisfaction trajectories: A growth mixture analysis. Learning and Instruction, 60, 275-285. https://doi.org/10.1016/j.learninstruc.2017.11.003

Ginns, P., Martin, A. J., & Papworth, B. (2018). Student learning in Australian high schools: Contrasting personological and contextual variables in a longitudinal structural model. Learning and Individual Differences, 64, 83-93. https://doi.org/10.1016/j.lindif.2018.03.007

Godfroid, A., & Spino, L. A. (2015). Reconceptualizing reactivity of think‐alouds and eye tracking: Absence of evidence is not evidence of absence. Language Learning, 65, 896-928. https://doi.org/10.1111/lang.12136

Hidi, S. (2016). Revisiting the role of rewards in motivation and learning: Implications of neuroscientific research. Educational Psychology Review, 28(1), 61-93. https://doi.org/10.1007/s10648-015-9307-5

Iaconelli, R. & Wolters C.A. (2020). Insufficient Effort Responding in Surveys Assessing Self-Regulated Learning: Nuisance or Fatal Flaw? Frontline Learning Research. 8 (3) 104 – 125. https://doi.org/10.14786/flr.v8i3.521

Lawless, K. A., & Riel, J. (2020). Exploring the utilization of the big data revolution as a methodology for exploring learning strategy in educational environments. In D.L. Dinsmore, L. K. Fryer, & M. M. Parkinson (Eds.), Handbook of strategies and strategic processing, (pp.296-316). New York: Routledge.

Lawrence, J. G. (2005). Horizontal and vertical gene transfer: The life history of pathogens. Contributions to Microbiology, 12, 255-271.

Kline, R. B. (2011). Principles and practices of structural equation modeling (3 ed.). New York: Guilford Press.

Martin, A.J. (2011). Prescriptive Statements and Educational Practice: What Can Structural Equation Modeling (SEM) Offer? Educational Psychology Review. 23. 235-244. https://doi.org/10.1007/s10648-011-9160-0

Mayer, R. E. (2017). How can brain research inform academic learning and instruction? Educational Psychology Review, 29(4), 835-846. https://doi.org/10.1007/s10648-016-9391-1

Moeller, J. ;Viljaranta, J.; Kracke, B. & Dietrich, J. (2020). Disentangling objective characteristics of learning situations from subjective perceptions thereof, using an experience sampling method design. Frontline Learning Research, 8(3), 63-84. https://doi.org/10.14786/flr.v8i3.529

Pekrun, R. (2020). Self-report is indispensable to assess students’ learning. Frontline Learning Research, 8 (3), 185–193. https://doi.org/10.14786/flr.v8i3.627

Rogiers, A.; Merchie, E. & Van Keer H. (2020). Opening the black box of students’ text-learning processes: A process mining perspective. Frontline Learning Research, 8(3), 40 – 62. https://doi.org/10.14786/flr.v8i3.527

Van Halem, N., van Klaveren, C., Drachsler H., Schmitz, M., & Cornelisz, I. (2020). Tracking Patterns in Self-Regulated Learning Using Students’ Self-Reports and Online Trace Data. Frontline Learning Research, 8(3) 140-163; https://doi.org/10.14786/flr.v8i3.497

Van Meter, P. (2020) Measurement and the Study of Motivation and Strategy Use: Determining If and When Self-report Measures are Appropriate. Frontline Learning Research, 8(3), 174–184. https://doi.org/10.14786/flr.v8i3.631.

Veenman, M. V., Van Hout-Wolters, B. H., & Afflerbach, P. (2006). Metacognition and learning: Conceptual and methodological considerations. Metacognition and Learning, 1, 3-14. https://doi.org/10.1007/s11409-006-6893-0

Vriesema, C.C., & McCaslin, M. (2020) Experience and Meaning in Small-Group Contexts: Fusing Observational and Self-Report Data to Capture Self and Other Dynamics. Frontline Learning Research, 8(3), 126-139. https://doi.org/10.14786/flr.v8i3.493

Winne, P. (2020) A Proposed Remedy for Grievances about Self-Report Methodologies. Frontline Learning Research. 8 (3) 164 -173. https://doi.org/10.14786/flr.v8i3.625

Yuen, A. H., Cheng, M., & Chan, F. H. (2019). Student satisfaction with learning management systems: A growth model of belief and use. British Journal of Educational Technology, 50(5), 2520-2535. https://doi.org/10.1111/bjet.12830

Zimmerman, B. J. (2000). Self-efficacy: An essential motive to learn. Contemporary Educational Psychology, 25, 82-91. https://doi.org/10.1006/ceps.1999.1016