‘A double-edged sword. This is powerful but it could be used destructively’: Perspectives of early career researchers on learning analytics

Main Article Content

Jenna Mittelmeier
Rebecca L. Edwards
Sarah K. Davis
Quan Nguyen
Victoria L. Murphy
Leonie Brummer
Bart Rienties

Abstract

Learning analytics has been increasingly outlined as a powerful tool for measuring, analysing, and predicting learning experiences and behaviours. The rising use of learning analytics means that many educational researchers now require new ranges of technical analytical skills to contribute to an increasingly data-heavy field. However, it has been argued that educational data scientists are a ‘scarce breed’ (Buckingham Shum et al., 2013) and that more resources are needed to support the next generation of early career education researchers. At the same time, little is known about how early career researchers feel towards learning analytics and whether it is important to their current and future research practices. Using a thematic analysis of a participatory learning analytics workshop discussions with 25 early career researchers, we outline in this article their ambitions, challenges and anxieties towards learning analytics. In doing so, we have provided a roadmap for how the learning analytics field might progress and practical implications for supporting early career researchers’ development.

Article Details

How to Cite
Mittelmeier, J., Edwards, R. L., Davis, S. K., Nguyen, Q., Murphy, V. L., Brummer, L., & Rienties, B. (2018). ‘A double-edged sword. This is powerful but it could be used destructively’: Perspectives of early career researchers on learning analytics. Frontline Learning Research, 6(2), 20–38. https://doi.org/10.14786/flr.v6i2.348
Section
Articles

References

Agudo-Peregrina, Á. F., Iglesias-Pradas, S., Conde-González, M. Á., & Hernández-García, Á. (2014). Can we predict success from log data in VLEs? Classification of interactions for learning analytics and their relation with performance in VLE-supported F2F and online learning. Computers in Human Behavior, 31, 542-550. doi: 10.1016/j.chb.2013.05.031

boyd, d., & Crawford, K. (2012). Critical questions for big data. Information, Communication & Society, 15(5), 662-679. doi: 10.1080/1369118X.2012.678878

Buckingham Shum, S., & Deakin Crick, R. (2012). Learning dispositions and transferable competencies: Pedagogy, modelling and learning analytics. Paper presented at the Learning Analytics and Knowledge (LAK), Vancouver, Canada.

Buckingham Shum, S., Hawksey, M., Baker, R., Jeffery, N., Behrens, J. T., & Pea, R. (2013). Educational data scientists: A scarce breed. Paper presented at the Learning Analytics and Knowledge (LAK), Leuven, Belgium.

Charleer, S., Klerkx, J., Duval, E., De Laet, T., & Verbert, K. (2016). Creating effective learning analytics dashboards: Lessons learnt. Paper presented at the European Conference on Technology Enhanced Learning (EC-TEL) Lyon, France.

Chatti, M. A., Dyckhoff, A. L., Schroeder, U., & Thüs, H. (2012). A reference model for learning analytics. International Journal of Technology Enhanced Learning, 4(5-6), 318-331. doi: 10.1504/ijtel.2012.051815

Creswell, J. W., & Miller, D. L. (2000). Determining validity in qualitative inquiry. Theory Into Practice, 39(3), 124-130. doi: 10.1207/s15430421tip3903_2

Dalziel, J. (2016). Learning design: Conceptualizing a framework for teaching and learning online. London, UK: Routledge.

Dawson, S., Gasevic, D., Siemens, G., & Joksimovic, S. (2014). Current state and future trends: a citation network analysis of the learning analytics field. Paper presented at the Proceedings of the Fourth International Conference on Learning Analytics And Knowledge, Indianapolis, Indiana, USA.

Dawson, S., & Siemens, G. (2014). Analytics to literacies: The development of a learning analytics framework for multiliteracies assessment. International Review of Research in Open and Distributed Learning, 15(4). doi: 10.19173/irrodl.v15i4.1878

Drachsler, H., & Greller, W. (2016). Privacy and analytics: it's a DELICATE issue a checklist for trusted learning analytics. Paper presented at the Learning Analytics and Knowledge (LAK), Edinburgh, United Kingdom.

Ferguson, R., Brasher, A., Cooper, A., Hillaire, G., Mittelmeier, J., Rienties, B., . . . Vuorikari, R. (2016). Research evidence of the use of learning analytics: Implications for education policy. In R. Vuorikari & J. Castano-Munoz (Eds.), A European Framework for Action on Learning Analytics. Luxembourg: Joint Research Centre Science for Policy Report.

Ferguson, R., Clow, D., Macfadyen, L., Essa, A., Dawson, S., & Alexander, S. (2014). Setting learning analytics in context: Overcoming the barriers to large-scale adoption. Paper presented at the Learning Analytics and Knowledge (LAK), Indianapolis, Indiana, USA.

García, R. M. C., Pardo, A., Kloos, C. D., Niemann, K., Scheffel, M., & Wolpers, M. (2012). Peeking into the black box: Visualising learning activities. International Journal of Technology Enhanced Learning, 4(1-2), 99-120. doi: 10.1504/ijtel.2012.048313

Gašević, D., Dawson, S., & Jovanovic, J. (2016). Ethics and privacy as enablers of learning analytics. Journal of Learning Analytics, 3(1), 4. doi: 10.18608/jla.2016.31.1

Gašević, D., Dawson, S., & Siemens, G. (2015). Let’s not forget: Learning analytics are about learning. TechTrends, 59(1), 64-71. doi: 10.1007/s11528-014-0822-x

Ifenthaler, D., & Widanapathirana, C. (2014). Development and validation of a learning analytics framework: Two case studies using support vector machines. Technology, Knowledge and Learning, 19(1), 221-240. doi: 10.1007/s10758-014-9226-4

Kirschner, P. (2016). Learning analytics: Utopia or dystopia Paper presented at the Learning Analytics and Knowledge (LAK) Keynote. http://lak16.solaresearch.org/?events=keynote-slides-available

Kirschner, P., & Erkens, G. (2013). Toward a framework for CSCL research. Educational Psychologist, 48(1), 1-8. doi: 10.1080/00461520.2012.750227

Kovanovic, V., Gašević, D., Dawson, S., Joksimovic, S., & Baker, R. (2016). Does Time-on-task Estimation Matter? Implications on Validity of Learning Analytics Findings. 2016, 2(3), 81-110. doi: 10.18608/jla.2015.23.6

Kovanovic, V., Gašević, D., Dawson, S., Joksimović, S., Baker, R. S., & Hatala, M. (2015). Penetrating the black box of time-on-task estimation. Paper presented at the Learning Analytics and Knowledge (LAK), Poughkeepsie, New York, USA.

LAK. (2011). Call for Papers: 1st Annual Conference on Learning Analytics and Knowledge.

Lang, C., Siemens, G., Wise, A. F., & Gašević, D. (2017). Handbook of learning analytics: Society for Learning Analytics Research.

Lichtman, M. (2013). Qualitative research in education: A user's guide (3 ed.). Thousand Oaks, CA: SAGE.

Lockyer, L., Heathcote, E., & Dawson, S. (2013). Informing pedagogical action: Aligning learning analytics with learning design. American Behavioral Scientist, 57(10), 1439-1459. doi: 10.1177/0002764213479367

Malmberg, J., Järvelä, S., & Järvenoja, H. (2017). Capturing temporal and sequential patterns of self-, co-, and socially shared regulation in the context of collaborative learning. Contemporary Educational Psychology, 49, 160-174. doi: 10.1016/j.cedpsych.2017.01.009

Merceron, A., Blikstein, P., & Siemens, G. (2016). Learning analytics: From big Data to meaningful data. Journal of Learning Analytics, 2(3), 5. doi: 10.18608/jla.2015.23.2

Mirriahi, N., & Vigentini, L. (2017). Analytics of learner video use. In C. Lang, G. Siemens, A. F. Wise, & D. Gasevic (Eds.), Handbook of learning analytics (pp. 49-57): Society for Learning Analytics Research.

Nguyen, Q., Rienties, B., Toetenel, L., Ferguson, R., & Whitelock, D. (2017). Examining the designs of computer-based assessment and its impact on student engagement, satisfaction, and pass rates. Computers in Human Behavior, 76, 703-714. doi: 10.1016/j.chb.2017.03.028

Papamitsiou, Z., & Economides, A. (2016). Learning analytics for smart learning environments: A meta-analysis of empirical research results from 2009 to 2015. In J. M. Spector, B. B. Lockee, & D. M. Childress (Eds.), Learning, design, and technology: An international compendium of theory, research, practice, and policy (pp. 1-23). London, UK: Springer.

Persico, D., & Pozzi, F. (2015). Informing learning design with learning analytics to improve teacher inquiry. British Journal of Educational Technology, 46(2), 230-248. doi: 10.1111/bjet.12207

Prinsloo, P., & Slade, S. (2017a). An elephant in the learning analytics room: The obligation to act. Paper presented at the Learning Analytics & Knowledge (LAK), Vancouver, Canada.

Prinsloo, P., & Slade, S. (2017b). Ethics and learning analytics: Charting the (un)charted. In C. Lang, G. Siemens, A. F. Wise, & D. Gasevic (Eds.), Handbook of learning analytics (pp. 49-57): Society for Learning Analytics Research.

Rienties, B., & Toetenel, L. (2016). The impact of learning design on student behaviour, satisfaction and performance: A cross-institutional comparison across 151 modules. Computers in Human Behavior, 60, 333-341. doi: 10.1016/j.chb.2016.02.074

Ruppert, E., Harvey, P., Lury, C., Mackenzie, A., McNally, R., Baker, S. A., & Lewis, C. (2015). Socialising big data: from concept to practice. Working Paper Series (No. 138): Centre for Research on Socio-Cultural Change.

Scholes, V. (2016). The ethics of using learning analytics to categorize students on risk. Educational Technology Research and Development, 64(5), 939-955. doi: 10.1007/s11423-016-9458-1

Selwyn, N. (2015). Data entry: Towards the critical study of digital data and education. Learning, Media and Technology, 40(1), 64-82. doi: 10.1080/17439884.2014.921628

Selwyn, N. (2016). Education and technology: Key issues and debates. London: Bloomsbury Publishing.

Sharples, M., de Roock, R., Ferguson, R., Gaved, M., Herodotou, C., Koh, E., . . . Wong, L. H. (2016). Innovating Pedagogy 2016: Open University Innovation Report 5. Milton Keynes: The Open University.

Siemens, G. (2013). Learning analytics: The emergence of a discipline. American Behavioral Scientist, 57(10), 1380-1400. doi: 10.1177/0002764213498851

Slade, S., & Prinsloo, P. (2013). Learning analytics: Ethical issues and dilemmas. American Behavioral Scientist, 57(10), 1510-1529. doi: 10.1177/0002764213479366

Suthers, D., & Verbert, K. (2013). Learning analytics as a "middle space". Paper presented at the Proceedings of the Third International Conference on Learning Analytics and Knowledge, Leuven, Belgium.

Tempelaar, D. T., Rienties, B., & Giesbers, B. (2015). In search for the most informative data for feedback generation: Learning Analytics in a data-rich context. Computers in Human Behavior, 47, 157-167. doi: 10.1016/j.chb.2014.05.038

Tempelaar, D. T., Rienties, B., Mittelmeier, J., & Nguyen, Q. (2017). Student profiling in a dispositional learning analytics application using formative assessment. Computers in Human Behavior, 78, 408-420. doi: 10.1016/j.chb.2017.08.010

van Leeuwen, A., Janssen, J., Erkens, G., & Brekelmans, M. (2015). Teacher regulation of cognitive activities during student collaboration: Effects of learning analytics. Computers & Education, 90, 80-94. doi: 10.1016/j.compedu.2015.09.006

Winne, P. H. (2017). Leveraging big data to help each learner upgrade learning and accelerate learning science. Teachers College Record, 119(13), 1-24.