Methodological Issues in Learning Analytics: Critical Insights and Reflections

By Professor Mark Brown

This brief opinion paper raises a number of conceptual and methodological issues associated with attempts to evaluate institutional initiatives in the area of learning analytics. It frames the discussion around three recent works that invite a more critical reading of learning analytics research and the potential of interventions and data-driven decisions for successful, sustainable and scalable impact on an institution-wide basis.

Firstly, the emerging field of Learning Analytics would benefit from more critical engagement with some of the points raised by Paul Kirschner (2016) in his keynote at the 6th International Conference on Learning Analytics and Knowledge (LAK16). More specifically, Kirschner warns that naïve understandings of learning and narrow conceptions of learning analytics may potentially do a lot of harm.

digital-388075_960_720More recently Kirschner and Neelen (2017) argue that many so-called learning analytics initiatives: (i) view education as a simple process that is easily modelled; (ii) base decisions and interventions on data rich but weak theory; (iii) inform decisions and interventions based on wrong or even invalid variables; (iv) make interpretations and arrive at conclusions that confuse correlations with causality; and (v) result in unintended and unwanted effects that pigeonhole and stereotype learners which may be counterproductive to enhancing student engagement and learner success. Arguably, to date there has not been a serious or comprehensive response to these justifiable concerns.

You can read more of this opinion piece on the ICDE website where the full version of this paper was first published as part of the two-day ICDE Leadership Summit in May 2017 in Nancy, France.

Envisioning Report on Future of Higher Education

The first Envisioning Report for Empowering Universities in the uptake of new modes of teaching and learning was formally launched at a Special EADTU-EU Summit on Open and Flexible Higher Education in Brussels in May 2017.  The report co-edited by Professor Mark Brown is an outcome of the EMPOWER initiative and offers a number of think pieces on the future of higher education. Click here to download a PDF version of the report.


Copies of the report were also distributed to delegates attending the recent ICDE Leadership Summit in Nancy, France (May 22-23, 2017). You can read a brief summary of the highlights of this submit on the ICDE website and the slide-deck from Professor Mark Brown’s talk is available below.