Good Reads from 2021: Our NIDL Top 10 Journal Articles – Part 3

This is the third and final blog post in the process of introducing our NIDL top 10 “good reads” for 2021. Next week we will be sharing a separate list of “good reads” from last year with a specific COVID-related focus. In our first and second blog posts, we established the background context and explained how we go about selecting our annual list of top 10 “good reads”. 

In this final post, we begin by sharing some of the descriptive features of our 2021 selections and report on how they compare with those chosen over the previous five years. We then share our list of top 10 “good reads” for 2021 along with a brief commentary on each article helping to explain the rationale behind each selection. Finally, we offer five additional highly recommended articles and briefly comment on the gaps in our selections and the importance of continuing to access and keep a watchful eye on literature that can only be found in restricted publications. 

What’s included in this year’s top 10? 

We begin by sharing some interesting observations and providing comparative data on this year’s top 10 articles. Firstly, for the third year running a higher proportion of women authors feature in the list, as illustrated in Table 1. This reverses a trend over the first three years of our selections.

Table 2 shows that the number of multiple authored articles in the top 10 list consists of 50% of the final selection. Only two articles are single authored which is consistent with previous years. 

Notably, one author features in three of this year’s top 10 selections and another in two of them. The former author, Aras Bozkurt, has now featured in eight of the top 10 articles over the past six years. This number is matched by Olaf Zawacki-Richter who also features in this year’s selections and their prominence, along with Melissa Bond (n=4), reflects our bias towards major literature reviews. Another nine authors (Gourley, Kalz, Knox, Lee, Lundin, Sangra, Selwyn, Shea, & Weller) have featured twice in our annual top 10 “good reads” since we began this exercise.

This year’s No 1 article appears in E-Learning and Digital Media which appears for the first time. As shown in Table 3, an article published in the Australasian Journal of Educational Technology took the No 1 spot over the first four years of selections. This year, two articles once again feature from this journal. In total, eight journals feature in this year’s top 10 list, with three appearing for the first time. Another new journal features in our list of five highly recommended articles, with the other four appearing in the International Review of Research in Open and Distributed Learning and the International Journal of Educational Technology in Higher Education.

Table 4 illustrates the distribution of journals included in the top 10 selections over the past six years. While some journals remain a consistent source of “good reads”, it is noteworthy that around 30% of the selected articles come from other types of journals, which we believe reflects our deliberate attempt to source a wide and diverse range of publications. In a similar pattern to 2020, this year half of our top 10 articles feature in such journals. 

We are less successful in selecting journal articles that are evenly spread in terms of geographical distribution. Table 5 reveals the dominance of English language speaking countries, with around 25% of the top 10 articles over the last six years having authors located in North America. While there is a strong trend of collaboration by authors across regions, which helps to increase the actual level of geographical inclusion, Asia, Africa and South America rarely feature in our selections. 

This year, six articles fall under the ‘across region’ category and for only the second time in six years there are no publications from authors exclusively based in North America. Having said that, three of our highly recommended articles have authors from this region, although we are pleased to report one is written by scholars based in South America. The other comes from Australasia. 

What are the top 10 articles for 2021?

The specific rank order of each article remains one of the most contentious aspects of the selection exercise, but to maintain consistency we have retained this practice.

Before listing our top 10 “good reads” in rank order, we would like to congratulate all of the authors who appear in our selections, including those in the highly recommended category.

We hope that you value this recognition of your work as it arises from lots of reading and a systematic review process. Additionally, we also trust that people find our brief notes on each article useful and they do justice to the authors and adequately describe the main focus and major contribution of each selection. The intention is to help explain why the article was selected as a top 10 “good read” and hopefully entice more people to slow read the ideas, thinking and perspectives contained in the writing and analysis of data.

No 1 – Selwyn, N. (2021). Ed-Tech within limits: Anticipating educational technology in times of environmental crisis. E-Learning and Digital Media, 18 (5), 496–510. https://doi.org/10.1177/20427530211022951

This article meets the criteria of challenging conventional thinking and stands out for the way it locates educational technology within wider societal concerns about climate change, ecological instability and environmental issues. While there have been several claims over the years that distance education is environmentally friendly and offers the opportunity to develop a low carbon higher education system, this article goes beyond any ‘feel good’ factor by raising serious questions about the ‘greening’ of schools and university provision through new digital technologies.

As Facer and Selwyn (2021) point out in a related UNESCO background paper, online learning may be an environmental solution to lowering emissions but massively increased global use of digital technologies in education require unsustainable levels of energy and place huge demands on natural resource consumption. They note that this includes the ‘dirty’ aspects of digital hardware production, the vast energy requirements of data-processing centres and the increasing problem of e-waste.

The uncomfortable truth is that these concerns feature rarely in the literature, despite evidence that the COVID reset has been a boon for the EdTech sector and this growth is likely to continue bolstering the uptake of new digital technologies for teaching and learning purposes. While the author acknowledges that technology can also be of the solution during a time of crisis, the sobering point is further planetary degradation may over the next decade put paid to ‘abundant’ and taken-for-granted forms of digital technology use. Therefore, the article calls for a new ‘within limits’ paradigm of educational technology that is both sustainable and more intentionally targeted towards addressing major societal challenges and those facing disadvantaged groups.

There is no question that this paper achieves its stated goal of provoking the field of educational technology to revalue, reconfigure, reprioritise and move beyond a complacency when it comes to the environmental crisis. The urgency and seriousness of this challenge left us with little choice when it came to ranking this year’s No 1 article, and we encourage everyone to ‘slow read’ and critically reflect on the big issues raised by the author as we plan for an unknown future. 

No 2 – Gourlay, L. (2021). There is no ‘virtual learning’: The materiality of digital education. Journal of New Approaches in Educational Research, 10 (1), 57-66. https://doi.org/10.7821/naer.2021.1.649

This article stands out for what is says on the tin—that is, ‘there is no virtual learning’. It offers a deep, thoughtful and convincing argument why the notion of ‘virtual learning’ is a flawed one. The author draws on Sociomaterial and Posthuman theoretical perspectives to challenge the false binary between virtual and face-to-face forms of learning, with a central thesis highly relevant to practitioners, institutional leaders and educational policy-makers.

Even if readers are unfamiliar with some of the theoretical literature, the article illustrates, through several examples, why we need to challenge our traditional conceptions and understandings of space, distance, absence, and presence in digital higher education. It demonstrates the embodied nature of digital technologies and how they are entangled in our day-to-day living and learning. In practical terms, the article makes the case that all learning and digital engagement is ‘in person’ and therefore we need to change our thinking, modify our language and redefine traditional delivery modes to reflect this more complex reality.

More generally, the paper reminds us to be critical of dominant technologically deterministic notions which position ‘the digital’ as a separate or independent driving force from education and society. Further extrapolating the notion of ‘entanglement’ reveals the naivety of the popular tool metaphor for learning technology, which falsely implies a degree of neutrality. It also brings into question efforts to disembody ‘the digital’ from the interwoven nature of pedagogy as educators rally to the appeal of ‘pedagogy-first’. 

No 3 – Gourlay, L., Rodríguez-Illera, J.L. et al. (2021). Networked learning in 2021: A community definition. Postdigital Science and Education 3, 326–369. https://doi.org/10.1007/s42438-021-00222-y

This article also focuses on the language we use and the values and thinking this reflects in a highly engaging discussion on networked conceptions of learning. It begins by outlining how instrumentalist understandings and managerialist approaches to digital education have permeated our thinking in the field and traces the emergence of networked learning as a response to the dominant discourses of the day. This discussion returns to the fore the critical and emancipatory agenda underlying the notion of networked learning and those who formed the original academic and research community.

However, the paper acknowledges that a lot has changed since the definition of network learning over two decades ago and therefore it takes up the challenge to reframe the current meaning and understanding for future directions and developments. What makes the article unique is the way it is collectively authored by 40 contributors from six continents working across many fields of education. Moreover, the reviewers are acknowledged as authors as their feedback and viewpoints are incorporated within the paper.

While there was always a risk that contributions from so many different authors under separate headings may have resulted in a disjointed collection of works, this concern is unwarranted as the conversation is seamless and insightful as each section adds a new perspective and often critical twist to the search for a refined and potentially unified definition. What really stands out from the discussion is how difficult it is to define the undefinable and how our search for commons definitions and to pin down our language can inadvertently narrow thinking and foreclose on different perspectives.

As Siân Bayne writes in her contribution to the article, “To define a field is necessarily to put boundaries around it, to determine which writings, conversations, people are ‘inside’ and which are ‘outside’ (Gourlay, L., Rodríguez-Illera, J.L. et al., 2021, p. 333). This point has wider relevance beyond efforts to redefine network learning as there several ongoing definition wars in the wider field of educational technology. In summary, we recommend this article as it helps to stretch the current digital horizon to longer-term societal goals of equity and social justice through a rich variety of perspectives. 

No 4 – Castaneda, L., & Williamson, B. (2021). Assembling new toolboxes of methods and theories for innovative critical research on educational technology. Journal of New Approaches in Educational Research, 10 (1), 1-14. http://dx.doi.org/10.7821/naer.2021.1.703

This article continues the theme of critique and reminds us of the importance of ‘public intellectuals’ in the face of greater interest, reinvigorated attention and competing agenda promoting the potential of educational technology. Importantly, the authors point out that many of the concerns that have played out in the backdrop of the COVID crisis mirror issues already raised in previous research.

They highlight enduring tensions and often politicized debates between techno-utopian enthusiasts, sometimes referred to as ‘Boosters’ or ‘Deschoolers’ (Brown, et al, 2019), who promote the disruptive and transformative benefits of digital technology, and those offering more critical voices. While not singled out in the article it is useful to emphasise that those labelled as ‘critics’ are often confused with a group of techno-dystopian detractors, or ‘Doomsters’ (Brown, et al, 2019), who repeat arguments from previous moral panics or draw on a demon perspective to suggest a technocratic nightmare.

Arguably, true critics adopt a multi-focal lens recognising that educational technology needs to be framed beyond crude binary positions of good or bad. As the authors point out, neither boom or threat positions offer a constructive path forward. More specifically, they go on to share their concerns that current preoccupation with evidence of ‘what works’ in relation to ‘EdTech’ risks deflecting attention away from crucial educational questions that consider more complex and wider societal issues. In this sense, the article helps us to keep the bigger picture in mind alerts us to the danger of getting caught up in the digital forest.

A related concern is the need for critical research and theorising to evolve fast if we are to shape and influence the field, especially given the emergence of “Big EdTech” (Brown, 2021) with powerful new actors attempting to accelerate the pace and scale of change. With the objective of helping to assemble new toolboxes for critical research and innovative approaches, the article identifies several current gaps and under-researched issues. It introduces a valuable collection of papers that offer exemplars and useful guiding beacons for future lines of research and development.

No 5 – Tamim, R. M., Borokhovski, E., Bernard, R. M., Schmid, R. F., Abrami, P. C., & Pickup, D. I. (2021). A study of meta-analyses reporting quality in the large and expanding literature of educational technology. Australasian Journal of Educational Technology37(4), 100–115. https://doi.org/10.14742/ajet.6322

This article makes a valuable contribution by recognising that not all meta-analyses of educational technology are equal. In recent years, rapid reviews, scoping reviews, systematic literature reviews and other variations of meta-analyses have become increasingly common with many featuring in our list of “good reads” partly due to the selection criteria. However, we have become wary of a tendency towards technicist or instrumentalist approaches to these major literature reviews as they often lack a framing theoretical perspective and deeper level of critique.

Indeed, the reader may find it difficult to judge their true value and contribution to the field due to increasing techno-sophistication effects in the way the findings are presented using new data analysis software. In reviewing 52 meta-analyses in the field of educational technology over almost 30 years using the Meta-Analysis Methodological Reporting Quality Guide (MMRQG), the authors confirm our own suspicion that many studies meet only moderate levels of quality. Thus, there is a risk that this type of analysis potentially misleads researchers and practitioners alike. Accordingly, we suggest that anyone embarking on a literature review in the field should familiarise themselves with this article.

We also suggest that many educators and researchers, including current and prospective doctoral candidates, would benefit from delving more deeply into the literature on how to undertake a quality meta-analyses. Three recent publications are worthy of slow reading: i) Systematic reviews in educational research: Methodology, perspectives and application (Zawacki-Richter, et al., 2020); Rapid reviews as an emerging approach to evidence synthesis in education (Wollscheid & Tripney, 2021); and iii) The anatomy of an award-winning meta-analysis: Recommendations for authors, reviewers, and readers of meta-analytic reviews (Steel, Beugelsdijk & Aguinis, 2021).  

No 6 – Jiménez‐Cortés, R., & Aires, L. (2021). Feminist trends in distance and hybrid higher education: a scoping review. International Journal of Educational Technology in Higher Education18:60, 1-20.https://doi.org/10.1186/s41239-021-00297-4

This article is the first in a sequence of four major literature reviews exploring different aspects of the field. It appears first in this sequence in light of our previous concerns about the growth of descriptive analyses of the literature lacking a deeper level of critique and theoretical perspective. Few could argue that feminist perspectives have featured prominently in the educational technology literature and there is growing evidence of what is known as the glass escalator in terms of how women are disadvantaged in the field, as Bond et al. (2021) recently illustrate in their survey of U.S. based instructional designers.

Therefore, this article reporting a review of 160 journals and 10 articles that meet the inclusion criteria is a welcome contribution to the field. Notably, the search protocol, methodology and review process over three phases is guided by the PRISMA-SCR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews), which helps to enhance the trustworthiness of data extraction and interpretation. Findings in terms of distance and hybrid models of education are reported based on three feminist approaches: i) feminist-pragmatist, ii) eco-dialogical feminist, and iii) intersectional-technofeminist. Those unfamiliar with feminist theories and pedagogical research will find these three perspectives relatively accessible and a real strength of the article is its description of how feminist digital pedagogy goes beyond critical digital pedagogy.

Importantly, the authors argue that digital enhanced teaching and learning platforms can limit feminist responses and reproduce dominant structures that reinforce existing power relations. While the article serves to highlight networked learning ideologies that from a feminist approach value connections, relationships, and collaborations, it also illustrates contrasting perspectives and their relationship to other theories concerning materiality, embodiment and hierarchies of power. Thus, the article flags an important gap in the literature and helps to border cross with other theoretical developments which have practical implications in terms of creating a more equitable and inclusive digital education ecosystem. 

No 7 – Bozkurt, A., & Zawacki-Richter, O. (2021). Trends and Patterns in Distance Education (2014–2019): A Synthesis of Scholarly Publications and a Visualization of the Intellectual Landscape. The International Review of Research in Open and Distributed Learning22(2), 19-45. https://doi.org/10.19173/irrodl.v22i2.5381

This article builds on several previous studies by the same authors exploring trends and patterns in distance education. Accordingly, in reviewing this article we had to ask the question: what makes it different from previous work and how does it contribute to new knowledge? Whether the six journals chosen for this analysis are truly representative of the field is open to conjecture, but two aspects standout in terms of answering this question. Firstly, the authors demonstrate how social network analysis (SNA) can be used to reveal new insights into a field.

More specifically, they model how researchers can deploy powerful data analysis software to undertake t-SNE analysis and content and co-word analysis using text mining techniques to visually identify and illustrate patterns, pivotal contributions and turning points. The underlying assumption that this type of visual analysis of the landscape has potential to better inform future research and development in the field is sound.

The second valuable contribution of this visual analysis is evidence of how since the 2000s, the fields of distance education and educational technology have intersected and triggered innovations in each other. Inclusion of more journals from the wider educational technology literature and mainstream publications would provide a means of further validating this type of cross fertilisation or symbiotic relationship. Also, greater consideration of what is missing from the published literature in terms of the issues raised by Castaneda and Williamson (2021) would further enhance the value of this type of analysis.

Drawing on their findings the authors conclude with recommendations for future research directions. Like several other articles in this year’s selection of “good reads”, they ask what our research agenda will and should be in the changing world. 

No 8 – Liu, C., Zou, D., Chen, X., Xie, H., & Chan, W. H. (2021). A bibliometric review on latent topics and trends of the empirical MOOC literature (2008–2019). Asia Pacific Education Review22 (3), 515-534. https://doi.org/10.1007/s12564-021-09692-y

This article ensures that we do not overlook the continuing influence of MOOCs on the education and digital learning landscape. As Bozkurt (2021) suggests in a separate analysis of the literature using data mining and analytic approaches, the MOOC continues to evolve and as new waves emerge their impact on traditional models and methods of education warrant ongoing investigation. We chose this particular bibliometric review of over 1,000 peer-reviewed MOOC studies published between 2008 and 2019 as it helps to bring an Asian perspective to the literature.

Notably, several of the research questions seek to investigate differences and collaborations across countries/regions, which gives further weight to the global perspective we hoped this article might provide. Not surprisingly, the review extracted its data from three reputable and influential publication databases, which unfortunately have a strong English language bias. This is something we have increasingly recognised over the years and places linguistic boundaries around our thinking and opportunities to share and co-construct new knowledge.

Mindful of this limitation and that many of us are unable to read what is published in other languages, the authors report that 11 countries contributed 81% of the total MOOC publications. The US (n=266) was the most prolific, with the UK (n=103), Spain (n=116) and China (n=172) featuring prominently in the literature. In terms of the latter, we know through our NIDL research collaborations with Chinese partners that the MOOC movement has generated an active local research community. To the author’s credit, some of this community and the level of global collaboration is revealed through social network analysis identifying scientific activity across countries/regions. The US collaborated with the most countries, followed by Spain, the UK, the Netherlands, China, Australia, and Germany. Ireland also features in this analysis, which is further illustrated through a visual representation of the most prolific institutions.

The main research topics and trends are also analysed at a country and institutional level helping this study to go beyond previous MOOC literature reviews. Thus, the authors generally meet their claim to have provided a deep and comprehensive understanding of current MOOC research up until 2019, which, in turn, builds on other reviews and supports future research.

No 9 – Tlili, A., Burgos, D., Huang, R., Mishra, S., Sharma, R. C., & Bozkurt, A. (2021). An analysis of peer-reviewed publications on Open Educational Practices (OEP) from 2007 to 2020: A bibliometric mapping analysis. Sustainability, 13, 10798, 1-15. https://doi.org/10.3390/su131910798

This article is the fourth major literature review featuring in this year’s selections with a focus on Open Education Practices (OEPs). The study reports a bibliometric mapping analysis of 156 publications listed in the Scopus and Web of Science databases that meet the inclusion criteria for OEPs. Importantly, the authors begin the paper by making a distinction between OEPs and more content-centred Open Educational Resources (OERs). The authors reveal how there has been a steady growth in OEP literature, with a peak in 2020. In light of the above comment about English language bias in research publication databases, perhaps not unexpectedly, 88% of the studies were in English, 6% were in Spanish, with 2% or less in French, Portuguese, Korean, and Russian.

The study identifies the leading journals publishing work in this area, with Distance Education contributing the most articles (n=18), which is ironic since this prestigious journal published by ODLAA is not fully open. Having said that, a special issue on OEPs does help to explain the journal’s position. The UK leads the country ‘league table’ with 38 documents followed by Spain (n=21) and Australia (n=20). The influence of North America on the OEP literature is better reflected when the tally for the US and Canada is combined as together they contribute 30 documents. Ireland is 10th in the list of countries with 4 documents, which is somewhat surprising given the level of interest in this area, although this number may reflect more of a content-centred emphasis on OERs.  

While the study shows on-going international cooperation regarding OEP amongst leading institutions and the contribution of several well-known scholars, the scale of global collaboration is limited. We believe this is an important finding. It would be interesting to compare the level of global collaboration between the OEP and OER communities, although many of the leading scholars work across both communities; and there is a question of where does the “Open Pedagogy” community ‘fit’ or map in terms of this type of relational analysis? We suggest the article needs to be read alongside a recent literature review on Open Pedagogy (Tietjen & Asino, 2021) as this is another branch of the literature.

The article is generally methodologically sound and helps to demonstrate how VOSviewer software can be deployed to undertake this type of bibliometric analysis. However, in light of the above comments, we would have liked a little more from the article. It offers limited analysis and critical insight into the competing drivers and attractors underlying the OEP movement. Given the thorny issue of definitions, different branches of the literature, and the politics of Openness, the question left unanswered is how do different OEP viewpoints, perspectives and understandings influence what is being researched, who is doing the research and what is being publishing in this area. It would also be interesting to analyse how the OER and Open Pedagogy literature is influencing OEP, and back again, based on citations and mapping the publication landscape.

Overall, the findings provide useful suggestions for future research and it is hard to disagree with the call for more inclusive practices that promote efforts to support and accommodate students with disabilities. In a similar vein, the value of focusing on cultural differences in education to internationalise OEPs makes good sense if we are to advance the United Nation’s Sustainable Development Goals and ensure that everyone benefits from the openness movement.

No 10 – Lodge, J. M., Corrin, L., Hwang, G.-J., & Thompson, K. (2021). Open science and educational technology research. Australasian Journal of Educational Technology37(4), 1–6. https://doi.org/10.14742/ajet.7565

This final article has a strong focus on the quality of research informing decisions and the direction of new developments in educational technology. Borrowing from other fields the authors describe the ‘replication crisis’ that helps to reveal questionable research practices (QRPs) and the robustness and trustworthiness of quantitative research across many disciplines. They suggest one of the greatest problems is that many published works are low powered—that is, the research fails to establish whether an effect is occurring at greater than chance levels.

Another concern is that of hypothesising after the results are known (HARKing), although this is difficult to identify based on a published article alone. Serving as an editorial, the paper goes on to explore what the replication crisis means for educational technology research with suggestions for future responses by the academic and professional community. While the authors observe that educational technology research does not rely as much on experimental designs, there is often a degree of intervention which then involves the study of effects raising inherent questions of replicability and generalisability. Although not singled out by the authors, the novelty of any intervention, often described as the ‘Hawthorn Effect’, also needs to be taken into account.

Overall, this is a novel and timely critique of the published research where the authors conclude that ‘Low powered studies are common’ (p. 3). Poor statistical practices characterise the field and there is evidence of widespread publication bias. Looking to the future, the article promotes the benefits of greater transparency as part of the ‘Open Science’ movement and renewed emphasis on statistical practices.

While it is hard to disagree with the concluding statement that quality must take precedence over what attracts the most clicks, perhaps future editorials could give more attention to the contestable nature of what counts as quality in educational technology research. After all, the idea of replication has Positivist undertones and can be interpreted from many different research perspectives. 

What else is worthy of reading? 

In this final section we identify five additional articles that are worthy of slow reading if you have not already come across them. In alphabetical order we highly recommended the following articles. 

Photo by Dmitry Ratushny on Unsplash

Dell, D. (2021). Resonance and current relevance of IRRODL Highly-cited articles: An integrative retrospective. The International Review of Research in Open and Distributed Learning22(1), 243-258. https://doi.org/10.19173/irrodl.v22i1.5315

  • This article which notably is written by a current doctoral candidate at Athabasca University provides a useful summary of the top 100 highly cited publications from past issues in this leading open access journal. 

Murphy, M. (2021). Belief without evidence? A policy research note on Universal Design for Learning. Policy Futures in Education, 19 (1), 7–12. https://doi.org/10.1177/1478210320940206

  • This article might not be to everyone’s taste, but it asks some important questions about the quality of evidence supporting the growing adoption of UDL principles in both policy and practice. 

Guzman‑Valenzuela , C., Gomez‑Gonzalez, C., Rojas‑Murphy Tagle, A, & Lorca‑Vyhmeister, A. (2021).  Learning analytics in higher education: a preponderance of analytics but very little learning? International Journal of Educational Technology in Higher Education18:23, 1-19. https://doi.org/10.1186/s41239-021-00258-x

  • This article helps to keep the rapidly evolving area of learning analytics to the fore of thinking and offers a valuable critical perspective through an analysis of 385 papers by showing that much of the focus to date has been more on analytics than on learning.

Moon, J., & Park, Y. (2021). A scoping review on Open Educational Resources to support interactions of learners with disabilities. The International Review of Research in Open and Distributed Learning22 (2), 314-341. https://doi.org/10.19173/irrodl.v22i1.5110

  • This paper through a scoping review of the literature responds to the challenge presented in one of our top 10 selections to promote more inclusive practices that support students with disabilities.

Nkomo, L., Daniel, B., & Butson, R. (2021). Synthesis of student engagement with digital technologies: a systematic review of the literature. International Journal of Educational Technology in Higher Education18:34, 1-19. https://educationaltechnologyjournal.springeropen.com/articles/10.1186/s41239-021-00270-1

  • This article adopts a tripartite model to provide a systematic review of the literature on the degree to which social media, video, and collaborative learning technologies have supported student engagement over the past decade. 
Where are the gaps?

We conclude with a brief comment on what’s missing from this year’s list as arguably the gaps are just as important as what we choose to profile. It’s simply not possible to include everything and so we acknowledge there are valuable publications offering a synthesis of the literature on issues of qualitycreativitywellbeingteacher competencemobile learningblockchainimmersive VRvirtual laboratoriesuse of video, the growth of surveillance and online exam proctoring, and the unbundling movement, to name a few.

This last topic also serves to illustrate  that the abundance of open access journals does not diminish the need to monitor the literature that often is only available in restricted publications.

Therefore, we finish by drawing your attention to one such article on this topic that makes good reading if your institution provides access to the journal: 

References

Bond, J., Dirkin, K., Tyler, A.J., & Lassitter, S. (2021). Ladders and escalators: Examining advancement obstacles for women in instructional design. Journal of Applied Instructional Design,https://edtechbooks.org/jaid_10_2/examining_advancemen

Bozkurt, A. (2021). Surfing on three waves of MOOCs: An examination and snapshot of research in Massive Open Online Courses. Open Praxis13 (3), 296–311. DOI: http://doi.org/10.5944/openpraxis.13.3.132

Brown, M. (2021). What are the main trends in online learning? A helicopter view of possible futures. Asian Journal of Distance Education, 16 (2), http://asianjde.com/ojs/index.php/AsianJDE/article/view/605

Brown, M., Conole, G., & Beblavỳ, M. (2019). Education outcomes enhanced by the use of digital technology: Reimagining the school learning ecology.  EENEE Analytical Report No. 38 Prepared for the European Commission. March.

Facer, K., & Selwyn, N. (2021). Digital technology and the futures of education – towards ‘non-stupid’ optimism.Background paper for the Futures of Education initiative, Paris: UNESCO. https://unesdoc.unesco.org/ark:/48223/pf0000377071.locale=en

Steel, P., Beugelsdijk, S. & Aguinis, H. (2021). The anatomy of an award-winning meta-analysis: Recommendations for authors, reviewers, and readers of meta-analytic reviews. Journal of International Business Studies 52,23–44. https://doi.org/10,.1057/s41267-020-00385-z

Tietjen, P., & Asino, T. I. (2021). What is open pedagogy? Identifying commonalities. The International Review of Research in Open and Distributed Learning22 (2), 185-204. https://doi.org/10.19173/irrodl.v22i2.5161

Wollscheid, S., & Tripney, J. (2021). Rapid reviews as an emerging approach to evidence synthesis in education. London Review of Education, 19 (1), https://ucl.scienceopen.com/hosted-document?doi=10.14324/LRE.19.1.32

Zawacki-Richter, O., Kerres, M., Bedenlier, S., Bond, M., & Buntins, K. (eds.). (2020). Systematic reviews in educational research: Methodology, perspectives and application.Wiesbaden, Germany: Springer VS. 

Higher Education 4.0: Exploring New Pedagogies for New Times

In the final week of our online masterclass, Higher Education 4.0: Certifying Your Future“, which has so far attracted more than 800 educators from around the world, we explored a number of critical questions related to new pedagogies for new and uncertain times. This blog post provides a brief synopsis of the discussions taking place over the previous week and what we expect will continue for several more weeks. As illustrated below, our NIDL writing team structured Week 3 around a number of guiding questions, such as:

How do people learn? How do you design environments of learning? How do you design for personalised learning? What new pedagogies are on the horizon? How can students become co-constructors of learning experiences and their own assessment? What are the types of pedagogical frameworks that might enable more active, authentic and real-world forms of learning? What are the challenges in doing so, for both students, teachers, and educational systems?

In addressing these questions, we explored several emerging and potentially disruptive trends in pedagogical practices, including Hip-Hop, Gratitude and Enriched Realities, but most of the facilitated discussion was framed in the language of “authentic pedagogies” and the notion of a “learner-centred” approach. This specific focus was predicated on three interwoven assumptions:

  • Authentic pedagogies following learner-centred principles offer considerable potential in terms of responding to the future skills agenda.
  • Such pedagogies anchored in real-life challenges are well-suited to supporting new flexible life-long learning pathways and recognition models promoting the co-construction of micro-credentials.
  • The adoption of learner-centred, authentic pedagogical approaches helps to connect the classroom to the real-world, and provides greater opportunity to exploit the benefits of digitalisation in reimagining teaching, learning and assessment.

For the purpose of this masterclass, we loosely defined our use of these terms by stating that:

  • Authentic pedagogies – refers to a constellation of pedagogical approaches which emphasise real-world problems and meaningful tasks where teaching, learning and assessment is situated in contexts or challenges requiring interdisciplinary inquiry and exploration.
  • Learner-centred approach – refers to a general philosophy or set of principles that places the learner (or student) at the centre of the learning process. Decisions about teaching, learning and assessment take into account the learner’s previous experiences and their individual needs, interests, capabilities and what they want to achieve.

While the term “student-centred learning” has been used over many years to convey a similar meaning to that above definition, we intentionally adopted “learner-centred” to broaden the discussion. After all, you don’t have to be a student to engage in learning, especially in the workplace or as you pursue informal or non formal types of professional development. This important distinction raised the question:

What are some of the principles you would identify as consistent with a learner-centred approach?

In unpacking this question, and inviting participants to identify their own principles, we introduced the messy landscape of learning theories by revealing the dozens (or more accurately hundreds) of different educational perspectives from which to choose from, as illustrated in the HoTEL project’s ambitious attempt to map them. In a similar vein, we alerted masterclass participants to the dangers of adopting what Sfard (1998) refers to in a seminal publication as single metaphor solutions for learning. To quote:

“Because no two students have the same needs and no two teachers arrive at their best performance in the same way, theoretical exclusivity and didactic single-mindedness can be trusted to make even the best of educational ideas fail” (Sfard, 1998, p.11).

This line of discussion raised the importance of intentionally teaching for learning transfer. In a topic devoted to this issue, we discussed concepts such as near and far transfer and the distinction between High Road and Low Road Transfer (Salomon & Perkins, 1989). Drawing on the diagram below, we argued that a lot of traditional assessment of learning in higher education takes place through highly similar tasks set in academic contexts, as illustrated in the lower left-hand quadrant. The real test of learning is perhaps whether there is evidence of transfer to highly dissimilar tasks in more authentic or real-life contexts, as depicted by the upper right-hand quadrant.

In a related poll, we asked participants to critically reflect on the effectiveness of the traditional examination in measuring evidence of learning. As you can see by the results shown in the figure below, a minority of participants agreed that the exam is solid (or valid) evidence of learning. Of course, it’s highly likely that the type of people attracted to this future-focused online masterclass are not representative of all higher educators.

Set against the issue of promoting learning transfer, a particular focus was placed on Challenge-based Learning (CBL) as this is an underlying signature pedagogy for the new ECIU University. The development of this masterclass is supported by the ECIU University as we endeavour to raise awareness of key concepts and implement many features of what might be defined as Higher Education 4.0. For a brief overview of CBL, we suggest you start by watching this short video.

A central element to the concept of CBL, naturally, is that of a challenge. While the phrase might bear some similarities to Problem-Based Learning (PBL), the focus of CBL is on investigating real-life problems related to pressing societal issues.  Recognising there are many variations of CBL, we shared with participants an innovative case study of authentic pedagogies in practice through a unique award winning module called “Learning Innovation for Enterprise” (LIFE) developed by a team in the DCU Business School.

A particular element of the module we highlight is its focus on Hackathons, day-long events at which students apply their skills to collective problems, such as fast fashion, smarter travel, and mental health (to use some of the thematic problems explored in 2020). These Hackathons, as Dr. Roisín Lyons, module lecturer, explains in the video below, provide students with real opportunities to work in a collaborative manner, “focusing on key themes we care about in social issue contexts”.

Another innovative feature of the Hack4Change experience added for the March 2021 week long event was use of the GatherTown platform as a virtual meeting place and space to augment learning. This online environment allows learners to gather and interact in spaces like they would in the real-world, as this brief video demonstrates.

Drawing on the DCU and ECIU University examples, we then explored a key question, how does CBL impact the teacher’s role? Thinking more generally, if CBL, authentic learner-centred approaches, personalised learning, technology-augmented instruction etc., are at the heart of Pedagogy 4.0, then is there still a role for direct teaching? Does the traditional lecture still have a place in this type of future learning environment? Put another way, is the lecture dead in Higher Education 4.0?

A related and more provocative question that generated some rich discussion is whether in the future the teacher could be replaced by a robot or intelligent digital agent? Some participants agreed “yes” in the discussion posts if the teacher is seen as nothing more than someone who delivers a pre-packaged curriculum largely consisting of digital content. However, as noted by Bonfield et al. (2020) in a future-focused article we provided on the potential impact of robots, artificial intelligence (AI), machine learning, internet of things (IoT), and so on:

“Yet, it remains open to debate if in Education 4.0 teachers might lose their status as all-knowing experts, and what the future classroom will even look like. Is a paradigm shift and new epistemology emerging, which acknowledges the web as a source of curriculum knowledge, and recognises that learners can occupy the role as content producers and sharers, and that the authority and ownership of knowledge is being transferred from teachers to students?” (p. 243).

Acknowledging that currently DCU Futures and the ECIU University projects are still works in progress, we asked, how do you successfully scale up this type of learning innovation? And is seeing believing? What evidence and success indicators (lead and lag) should be used to measure the longer-term impact of such initiatives? As Dawson and Dawson (2016) point out, higher education learning and teaching research are particularly susceptible to hiding failures and positive reporting bias. In analysing the learning innovation literature they found:

“When the findings of large sets of educational research are pooled together, negative results reporting unsuccessful interventions are rare” (Dawson & Dawson, 2016, p.1).

This valuable line of research highlights the risk of “Hawthorne Effects” arising from learning innovations which often cloud judgments and contribute to change blindness. Accordingly, trying to understand whether “seeing is believing”, or not, raises some challenging methodological issues for those involved in leading learning innovations. As Bonfield, et al. (2020) conclude:

“…more data and research are needed in order to redress the fact that efforts in the field of Education 4.0 are largely driven by intuition and common-sense extrapolations, rather than being solidly underpinned by research-informed models and frameworks” (p. 242).

While the jury might still be out concerning the impact of CBL, masterclass participants were generally positively inclined towards the benefits of such an authentic learner-centred approach, particularly when thinking about their own institutions, as illustrated in the following poll result.

Throughout last week, we encouraged masterclass participants to critically reflect on the transformative power, and potential pitfalls, of authentic learning-centred pedagogies. There was some rich discussion which we expect to continue for several more weeks as people continue to work their way through the masterclass. We finished the week by reflecting back on the big question introduced in Week 1 by asking participants:

What is your vision of Higher Education for the year 2030?

We made a decision in designing the masterclass not to offer a precise definition of Higher Education 4.0 in a practical or detailed sense as the educational context is always important. Instead, our team chose to present and make explicit over each week many of the choices facing higher educators, future policy-makers, and related stakeholders, which deliberately provide a stark contrast with the current normal. In reflecting on the three main topics of future skills, the rapid growth of the micro-credentialing movement, and new and emerging pedagogies for uncertain times, we reminded participants of the words of former US first lady Michelle Obama:

According to Gilly Salmon (2019), the answer to the above question of what Education 4.0 will look like and how it will differ can be defined relationally, through exploring the distinctions between the “other” educations:

  • Education 1.0 (Transmission)
  • Education 2.0 (Social, post-2005)
  • Education 3.0 (Digital Lives and Mobility)

However, a more definitive answer to this question remains open for further discussion and is a challenge for educators to define. In light of powerful change forces explored in weeks 1 & 2, we have argued throughout the masterclass that it’s essential for educators to help drive and shape the future direction of higher education.

In concluding the masterclass, we shared one final supplementary reading from Keri Facer (2020) which very much encapsulates the view that, “The future depends on what we do in the present” as noted by Mahatma Gandhi. Reflecting back on the narrow, heavily biased and somewhat disturbing vision of Education 4.0 presented at the start of Week 1 in a video produced by Jisc (2019), we stress that educators must continue to ask:

What and whose knowledges are being used to create these ideas of the future and where are the absences? (Facer, 2020, p.2).

Our final challenge to masterclass participants, as illustrated below drawing on the recent landing of the Mars rover, is to “Dare mighty things” – quoting a famous line from former US President Theodore Roosevelt. We challenged participants to go beyond critical reflection by identifying what they will do differently as micro-leaders to shape a better future.

So far the feedback we have received from masterclass participants has been overwhelming positive, as evidenced by the following comment from an Irish educator…

“Thank you all so much … a great thought provoking course. Go raibh míle maith agaibh.”

The class has been truly international, and to quote another participant living outside of Ireland…

“I thoroughly enjoyed this course, I learned a lot and really enjoyed engaging with our knowledgeable, committed and encouraging @Educators and the learner community that has such amazingly diverse professional background, open mind and willingness to share thoughts and opinions.”

Finally, our NIDL team will continue to engage over the next few weeks and respond to those participants still completing the learning experience. So you can still sign up to join the masterclass as a later comer to see what others have said about some of the important issues we have explored, and to contribute your own views on the future of higher education. In the meantime, we would like to acknowledge our ECIU University colleagues and the contribution of those who have already completed the masterclass as their discussion posts, in particular, have added to the richness of the learning experience.

The HE4.0 team

PS We have already started planning for our next online masterclass that will explore how higher education institutions shape the digital transformation agenda to achieve their future ambitions.