Assessment, feedback and technology

In a new open access book from the Bloomsbury Learning Environment, Sarah Sherman and Leo Havemann look at the role of technology in educational assessment and what looks set to change.

Assessment lies at the heart of formal learning, and therefore at the heart of our work as educational technology practitioners. For our students in higher education institutions throughout Bloomsbury and the wider sector, undertaking coursework typically involves the use of online services and software to research and produce digital documents which are then submitted via a virtual learning environment (in our case, Moodle). Increasingly, marking and feedback also takes place online. These changes to assessment practices have been brought about through dialogue, collaboration and investment of precious time by academics, administrative staff and learning technologists, and by and large, the results appear to be welcomed by both students and staff. Yet this is not the full story of the role technology already and potentially plays in assessment. Online submission and marking of digital documents represents a digitisation of offline practices, which brings various new affordances (and of course removes others), but is not necessarily transformative.

Student attainment and satisfaction are sector-wide concerns, leading to calls from influential agencies such as the HEA and Jisc to enhance and transform assessment practices. The Bloomsbury Learning Environment (BLE) agreed in 2014 to focus the consortium’s shared activities on the ways in which learning technologies can enhance and support assessment and feedback. We wanted to gain an overview of current practices throughout Bloomsbury, and at the same time uncover and share examples of people making use of learning technologies in ways which go beyond the norm of digitised offline practice. Over the two subsequent academic years, we organised a programme of online and face-to-face events, conducted research, and collected case studies highlighting good practice.

In our experience, teaching staff often do not have much opportunity to find out what their peers are doing. Therefore, we have now published the written outputs of our enhancement theme as a freely available, open access ebook entitled Assessment, Feedback and Technology: Contexts and Case Studies in Bloomsbury. The ebook contains three research papers, which capture macro-level snapshots of current practice across the BLE partner institutions, as well as a wide range of pedagogic and technical case studies. These chapters have been contributed by academics, learning technologists, administrators and consultants, bringing a variety of perspectives to the topic. In developing this collection, our aim is therefore to offer an overview of current assessment practices, and hopefully some inspiration and ideas for making better use of technology.

The research presented in the first three chapters of the book include specific examples of practice at the BLE partner institutions from which broad recommendations have been drawn to help inform wider practice. These papers focus on:

  1. The use of technology across the assessment lifecycle
  2. The roles played by administrative staff in assessment processes
  3. Technology-supported assessment in distance learning

The first chapter introduces the assessment lifecycle model, developed by Manchester Metropolitan University and Jisc, which helps to contextualise the Bloomsbury landscape. The chapter was prompted by a wide-ranging survey conducted by each partner member to gauge how assessment practices were delivered and supported with technology. The second chapter offers administrative perspectives of the processes involved in assessment, and the research provides insight into how course administrators manage their responsibility in the workflow. We explore their pain points and consider improvements. Finally, the third chapter describes the assessment and feedback practices in the Bloomsbury programmes which offer distance learning (DL). Although it specifically considered DL, the findings and recommendations in this chapter are applicable for all teaching models.

The subsequent chapters are case studies of digital assessment and feedback practices, which operate at the micro-level of specific modules, offering an understanding of the pedagogy underlying the adoption of particular tools, and the associated benefits and challenges. The practice described does not simply replicate standard offline practices in a digital way, but extends the role of assessment and feedback. The case studies are categorised into five themes:

  • Alternative Tasks and Formats
  • Students Feeding Back
  • Assessing at Scale
  • Multimedia Approaches
  • Technical Developments

The final section contains three case studies of technical developments, which have been undertaken locally to support or enhance aspects of practice. The book acknowledges the inspiring work of our colleagues but also contributes to the wider discussion in the education community regarding improvements to assessment and feedback. Most of all, we hope this collection will be of interest to academics throughout Bloomsbury and beyond who are curious to learn about and develop new assessment approaches.

Further information: http://www.ble.ac.uk/ebook.html

Authors:
Sarah Sherman, BLE Service Manager, Bloomsbury Learning Environment @BLE1
Leo Havemann, Learning Technologist, Birkbeck, University of London @leohavemann

Share
. Reply . Category: Categories . Tags: , , ,

Animating medieval manuscripts

Professor of Medieval Studies Anthony Bale discusses his work with Birkbeck’s artist in residence, animator Shay Hamias. Together, they are developing a new interface between contemporary digital animation and medieval studies.

This year Birkbeck received one of only 19 prestigious Leverhulme Trust Artist-in-Residence awards. The residency is supporting animation artist Shay Hamias to work with me in Birkbeck’s School of Arts. Hamias is an animation director, with experience working on short and feature films, advertisements, and the museum and heritage sectors. Hamias’ work creatively explores the visual possibilities of design, motion and narrative, seeking new ways to interpret the medium. Hamias had long been fascinated by the artistry of medieval manuscripts, their combination of the written word and visual effects, and their engagement with religious belief. So the Leverhulme Artist-in-Residence award provided a superb opportunity to develop a completely new interface between contemporary digital animation and medieval studies.

Hamias and I share an interest in the meanings of images and symbolism, in particular, the religious symbolism in Christianity and Judaism. Our project has sought to put modern design in conversation with medieval artefacts in a bold new way. We have tried to test that idea, proposed by many scholars of medieval culture, that the pages of medieval books are ‘alive’ and animate, full of ‘active’ visual and mnemonic effects for the reader. Can contemporary animation engage in a fruitful and stimulating encounter with the often perplexing but beautiful images we find in medieval manuscripts? In medieval manuscripts, design and illustration are provided as tools for the viewer/reader to enable them to decode biblical narratives, using a visual language that would resonate with them and locate them mentally.

In the creative process, the artist looks at a subject from a personal point of engagement with it, combined with established ways of seeing.  Animation lends itself to translating inner thought and inner states, in a creative process based on lateral approaches to thinking and the use of associative emotions and imagination. Hamias and I have been thinking about how parallels might be drawn between modern visual language and medieval visuals. Might traditional techniques be applied to modern narratives, in a creative anachronism?

Formally, medieval manuscripts have much in common with modern animation: both condense time and space, through discontinuous visual and verbal narrative; both can rapidly illustrate change over a long period and produce memorable narrative through a ‘familiar’ iconography and media in service of popularly-held or generally-endorsed views; both can reveal metamorphosis and sudden change, sudden effects which are accepted by audiences because of their familiarity with the world created by the medium.

The emphasis of the residency is on Hamias’ artistic and creative freedom to respond to medieval sources in his own distinctive way. Hamias and I have met at least weekly during the residency, sometimes in libraries and archives with medieval manuscripts in front of us. The first animation project we have produced focusses on pilgrimage and visual movement. We have taken the idea of ‘visual storytelling’ and given it a contemporary take. We feel that our methodology remains ‘medieval’: our project is constructed entirely from things we have read in medieval texts or found in medieval visual culture. Moreover, Hamias put himself in a similar position to the medieval artist, who was imagining things based largely on received stories and depictions. Our first short animated film is called ‘The Matter of Jerusalem’, after William Wey’s 1460s manuscript book which describes the journey from Venice to Jerusalem.

We now have plans to develop this film and to collaborate on an exhibition about Birkbeck’s own medieval books in summer 2018.

You can follow Anthony and Shay’s project on their Instagram page @animatedpage

 

Share
. Reply . Category: Arts . Tags: , , , , , , , , , ,