On Deep Learning Approaches to Automated Assessment: Strategies for Short Answer Grading

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

The recent increase in the number of courses that are delivered in a blended fashion, before the effect of the pandemic has even been considered, has led to a concurrent interest in the question of how appropriate or useful automated assessment can be in such a setting. In this paper, we consider the case of automated short answer grading (ASAG), i.e., the evaluation of student answers that are strictly limited in terms of length using machine learning and in particular deep learning methods. Although ASAG has been studied for over 50 years, it is still one of the most active areas of NLP research as it represents a starting point for the possible consideration of more open ended or conversational answering. The availability of good training data, including inter alia, labelled and domain-specific information is a key challenge for ASAG. This paper reviews deep learning approaches to this question. In particular, deep learning models, dataset curation, and evaluation metrics for ASAG tasks are considered in some detail. Finally, this study considers the development of guidelines for educators to improve the applicability of ASAG research.

Original languageEnglish
Title of host publicationProceedings of the 14th International Conference on Computer Supported Education - Volume 2, CSEDU 2022
EditorsMutlu Cukurova, Nikol Rummel, Denis Gillet, Bruce McLaren, James Uhomoibhi
PublisherScience and Technology Publications, Lda
Pages85-94
Number of pages10
ISBN (Electronic)9789897585623
DOIs
Publication statusPublished - 2022
Event14th International Conference on Computer Supported Education, CSEDU 2022 - Virtual, Online
Duration: 22 Apr 202224 Apr 2022

Publication series

NameInternational Conference on Computer Supported Education, CSEDU - Proceedings
Volume2
ISSN (Electronic)2184-5026

Conference

Conference14th International Conference on Computer Supported Education, CSEDU 2022
CityVirtual, Online
Period22/04/2224/04/22

Keywords

  • Automated Assessment
  • Automatic Short Answer Grading
  • Blended Learning
  • Deep Learning
  • Natural Language Processing

Fingerprint

Dive into the research topics of 'On Deep Learning Approaches to Automated Assessment: Strategies for Short Answer Grading'. Together they form a unique fingerprint.

Cite this