TY - GEN
T1 - On the Application of Sentence Transformers to Automatic Short Answer Grading in Blended Assessment
AU - Ahmed, Abbirah
AU - Joorabchi, Arash
AU - Hayes, Martin J.
N1 - Publisher Copyright:
© 2022 IEEE.
PY - 2022
Y1 - 2022
N2 - In Natural Language Processing, automatic short answer grading remains a necessary launch-pad for the analysis of human responses in a blended learning setting. This study presents pre-trained neural language models that use context dependent Sentence-Transformers to automatically grade student responses with two different input settings. It is found that the use of these models achieves promising results when compared to conventional Bidirectional Encoder Representation Transformer, (BERT), approaches when applying various text similarity-based tasks. This work presents experiments using the benchmark Mohler dataset to test these new models. In summary, an excellent Pearson Correlation score of 0.82 and a Root Mean Square Error of 0.69 is exhibited across a representative experiment sample size.
AB - In Natural Language Processing, automatic short answer grading remains a necessary launch-pad for the analysis of human responses in a blended learning setting. This study presents pre-trained neural language models that use context dependent Sentence-Transformers to automatically grade student responses with two different input settings. It is found that the use of these models achieves promising results when compared to conventional Bidirectional Encoder Representation Transformer, (BERT), approaches when applying various text similarity-based tasks. This work presents experiments using the benchmark Mohler dataset to test these new models. In summary, an excellent Pearson Correlation score of 0.82 and a Root Mean Square Error of 0.69 is exhibited across a representative experiment sample size.
KW - Automatic Short Answer Grading
KW - BERT
KW - BiLSTM
KW - Natural Language Processing
UR - http://www.scopus.com/inward/record.url?scp=85135875727&partnerID=8YFLogxK
U2 - 10.1109/ISSC55427.2022.9826194
DO - 10.1109/ISSC55427.2022.9826194
M3 - Conference contribution
AN - SCOPUS:85135875727
T3 - 2022 33rd Irish Signals and Systems Conference, ISSC 2022
BT - 2022 33rd Irish Signals and Systems Conference, ISSC 2022
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 33rd Irish Signals and Systems Conference, ISSC 2022
Y2 - 9 June 2022 through 10 June 2022
ER -