Transformers based automated short answer grading with contrastive learning for Indonesian language

Name: Mukti, Aldo Arya Saka

Organization : Universitas Gadjah Mada. Dept. of Electrical and Information Engineering

Email : aldoarya00@mail.ugm.ac.id

Name: Alfarozi, Syukron Abu Ishaq

Organization : Universitas Gadjah Mada. Dept. of Electrical and Information Engineering

Email : syukron.abu@ugm.ac.id

Name: Kusumawardani, Sri Suning

Organization : Universitas Gadjah Mada. Dept. of Electrical and Information Engineering

Email : suning@ugm.ac.id

keyword: Contrastive learning

LCSH: Electric transformers

; Automated short answer grading

; e-Learning

Abstract: The rapid development of technology has impacted various sectors, including education. These developments have enabled e-Learning to thrive, especially during the Covid-19 pandemic. Evaluating student performance and understanding in e-Learning is typically done through quizzes. However, these evaluations, especially in essay grading, still require manual effort. This can lead to exhaustion and introduce bias and inconsistency into the scoring process. To address this issue, one possible solution is to develop an automated short-answer grading system. This research explores large language model that has a general understanding of language. This model is then subjected to a finetuning process. Specifically, this study employs BERT model, with contrastive learning method to develop an automated short-answer scoring system and compare its performance with similar systems. The model is composed of two components, namely the model body which utilizes BERT variation and the model head which employs logistic regression. The model body is structured in a siamese architecture. The results demonstrate an improvement in model performance of BERT model with constrastive learning. When compared to the pretrained BERT and BERT with cosine similarity finetuning, the reduction in prediction MAE is 21.72% and 9.90%, while for the RMSE metric, it is 17.79% and 13.80%. The transformersbased model with contrastive learning achieves metrics of 0.191 for MAE and 0.231 for RMSE. These findings indicate the potential of using the contrastive learning method in transformers models to develop an automated short-answer scoring system

King Mongkut's University of Technology North Bangkok. Central Library

Address: BANGKOK

Email: library@kmutnb.ac.th

Created: 2024

Modified: 2024-12-20

Issued: 2024-12-20

บทความ/Article

application/pdf

BibliograpyCitation : In IEEE Computational Intelligence Society Thailand Chapter, King Mongkut's Institute of Technology Ladkrabang. School of Information Technology and Universitas Gadjah Mada. Department of Electrical Engineering and Information Technology. The 15th International Conference on Information Technology and Electrical Engineering (ICITEE 2023) (pp.121-126) Nonthaburi : IEEE Computational Intelligence Society Thailand Chapter, 2023

eng

©copyrights King Mongkut's University of Technology North Bangkok

ลำดับที่.	ชื่อแฟ้มข้อมูล	ขนาดแฟ้มข้อมูล	จำนวนเข้าถึง	วัน-เวลาเข้าถึงล่าสุด
1	ICITEE 2023pp.121-126.pdf	655.63 KB

ใช้เวลา

0.033392 วินาที