Machine learning algorithm for grading open-ended physics questions in Turkish

Çınar A., Ince E., Gezer M., Yılmaz Ö.

Education and Information Technologies, cilt.25, sa.5, ss.3821-3844, 2020 (SCI-Expanded) identifier identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 25 Sayı: 5
  • Basım Tarihi: 2020
  • Doi Numarası: 10.1007/s10639-020-10128-0
  • Dergi Adı: Education and Information Technologies
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Social Sciences Citation Index (SSCI), Emerging Sources Citation Index (ESCI), Scopus, EBSCO Education Source, Educational research abstracts (ERA), ERIC (Education Resources Information Center), INSPEC
  • Sayfa Sayıları: ss.3821-3844
  • Anahtar Kelimeler: Machine learning, Automatic short answer grading, Short-answer scoring, AUTOMATIC ASSESSMENT, ANSWERS
  • İstanbul Üniversitesi Adresli: Evet

Özet

© 2020, Springer Science+Business Media, LLC, part of Springer Nature.Worldwide, open-ended questions that require short answers have been used in many exams in fields of science, such as the International Student Assessment Program (PISA), the International Science and Maths Trends Research (TIMSS). However, multiple-choice questions are used for many exams at the national level in Turkey, especially high school and university entrance exams. This study aims to develop an objective and useful automatic scoring model for open-ended questions using machine learning algorithms. Within the scope of this aim, an automated scoring model construction study was conducted on four Physics questions at a University level course with the participation of 246 undergraduate students. The short-answer scoring was handled through an approach that addresses students’ answers in Turkish. Model performing machine learning classification techniques such as SVM (Support Vector Machines), Gini, KNN (k-Nearest Neighbors), and Bagging and Boosting were applied after data preprocessing. The score indicated the accuracy, precision and F1-Score of each predictive model of which the AdaBoost.M1 technique had the best performance. In this paper, we report on a short answer grading system in Turkish, based on a machine learning approach using a constructed dataset about a Physics course in Turkish. This study is also the first study in the field of open-ended exam scoring in Turkish.