Evaluation is a very important tool to measure students' level of understanding, both in e-learning or conventional studying system. Essay is one of the evaluation which to determine students ability where choices are not provided. Students have to answer by sentences, so then it could be various based on their opinion, since it reflects the student’s best thoughts of the materials. Today, automatic grading essay is becoming more efficient and more effective especially in maintaining fairness. SIMPLE-O, a web based automated short essay grading system for Indonesian Language, was developed in Electrical Engineering Department, University of Indonesia. SIMPLE-O uses an improved Latent Semantic Analysis (LSA) method. This research proposed several modifications to the LSA method to improve its performance in our use case. Usage of multi-level keywords is proven capable to improve scoring accuracy and agreement with human raters’ score. The results was measured in small classes, up to 82.56% human raters’ agreement can be measured.
Anak Agung Putri Ratna, Universitas Indonesia, Indonesia
Prima Dewi Purnamasari, Universitas Indonesia, Indonesia
Boma Anantasatya Adhi, Universitas Indonesia, Indonesia
Stream: Education and Technology: Teaching
This paper is part of the ACSET2015 Conference Proceedings (View)
View / Download the full paper in a new tab/window