AN AUTOMATED SCORING APPROACH FOR ESSAY QUESTIONS
Keywords:
Automated essay scoring, project essay grade, e-pedagogy and e-assessmentAbstract
The automated scoring or evaluation for written student responses have been, and are still a highly interesting topic for both education and natural language processing, NLP, researchers alike. With the obvious motivation of the difficulties teachers face when marking or correcting open essay questions; the development of automatic scoring methods have recently received much attention. In this paper, we developed and compared number of NLP techniques that accomplish this task. The baseline for this study is based on a vector space model, VSM. Where after normalisation, the baseline-system represents each essay by a vector, and subsequently calculates its score using the cosine similarity between it and the vector of the model answer. This baseline is then compared with the improved model, which takes the document structure into account. To evaluate our system, we used real essays that submitted for computer science course. Each essay was independently scored by two teachers, which we used as our gold standard. The systems' scoring was then compared to both teachers. A high emphasis was added to the evaluation when the two human assessors are in agreement. The systems' results show a high and promising performance.Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2014 The Eurasia Proceedings of Educational and Social Sciences
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
The articles may be used for research, teaching, and private study purposes. Any substantial or systematic reproduction, redistribution, reselling, loan, sub-licensing, systematic supply, or distribution in any form to anyone is expressly forbidden. Authors alone are responsible for the contents of their articles. The journal owns the copyright of the articles. The publisher shall not be liable for any loss, actions, claims, proceedings, demand, or costs or damages whatsoever or howsoever caused arising directly or indirectly in connection with or arising out of the use of the research material. All authors are requested to disclose any actual or potential conflict of interest including any financial, personal or other relationships with other people or organizations regarding the submitted work.