RESEARCH ARTICLE
A Study on the Possibility of Replacing Holistic Evaluation with Linguistic Feature Assessment in Essay Evaluation
Min-Seok Choi, Dong Ju Lee*
Korea National University of Education
Correspondence to Dong Ju Lee, maydjlee@knue.ac.kr
Brain, Digital, & Learning. Volume 16, Number 2, 189–204, June 2026. https://doi.org/10.31216/BDL.2026.16.2.5
Received on June 9, 2026, Revised on June 30, 2026, Accepted on June 30, 2026, Published on June 30, 2026.
Copyright © 2026 Institute of Brain based Education, Korea National University of Education This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (https://creativecommons.org/licenses/by-nc/4.0/) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.
Abstract
This study investigated the relationship between the linguistic features of English essays and the holistic evaluations conducted by non-native Korean teachers of English, while also examining the applicability of automated essay scoring. A total of 23 essays written by second- and third-year high school students were analyzed using Coh-Metrix 3.0, with particular attention to indices of lexical diversity, syntactic complexity, cohesion, and readability. Spearman’s rank-order correlation analysis was performed using SPSS to examine the relationships between the linguistic indices and the teachers’ evaluation rankings. The results revealed that lexical diversity (LDTTRa) demonstrated a relatively strong positive correlation with teachers’ evaluations, whereas indices related to syntactic complexity, cohesion, and readability exhibited only limited correlations. These findings suggest that lexical features may play a significant role in teachers’ holistic judgments of essay quality. Furthermore, the study indicates that Coh-Metrix-based automated scoring may serve as a supplementary tool to enhance the objectivity and reliability of essay assessment, rather than functioning as a replacement for human raters.
Keywords
English essay evaluation, Coh-Metrix, automated scoring, lexical diversity