n South African Journal of Higher Education - New frontiers in automated assessment : using latent semantic analysis to assess conceptual content in essays




This article describes the use of latent semantic analysis, latent semantic analysis, a machine-learning technique which has been developed for the computerised assessment of knowledge. Latent semantic analysis employs linear algebra techniques to induce and represent knowledge in high dimensional spaces, and can be used to compare documents in terms of their degree of semantic similarity to one another. In this article we report on a study to explore the feasibility of latent semantic analysis as a computational tool for assessing the conceptual content of essay-type answers. Student answers to two short essay questions in an undergraduate psychology course were first independently graded by two human lecturers, and were then converted to machine readable texts and scored by latent semantic analysis. The scores assigned by latent semantic analysis showed good agreement with those awarded by the humans. The implications of the results, and some of the pros and cons of latent semantic analysis as a practical assessment technology, are discussed.


Article metrics loading...

This is a required field
Please enter a valid email address
Approval was a Success
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error