How do raters judge spoken vocabulary?
Li, Hui (2016) How do raters judge spoken vocabulary? English Language Teaching, 9 (2). ISSN 1916-4750 (https://doi.org/10.5539/elt.v9n2p102)
Preview |
Text.
Filename: Li_ELT_2016_How_do_raters_judge_spoken.pdf
Final Published Version License: Download (248kB)| Preview |
Abstract
The aim of the study was to investigate how raters come to their decisions when judging spoken vocabulary. Segmental rating was introduced to quantify raters’ decision-making process. It is hoped that this simulated study brings fresh insight to future methodological considerations with spoken data. Twenty trainee raters assessed five Chinese students’ monologic texts on vocabulary in this study. Both segmental rating and overall rating were retrieved from the raters. Rasch analysis suggested variation between raters in their judgment of vocabulary, although consistency was found in general. Besides, there was a mismatch between candidates’ vocabulary scores and their lexical statistics. The raters’ decision-making process was generally cumulative.
ORCID iDs
Li, Hui ORCID: https://orcid.org/0000-0002-3245-5478;-
-
Item type: Article ID code: 57365 Dates: DateEvent11 January 2016Published11 January 2016Published Online10 January 2016AcceptedSubjects: Language and Literature > Philology. Linguistics
Education > Education (General)Department: Faculty of Humanities and Social Sciences (HaSS) > Humanities > Mandarin Depositing user: Pure Administrator Date deposited: 10 Aug 2016 15:52 Last modified: 17 Oct 2024 00:25 Related URLs: URI: https://strathprints.strath.ac.uk/id/eprint/57365