File Download

There are no files associated with this item.

  Links for fulltext
     (May Require Subscription)
Supplementary

Book Chapter: Exploring the Relationship Between Raters’ Personality Traits and Rating Severity in Writing Assessment of Chinese as a Second Language: A Pilot Study

TitleExploring the Relationship Between Raters’ Personality Traits and Rating Severity in Writing Assessment of Chinese as a Second Language: A Pilot Study
Authors
Issue Date2017
PublisherSpringer
Citation
Exploring the Relationship Between Raters’ Personality Traits and Rating Severity in Writing Assessment of Chinese as a Second Language: A Pilot Study. In Zhang, D & Lin CH (Eds.), Chinese as a Second Language Assessment, p. 203-223. Singapore: Springer, 2017 How to Cite?
AbstractSubjective rating is a widely adopted practice in human assessment and measurement. Without a careful control of severity among raters in grading, both the validity and reliability of a subjective assessment will be subject to skepticism. Among many variables which may potentially impact raters’ severity, raters’ personality in recent years has caused concerns for many researchers. However, so far there is no study investigating such a potential relationship in the context of testing and assessing Chinese as a second language. To explore the relationship between raters’ personality traits and rating severity in writing assessment of Chinese as a foreign language, master’s degree students who majored in teaching of Chinese as a foreign language (n = 28) were asked to rate a writing test of the New HSK, a large-scale standardized test of Chinese proficiency promoted by the Chinese government. Valid data for FACETS analysis were the 28 raters’ independent ratings of 77 examinees’ 154 essays (2 topics) from the test. Each rater also completed NEO-PI-R, a fairly reliable personality inventory. Demographic variables such as age, gender, educational background, and rating experience, which may affect raters’ severity in essay grading, were strictly controlled. The results of this pilot study showed individual differences in raters’ severity and significant associations between raters’ personality traits and their rating behavior in terms of severity. Findings of this study are expected to enrich our understanding of subjective rating behaviors of human assessment, especially in the field of testing and assessing Chinese as a second language.
Persistent Identifierhttp://hdl.handle.net/10722/283006
ISBN
Series/Report no.Chinese Language Learning Sciences (CLLS)

 

DC FieldValueLanguage
dc.contributor.authorZhu, Y-
dc.contributor.authorFung, SL-
dc.contributor.authorTse, SK-
dc.contributor.authorHsieh, CY-
dc.date.accessioned2020-06-05T06:23:58Z-
dc.date.available2020-06-05T06:23:58Z-
dc.date.issued2017-
dc.identifier.citationExploring the Relationship Between Raters’ Personality Traits and Rating Severity in Writing Assessment of Chinese as a Second Language: A Pilot Study. In Zhang, D & Lin CH (Eds.), Chinese as a Second Language Assessment, p. 203-223. Singapore: Springer, 2017-
dc.identifier.isbn978-981-10-4087-0-
dc.identifier.urihttp://hdl.handle.net/10722/283006-
dc.description.abstractSubjective rating is a widely adopted practice in human assessment and measurement. Without a careful control of severity among raters in grading, both the validity and reliability of a subjective assessment will be subject to skepticism. Among many variables which may potentially impact raters’ severity, raters’ personality in recent years has caused concerns for many researchers. However, so far there is no study investigating such a potential relationship in the context of testing and assessing Chinese as a second language. To explore the relationship between raters’ personality traits and rating severity in writing assessment of Chinese as a foreign language, master’s degree students who majored in teaching of Chinese as a foreign language (n = 28) were asked to rate a writing test of the New HSK, a large-scale standardized test of Chinese proficiency promoted by the Chinese government. Valid data for FACETS analysis were the 28 raters’ independent ratings of 77 examinees’ 154 essays (2 topics) from the test. Each rater also completed NEO-PI-R, a fairly reliable personality inventory. Demographic variables such as age, gender, educational background, and rating experience, which may affect raters’ severity in essay grading, were strictly controlled. The results of this pilot study showed individual differences in raters’ severity and significant associations between raters’ personality traits and their rating behavior in terms of severity. Findings of this study are expected to enrich our understanding of subjective rating behaviors of human assessment, especially in the field of testing and assessing Chinese as a second language.-
dc.languageeng-
dc.publisherSpringer-
dc.relation.ispartofChinese as a Second Language Assessment-
dc.relation.ispartofseriesChinese Language Learning Sciences (CLLS)-
dc.titleExploring the Relationship Between Raters’ Personality Traits and Rating Severity in Writing Assessment of Chinese as a Second Language: A Pilot Study-
dc.typeBook_Chapter-
dc.identifier.emailTse, SK: sktse@hku.hk-
dc.identifier.authorityTse, SK=rp00964-
dc.identifier.doi10.1007/978-981-10-4089-4_10-
dc.identifier.hkuros310296-
dc.identifier.spage203-
dc.identifier.epage223-
dc.publisher.placeSingapore-

Export via OAI-PMH Interface in XML Formats


OR


Export to Other Non-XML Formats