当代外语研究 ›› 2022, Vol. 22 ›› Issue (4): 133-143.doi: 10.3969/j.issn.1674-8921.2022.04.013

• 思想与学术 • 上一篇    下一篇

评分员视角下外语写作测试分项评分标准的界定

邹绍艳(), 范劲松()   

  1. 青岛农业大学,青岛,266109
    墨尔本大学,墨尔本,3010
  • 出版日期:2022-08-28 发布日期:2022-09-13
  • 作者简介:邹绍艳,博士,青岛农业大学外国语学院副教授。主要研究方向为语言测试与评估、外语教学。电子邮箱: amandazsy@163.com;|范劲松,博士,澳大利亚墨尔本大学语言测试研究中心高级研究员。主要研究方向为语言测试与评估。电子邮箱: jinsong.fan@unimelb.edu.au
  • 基金资助:
    * 2019年度山东省社会科学规划项目“基于中国英语能力等级量表的英语写作形成性反馈模式研究”的阶段性成果(编号19CWZJ11)

Pinpointing Analytic Rating Criteria for EFL Writing Assessment from Raters’ Perspectives

ZOU Shaoyan(), FAN Jingsong()   

  • Online:2022-08-28 Published:2022-09-13

摘要:

近年来,大规模外语写作测试中采用的评分标准引起了普遍关注,很多研究者一致认为评分标准代表了写作测试实际测量的构念。鉴于此,本研究以大学英语四级写作测试(简称CET-4写作测试)为例,探索适用于CET-4写作测试的评分标准。在理论回顾和文献分析的基础上,本文初步归纳出可能适用于CET-4写作测试的评分标准,然后采用混合研究方法,借助问卷和访谈调查了评分员对这些评分标准的意见。研究结果表明:除了“任务的完成度”这项评分标准之外,其余九项评分标准在CET-4写作测试的评分中都比较有效,而且这些评分标准也基本包含在CET-4写作测试目前的构念框架中,说明这些评分标准符合CET-4写作测试的理论构念要求。本研究从理论上和方法上对于界定大规模外语写作测试的构念,以及检验评分量表的效度都具有一定的启示意义。

关键词: 外语写作测试, 评分标准, 构念, CET-4写作测试, 混合研究方法, 效度

Abstract:

In recent years, the rating criteria adopted in large-scale EFL writing assessments have received increasing research attention due to the widespread consensus that rating criteria represent the de-facto test construct of writing assessment. As such, this study was conducted to pinpoint the most useful rating criteria for the writing components of College English Test Band Four (CET-4 writing). Relying on a Mixed-methods approach, the study investigated how CET-4 raters would perceive the usefulness of a set of rating criteria elicited on the basis of atheoretical and literature review. The results showed that all the rating criteria were perceived to be useful except for one criterion —task fulfillment. Given that the remaining criteria were relevant to the construct components of CET-4 writing, we could have confidence in their representativenss of the construct validity of CET-4 writing. Meanwhile, the study also found that the proficiency levels of CET-4 writing performance could significantly impact raters’ perception of the usefulness of the rating criteria. This, to some extent, could pose challenge to the validity of the holistic scoring approach adopted by CET-4 writing. In conclusion, this study can provide some theoretical and methodological implications for future research indelineating the construct components of large-scale EFL assessments, as well as examining the validity of the existing rating scales adopted by large-scale EFL assessments.

Key words: EFL writing assessments, rating criteria, construct, CET-4 writing, Mixed-methods approach, test validity

中图分类号: