网上评卷的实践与思考:香港公开考试视角

当代外语研究 ›› 2013, Vol. 13 ›› Issue (08): 14-19.

网上评卷的实践与思考:香港公开考试视角

龚大胃, 麦陈淑贤, 金檀, 刘力

香港教育学院,香港,999077;香港中文大学,香港,999077;树童国际语言教育研究院,广州,511400;香港中文大学,香港,999077

出版日期:2013-08-15 发布日期:2020-07-25
作者简介:龚大胃,香港教育学院课程与评估讲座教授、课程与教学系系主任。主要研究方向为语言评估、语言教学法及计算机辅助语言学习。电子邮箱:coniam@ied.edu.hk;麦陈淑贤,香港中文大学教育学院副教授、联合书院副院长兼书院辅导长。主要研究方向为教师专业发展、语言学习焦虑、语言测试与评估及第二语言写作和阅读。电子邮箱:barleymak@cuhk.edu.hk;金檀,树童国际语言教育研究院常务副院长。主要研究方向为语言评估、教师教育及研究方法。电子邮箱:alextanjin@gmail.com;刘力,香港中文大学教育学院博士生。主要研究方向为语言测试与评估、语料库语言学及教师专业发展。电子邮箱:refilane@gmail.com

Reflections on the Practice of Onscreen Marking: The Case of Hong Kong Public Examinations

David Coniam, Barley Mak, JIN Tan, LIU Li

Online:2013-08-15 Published:2020-07-25

摘要/Abstract

摘要： 网上评卷作为一种新型评卷形式,对提高评卷效率、控制评卷误差具有重要的现实意义。文章系统回顾了国际领域网上评卷的实施情况,并报告了香港考试及评核局针对香港中学会考网上评卷的实施情况所开展的一系列验证性研究。研究结果表明:(1)网上评卷和纸质评卷所得分数具有可比性;(2)采用网上评卷不会对考生分数产生影响;(3)评分员对于评分模式的倾向不存在偏倚。文章还提出了日后网上评卷研究的研究重点和发展方向,对其他国家和地区开展网上评卷有一定借鉴和启示作用。

关键词: 网上评卷, 纸质评卷, 香港中学会考

Abstract: Test fairness is one of the overriding concerns in language test research and development. And how teachers conceive and implement test fairness is of critical importance in ensuring test fairness. This paper, by means of a questionnaire survey, looks into the perception and practice of teachers with regard to test fairness. The results show that teachers were aware of test fairness in some aspects and had practiced accordingly, while in other aspects teachers were not clear and thus failed to adopt adequate measures. Finally, the paper proposes that proper training be provided to teachers so as to raise their awareness.

中图分类号:

龚大胃, 麦陈淑贤, 金檀, 刘力. 网上评卷的实践与思考:香港公开考试视角[J]. 当代外语研究, 2013, 13(08): 14-19.

David Coniam, Barley Mak, JIN Tan, LIU Li. Reflections on the Practice of Onscreen Marking: The Case of Hong Kong Public Examinations[J]. Contemporary Foreign Languages Studies, 2013, 13(08): 14-19.

参考文献

Adams, C. 2005. How does assessment differ when e-marking replaces paper-based marking? [R]. The 31st Annual International Association for Educational Assessment Conference, Abuja, Nigeria.
Attali, Y. & J. Burstein. 2006. Automated essay scoring with e-rater v. 2 [J]. Journal of Technology, Learning, and Assessment (3): 3-29.
Bond, T. G. & C. M. Fox. 2007. Applying the Rasch Model: Fundamental Measurement in the Human Sciences (2nd edition) [M]. Mahwah, N.J.: Lawrence Erlbaum.
Coniam, D. 1991. Essay marking: A comparison of criterion-referenced and norm-referenced marking [J]. Institute of Language in Education Journal (7): 154-64.
Coniam, D. 2008. An investigation into the effect of raw scores in determining grades in a public examination of writing [J]. Japan Association for Language Teaching Journal (1): 69-84.
Coniam, D. 2009a. A comparison of onscreen and paper-based marking in the Hong Kong public examination system [J]. Educational Research and Evaluation (3): 243-63.Coniam, D. 2009b. Discrepancy essays: Natural phenomenon or problem to be solved [J]. Melbourne Papers in Language Testing (2): 1-31.
Coniam, D. 2010a. Validating onscreen marking in Hong Kong [J]. Asia Pacific Education Review (3): 423-31.
Coniam, D. 2010b. Examining negative attitudes towards onscreen marking in Hong Kong [J]. Education Journal (1-2): 71-87.
Coniam, D. 2010c. The comparability of marking on screen and on paper: The case of Liberal Studies in Hong Kong [J]. Journal of Educational Technology Systems (4): 453-69.
Coniam, D. 2011. A qualitative examination of the attitudes of Liberal Studies markers towards onscreen marking [J]. British Journal of Educational Technology (6): 1042-54.
Coniam, D. & A. Yeung. 2010. Markers' perceptions regarding the onscreen marking of Liberal Studies in the Hong Kong public examination system [J]. Asia Pacific Journal of Education (3): 249-71.
Dörnyei, Z. 2003. Questionnaires in Second Language Research: Construction, Administration, and Processing [M]. Mahwah, New Jersey: Lawrence Erlbaum.
Falvey, P. & D. Coniam. 2010. A qualitative study of the response of raters towards onscreen and paper-based marking [J]. Melbourne Papers in Language Testing (1): 1-26.
Fowles, D. 2002. Evaluation of an e-marking pilot in GCE Chemistry: Effects on marking and examiners' views [R]. AQA Research Committee paper RC/190.
Hatch, E. & A. Lazaraton. 1991. The Research Manual: Design and Statistics for Applied Linguistics [M]. New York: Newbury/Harper Collins.
Hong Kong Examinations and Assessment Authority (HKEAA). 2007. HKCEE English language examination report and question papers [R]. Hong Kong: Hong Kong Examinations and Assessment Authority.
Johnson, M., R. Nádas & J. F. Bell. 2010. Marking essays on screen: An investigation into the reliability of marking extended subjective texts [J]. British Journal of Educational Technology (5): 814-26.
King, R. 1994. Historical survey of English language testing in Hong Kong [A]. In J. Boyle & P. Falvey (eds.). English Language Testing in Hong Kong [C]. Hong Kong: The Chinese University Press. 3-29.
Linacre, J. M. 2004. A User's Guide to FACETS: Rasch-Model Computer Programs [M]. Chicago: Winsteps.com.
Weir, C. J. 2005. A socio-cognitive approach to test validation [R]. The ALTE Second International Conference, Berlin.
Zhang, Y., D. Powers, W. Wright & R. Morgan. 2003. Applying the online scoring network (OSN) to advanced program placement program (AP) Tests [R]. ETS Research Report RR-03-12.
罗友花、刘铁明.2009.网上阅卷研究述评[J].中国考试(11):34-37.
马世晔.2004.网上阅卷的回顾与思考[J].中国考试(研究版)(7):24-26.
赵建宁、厉浩.2012.以考生为本的高考网上评卷精细化管理研究[J].中国考试(2):28-31.

[1]	李战子. 新媒体素养:内涵和演变——兼论对功能语言学话语分析的新挑战[J]. 当代外语研究, 2021, 454(4): 13-20.
[2]	白天依. 中国南海安全政策话语的演变与发展[J]. 当代外语研究, 2021, 452(2): 53-63.
[3]	许皖栋, 辜向东. 认知效度理据、概念、模型及实证研究综述[J]. 当代外语研究, 2020, 450(6): 68-78.
[4]	高岩杰, 丁艺, 蒋跃. 英语政治访谈文本中情态量值的人际意义[J]. 当代外语研究, 2020, 450(6): 50-58.
[5]	张乐, 刘芹. 中国理工科大学生英语求职信中的短语特征[J]. 当代外语研究, 2020, 450(6): 111-120.
[6]	王靓婧, 潘璠. 新一代可视化语料库软件#LancsBox的核心功能和应用前景[J]. 当代外语研究, 2020, 449(5): 77-90.
[7]	姚剑鹏. 二语教师话语中的修补启动[J]. 当代外语研究, 2015, 15(09): 70-75.
[8]	张敬源, 夏静. 加的夫语法视阈下的现代汉语“使”字结构研究[J]. 当代外语研究, 2015, 15(05): 17-22.
[9]	黄万丽, 秦洪武. 英汉平行历时语料库的创建与语料检索[J]. 当代外语研究, 2015, 15(03): 14-19.
[10]	张建华. 日语专业学生产出性词汇广度知识发展的研究[J]. 当代外语研究, 2015, 15(03): 31-35.
[11]	周惠, 刘永兵. 英汉学术书评中投射结构的评价研究[J]. 当代外语研究, 2015, 15(02): 18-23.
[12]	李文中. 语料库证据在美国法庭应用的再审视[J]. 当代外语研究, 2014, 14(07): 7-11.
[13]	刘立新, 杨玉晨. “起承转合”之起承转合——对比修辞视阈下汉语篇章模式研究[J]. 当代外语研究, 2014, 14(04): 18-22.
[14]	吴若蕙. “全民英检”高级写作纸笔与电脑化测验之平行研究初探[J]. 当代外语研究, 2013, 13(08): 6-13.
[15]	贾冬梅, 蓝纯. 五行之土行背后的概念隐喻和借代[J]. 当代外语研究, 2013, 13(01): 20-25.