Rasch模型下自我评估量表的效度探析

doi:10.3969/j.issn.1674-8921.2017.02.005

当代外语研究 ›› 2017, Vol. 17 ›› Issue (02): 34-40.doi: 10.3969/j.issn.1674-8921.2017.02.005

Rasch模型下自我评估量表的效度探析

范劲松

复旦大学,上海,200433

出版日期:2017-03-28 发布日期:2020-07-25
作者简介:范劲松,博士,复旦大学外文学院副教授。主要研究方向为语言测试与评估。电子邮箱:jinsongfan@fudan.edu.cn
基金资助:
*本研究系教育部人文社会科学研究青年基金项目“基于多元语言文化能力的中国多语档案袋研究”(编号 15YJC740071)和全国高校外语教学科研项目“翻译教学中的师评、自评与互评研究:基于多层面Rasch模型的方法”(编号 SH201400008A)的阶段性成果。

The Validity of Self assessment Scale under the Rasch Model

FAN Jingsong

Online:2017-03-28 Published:2020-07-25

摘要/Abstract

摘要： 本研究采用Rasch测量理论中的评分量表模型探析一项自我评估量表的效度。根据解释性效度论据理论,本研究提出量表效度的四个关键性理据,并采用Rasch分析检查这四个效度理据的准确性与合理性。本研究中,我们采用一系列Rasch分析方法,包括信度分析、描述语与模型的拟合度分析、因子分析与试题差异分析等。同时,我们还研究了Rasch模型下被试的自评能力测量值与他们的客观水平测试成绩之间的相关性。研究结果表明,量表的信度良好,基本为单一的能力维度结构,量表的类别设置也比较合理。被试的自评能力值与客观水平测试成绩之间显著相关。本研究的分析结果为四个效度理据提供了重要支撑,本研究所采用的效度研究方法也为量表的效度研究提供了重要参考。

中图分类号:

H319

范劲松. Rasch模型下自我评估量表的效度探析[J]. 当代外语研究, 2017, 17(02): 34-40.

FAN Jingsong. The Validity of Self assessment Scale under the Rasch Model[J]. Contemporary Foreign Languages Studies, 2017, 17(02): 34-40.

参考文献

Andrich, D. 1978. Rating formulation for ordered response categories [J]. Psychometrika 43(4): 561-573.
Bachman, L. F. & A. S. Palmer. 1989. The construct validation of self-ratings of communicative language ability [J]. Language Testing 6(1): 14-29.
Bachman, L. F. & A. S. Palmer. 2010. Language Assessment in Practice: Developing Language Assessments and Justifying Their Use in the Real World [M]. Oxford: Oxford University Press.
Bond, T. G. & C. M. Fox. 2015. Applying the Rasch Model: Fundamental Measurement in the Human Sciences (3rd edn.) [M]. New Jersey: Lawrence Erlbaum Associates.
Butler, Y. G. & J. Lee. 2006. On-task versus off-task self-assessments among Korean elementary school students studying English [J]. The Modern Language Journal 90(4):506-518.
Chapelle, C. A., M. K. Enright & J. M. Jamieson. 2008. Building a Validity Argument for the Test of English as a Foreign Language [M]. New York and London: Routledge, Taylor & Francis Group.
Creswell, J. W. 2013. Research Design: Qualitative, Quantitative, and Mixed Methods Approaches [M]. Thousand Oaks, Sage.
Engelhard, G. 2013. Invariant Measurement: Using Rasch Models in the Social, Behavioral, and Health Sciences [M]. New York: Routledge.
IBM. 2012. IBM SPSS Statistics Version 21 [EB/OL]. [2015-10-20]. ftp://public.dhe.ibm.com/software/analytics/spss/documentation/amos/21.0/en/Manuals/IBM_SPSS_Amos_Users_Guide.pdf.
Linacre, J. M. 1989. Many-facet Rasch Measurement [M]. Chicago: MESA Press.
Linacre, J. M. 2002. Optimizing rating scale category effectiveness [J]. Journal of Applied Measurement 3(1): 85-106.
Linacre, J. M. 2013. Winsteps Tutorial [EB/OL]. [2014-11-07].http://www.winsteps.com/tutorials.htm.
Luoma, S. & M. Tarnanen. 2003. Creating a self-rating instrument for second language writing: From idea to implementation [J]. Language Testing 20(4): 440-465.
Masters, G. N. 1982. A Rasch model for partial credit scoring [J]. Psychometrika 47(2):149-174.
Matsuno, S. 2009. Self-, peer-, and teacher-assessments in Japanese university EFL writing classrooms [J]. Language Testing 26(1): 75-100.
Oscarson, M. 2013. Self-assessment in the classroom [A]. In A. J. Kunnan (ed.). The Companion to Language Assessment [C]. New York: Wiley-Blackwell. 712-729.
Pierce, B. N., M. Swain & D. Hart. (1993). Self-assessment, French immersion, and locus of control [J]. Applied Linguistics 14(1): 25-42.
Powers, D. E. & A. Powers. 2015. The incremental contribution of TOEIC? Listening, Reading, Speaking, and Writing tests to predicting performance on real-life English language tasks [J]. Language Testing 32(2): 151-167.
Rasch, G. 1960/1980. Probalistic Models for Some Intelligence and Attainment Tests [M]. Chicago: The University of Chicago Press.
Ross, S. 1998. Self-assessment in second language testing: A meta-analysis and analysis of experiential factors [J]. Language Testing 15(1): 1-20.
Suzuki, Y. 2015. Self-assessment of Japanese as a second language: The role of experiences in the naturalistic acquisition [J]. Language Testing 32(1): 63-81.
Toulmin, S. E. 2003. The Uses of Argument [M]. Cambridge: Cambridge University Press.
范劲松、季佩英、俞理明. 2014. 语言测试效度研究的另一视角:考试的因子结构研究 [J]. 外语教学理论与实践(4): 34-40.
范劲松、季佩英. 2015. 口语测试中分析性评分量表的构念效度研究 [J]. 中国外语教育 8(3): 85-94.
刘建达. 2002. 学生英文写作能力的自我评估 [J]. 现代外语 25(3): 241-249.
楼荷英. 2005. 自我评估同辈评估与培养自主学习能力之间的关系 [J]. 外语教学 26(4): 60-63.
孙鑫、李秋菊. 2015. 基础英语写作教学中自我、同伴及教师评估对比研究 [J]. 中国外语 12(1): 75-81.

[1]	赵中宝;. 《哲学与社会视角下的语言测试再审视》介评[J]. 当代外语研究, 2018, 18(03): 105-107.
[2]	张琳;陈琳丽;. 大学英语四级考试质量评估:基于经典测量理论和Rasch模型的数据分析[J]. 当代外语研究, 2015, 15(10): 41-47+66.

Rasch模型下自我评估量表的效度探析

The Validity of Self assessment Scale under the Rasch Model

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 2

编辑推荐

Metrics

本文评价