本研究采用Rasch测量理论中的评分量表模型探析一项自我评估量表的效度。根据解释性效度论据理论,本研究提出量表效度的四个关键性理据,并采用Rasch分析检查这四个效度理据的准确性与合理性。本研究中,我们采用一系列Rasch分析方法,包括信度分析、描述语与模型的拟合度分析、因子分析与试题差异分析等。同时,我们还研究了Rasch模型下被试的自评能力测量值与他们的客观水平测试成绩之间的相关性。研究结果表明,量表的信度良好,基本为单一的能力维度结构,量表的类别设置也比较合理。被试的自评能力值与客观水平测试成绩之间显著相关。本研究的分析结果为四个效度理据提供了重要支撑,本研究所采用的效度研究方法也为量表的效度研究提供了重要参考。
Andrich, D. 1978. Rating formulation for ordered response categories [J]. Psychometrika 43(4): 561-573.
Bachman, L. F. & A. S. Palmer. 1989. The construct validation of self-ratings of communicative language ability [J]. Language Testing 6(1): 14-29.
Bachman, L. F. & A. S. Palmer. 2010. Language Assessment in Practice: Developing Language Assessments and Justifying Their Use in the Real World [M]. Oxford: Oxford University Press.
Bond, T. G. & C. M. Fox. 2015. Applying the Rasch Model: Fundamental Measurement in the Human Sciences (3rd edn.) [M]. New Jersey: Lawrence Erlbaum Associates.
Butler, Y. G. & J. Lee. 2006. On-task versus off-task self-assessments among Korean elementary school students studying English [J]. The Modern Language Journal 90(4):506-518.
Chapelle, C. A., M. K. Enright & J. M. Jamieson. 2008. Building a Validity Argument for the Test of English as a Foreign Language [M]. New York and London: Routledge, Taylor & Francis Group.
Creswell, J. W. 2013. Research Design: Qualitative, Quantitative, and Mixed Methods Approaches [M]. Thousand Oaks, Sage.
Engelhard, G. 2013. Invariant Measurement: Using Rasch Models in the Social, Behavioral, and Health Sciences [M]. New York: Routledge.
IBM. 2012. IBM SPSS Statistics Version 21 [EB/OL]. [2015-10-20]. ftp://public.dhe.ibm.com/software/analytics/spss/documentation/amos/21.0/en/Manuals/IBM_SPSS_Amos_Users_Guide.pdf.
Linacre, J. M. 1989. Many-facet Rasch Measurement [M]. Chicago: MESA Press.
Linacre, J. M. 2002. Optimizing rating scale category effectiveness [J]. Journal of Applied Measurement 3(1): 85-106.
Linacre, J. M. 2013. Winsteps Tutorial [EB/OL]. [2014-11-07].http://www.winsteps.com/tutorials.htm.
Luoma, S. & M. Tarnanen. 2003. Creating a self-rating instrument for second language writing: From idea to implementation [J]. Language Testing 20(4): 440-465.
Masters, G. N. 1982. A Rasch model for partial credit scoring [J]. Psychometrika 47(2):149-174.
Matsuno, S. 2009. Self-, peer-, and teacher-assessments in Japanese university EFL writing classrooms [J]. Language Testing 26(1): 75-100.
Oscarson, M. 2013. Self-assessment in the classroom [A]. In A. J. Kunnan (ed.). The Companion to Language Assessment [C]. New York: Wiley-Blackwell. 712-729.
Pierce, B. N., M. Swain & D. Hart. (1993). Self-assessment, French immersion, and locus of control [J]. Applied Linguistics 14(1): 25-42.
Powers, D. E. & A. Powers. 2015. The incremental contribution of TOEIC? Listening, Reading, Speaking, and Writing tests to predicting performance on real-life English language tasks [J]. Language Testing 32(2): 151-167.
Rasch, G. 1960/1980. Probalistic Models for Some Intelligence and Attainment Tests [M]. Chicago: The University of Chicago Press.
Ross, S. 1998. Self-assessment in second language testing: A meta-analysis and analysis of experiential factors [J]. Language Testing 15(1): 1-20.
Suzuki, Y. 2015. Self-assessment of Japanese as a second language: The role of experiences in the naturalistic acquisition [J]. Language Testing 32(1): 63-81.
Toulmin, S. E. 2003. The Uses of Argument [M]. Cambridge: Cambridge University Press.
范劲松、季佩英、俞理明. 2014. 语言测试效度研究的另一视角:考试的因子结构研究 [J]. 外语教学理论与实践(4): 34-40.
范劲松、季佩英. 2015. 口语测试中分析性评分量表的构念效度研究 [J]. 中国外语教育 8(3): 85-94.
刘建达. 2002. 学生英文写作能力的自我评估 [J]. 现代外语 25(3): 241-249.
楼荷英. 2005. 自我评估同辈评估与培养自主学习能力之间的关系 [J]. 外语教学 26(4): 60-63.
孙鑫、李秋菊. 2015. 基础英语写作教学中自我、同伴及教师评估对比研究 [J]. 中国外语 12(1): 75-81.
