TEM4听力理解项目的行为锚定分析及标准参照属性Behaviorally Anchoring and Criterion-Referencing of TEM-4 Listening Comprehension
彭康洲
摘要(Abstract):
本文按照文本类型和项目所涉及的认知活动进行项目归类,使用Rasch模型对2007年TEM4听力理解测试做行为锚定分析,了解项目的标准参照属性。分析表明,不同水平的考生在听力技能掌握方面存在显著差异。从标准参照属性来看,所有学生基本上掌握了理解明确信息的听力技能,这类题目区分度高;而对于隐含信息的理解都较差,这类题目区分度较弱。总体来讲,明确信息最容易理解,信息整合次之,而隐含信息最难。从听力理解的体裁类型来看,所有学生基本上能理解短文类和新闻类的文章;短文类的区分度好,会话类最差。
关键词(KeyWords): 标准参照语言测试;文本类型;认知活动;行为锚定分析
基金项目(Foundation): 上海外国语大学“211工程”三期建设重点学科资助项目《英语专业写作教学语料库研究与建设》阶段性成果之一;项目编号:SISU211-3-1-1-032;项目负责人:邹申
作者(Author): 彭康洲
参考文献(References):
- [1]高校英语专业四级考试大纲修订小组.高校英语专业考试大纲[Z].上海:上海外语教育出版社,2004.
- [2]黄子东.话题熟悉度、语言水平和问题类型对EFL听力理解的影响:一项基于图式理论和关联理论的实验研究[J].现代外语, 1998(4).
- [3]彭康洲,李清华.应用IRT模型分析TEM4听力理解项目的质量[J].外语教学理论与实践,2009(3).
- [4]杨志,张雷.测评的概化理论及其应用[M].北京:教育科学出版社,2003.
- [5]邹申,杨任明.对标准参照考试的再认识——兼谈其在考试反拨效应中的积极作用[J].外语电化教学,2006(5).
- [6]邹申.初探TEM8考试人文知识项目的标准参照属性[J].外语界,2007(6).
- [7]邹申.初探标准参照考试在我国语言测试中的作用[J].中国英语教学,2008(4).
- [8]Bachman,L.F.Fundamental Considerations in Language Testing [M].Oxford:OUP,1990.
- [9]Cartier,F.A.Criterion-referenced testing of language skills[J].TESOL Quarterly,1968,2(1):27-32.
- [10]Cziko,G.A.Improving the psychometric,criterion-referenced,and practical qualities of integrative language tests[J].TESOL Quarterly, 1982,16(3):367-379.
- [11]Brown,J.D.Improving ESL placement tests using two perspectives [J].TESOL Quarterly,1989,23(1):65-83.
- [12]Brown,J.D.Short-cut estimators of criterion-referenced test consistency [J].Language Testing,1990,7(1):77-97.
- [13]Brown,J.D.Testing in Language Programs:A Comprehensive Guide to English Language Assessment[M].New York:The McGraw-Hill Companies,Inc.,2005.
- [14]Brown,J.D.,& Hudson,T.Criterion-referenced Language Testing [M].Cambridge:CUP,2002.
- [15]Findley,C.A.,& Nathan,L.A.Functional language objectives in a competency ESL curriculum[J].TESOL Quarterly,1980,14(2): 221-231.
- [16]Henning,G.Advantages of latent trait measurement in language testing [J].Language Testing,1984,1(2):123-133.
- [17]Hudson,T.Relationships among IRT item discrimination and item indices in criterion-referenced language testing[J].Language Testing, 1991,8(2):160-181.
- [18]Hudson,T.Trends in assessment scales and criterion-referenced language assessment[J].Annual Review of Applied Linguistics, 2005,25:205-227.
- [19]Hudson,T.,& Lynch,B.A criterion-referenced measurement approach to ESL achievement testing[J].Language Testing,1984,1 (2):171-210.
- [20]Lynch,B.K.,& Davidson,F.Criterion-referenced language test development:linking curricula,teachers,and tests[J].TESOL Quarterly,1994,28(4):727-743.
- [21]Perkins,K.,& Brutten,S.R.A behavioral anchoring analysis of three ESL reading comprehension tests[J].TESOL Quarterly,1988, 22(4):64-79.
- [22]Shavelson,R.J.,& Webb,N.M.Generalizability Theory:A Primer [M].California:Sage Publications,Inc.,1991.
- [23]Shohamy,E.,& Inbar,O.Validation of listening comprehension tests:The effects of text and question type[J].Language Testing, 1991,8(1):23-40.