大学英语阅读诊断反馈报告应用及评价——以G-DINA模型为例Application and Evaluation of Diagnostic Feedback Report on College English Reading——An Example of G-DINA Model
张海云;
摘要(Abstract):
认知诊断评估为大学英语阅读教学提供了新视角,G-DINA认知诊断模型可以获取丰富的诊断信息。本研究选取6089名被试的阅读测试数据,基于G-DINA模型进行诊断分析,根据获取的诊断信息,随机选取1099名学生和12名大学英语任课教师分别制作学生个性化诊断反馈报告与班级诊断反馈报告,并开展问卷调查了解学生和教师对于反馈报告的评价及意见建议等。研究表明,G-DINA模型能够很好地拟合学生大学英语阅读测试的作答数据并为学生的表现提供充足的诊断信息。大部分教师和学生都对报告的内容和设计表示认可,认为反馈报告有助于进一步的教学或学习。
关键词(KeyWords): 大学英语阅读;认知诊断评估;DF报告;G-DINA模型
基金项目(Foundation): 山东省社会科学规划研究项目(项目编号:18CWZJ36)的阶段性研究成果
作者(Authors): 张海云;
参考文献(References):
- [ 1 ] Alderson,J.C.Diagnosing Foreign Language Proficiency:The Interface between Learning and Assessment[M].London:Continuum,2005.
- [ 2 ] Alderson,J.C.,Clapham,C.& D.Wall.Language Test Construction and Evaluation[M].Cambridge:Cambridge University Press,1995.
- [ 3 ] Boud,D.Assessment reforms around the world [A].In Berry,R.& B.Adamson (eds.).Education in the Asia-Pacific Region:Issues,Concerns and Prospects[C].London:Springer,2007.
- [ 4 ] Brown,L.I.et al.National tests and diagnostic feedback:What say teachers in Trinidad and Tobago?[J].Journal of Educational Research,2014(3).
- [ 5 ] de la Torre,J.DINA model and parameter estimation:A didactic[J].Journal of Educational and Behavioral Statistics,2009(1).
- [ 6 ] de la Torre,J.The generalized DINA model framework[J].Psychometrika,2011(2).
- [ 7 ] Doe,C.Student interpretations of diagnostic feedback[J].Language Assessment Quarterly,2015(12).
- [ 8 ] Harding,L.,Alderson,J.C.& T.Brunfaut.Diagnostic assessment of reading and listening in a second or foreign language:Elaborating on diagnostic principles[J].Language Testing,2015(3).
- [ 9 ] Hemmati,S.J.,Baghaei,P.& Bemani,M.Cognitive diagnostic modeling of L2 reading comprehension ability:Providing feedback on the reading performance of Iranian candidates for the university entrance examination[J].International Journal of Language Testing,2016(2).
- [10] Hirvela,A.Connecting Reading and Writing in Second Language Writing Instruction[M].Ann Arbor:The University of Michigan Press,2004.
- [11] Jang,E.E.Cognitive diagnostic assessment of L2 reading comprehension ability:Validity arguments for Fusion Model application to LanguEdge assessment[J].Language Testing,2009(1).
- [12] Jang,E.E.et al.How do young students with different profiles of reading skill mastery,perceived ability,and goal orientation respond to holistic diagnostic feedback?[J].Language Testing,2015(3).
- [13] Javidanmehr,Z.& M.R.A.Sarab.Retrofitting non-diagnostic reading comprehension assessment:Application of the G-DINA model to a high stakes reading comprehen-sion test[J].Language Assessment Quarterly,2019(3).
- [14] Kim,A.Y.Exploring ways to provide diagnostic feedback with an ESL placement test:Cognitive diagnostic assessment of L2 reading ability[J].Language Testing,2015(2).
- [15] Kunnan,A.& E.E.Jang.Diagnostic feedback in language testing[A].In Long,M.& C.Doughty (eds.).The Handbook of Language Teaching[C].Oxford:Wiley-Blackwell,2009.
- [16] Lee,Y.W.& Y.Sawaki.Cognitive diagnostic approaches to language assessment:An overview[J].Language Assess-ment Quarterly,2009(3).
- [17] Leighton,J.P.& M.J.Gierl.Cognitive Diagnostic Assessment for Education:Theory and Practices[M].Cambridge:Cambridge University Press,2007.
- [18] Li,H.,Hunter,C.V.& P.W.Lei.The selection of cognitive diagnostic models for a reading comprehension test[J].Language Testing,2016(3).
- [19] Lord,F.M.Applications of Item Response Theory to Practical Testing Problems[M].Hillsdale:Lawrence Erlbaum Associates,1980.
- [20] Mirzaei,A.,Vincheh,M.H.& M.Hashemian.Retrofitting the IELTS reading section with a general cognitive diagnostic model in an Iranian EAP context[J].Studies in Educational Evaluation,2020(1).
- [21] Ravand,H.& A.Robitzsch.Cognitive diagnostic model of best choice:A study of reading comprehension[J].Educational Psychology,2018(10).
- [22] Roberts,M.R.& M.J.Gierl.Developing score reports for cognitive diagnostic assessments[J].Educational Measure-ment:Issues and Practice,2010(3).
- [23] Spearman,C.General intelligence,objectively determined and measured[J].American Journal of Psychology,1904(1).
- [24] Spolsky,B.Social aspects of individual assessment[A].In de Jong,J.& D.K.Stevenson (eds.).Individualizing the Assessment of Language Abilities[C].Clevedon:Multilingual Matters,1990.
- [25] Sun,Y.& M.Suzuki.Diagnostic assessment for improving teaching practice[J].International Journal of Information and Education Technology,2013(6).
- [26] Wei,J.Bridging the Gap between Research and Practice:Construction and Validation of a CDA-Informed English Reading Test for China's Twelfth Graders [D].Urbana-Champaign:University of Illinois at Urbana-Champaign,2016.
- [27] Yang,R.Investigating How Test-Takers Use the DIALANG Feedback [D].Lancaster:Lancaster University,2003.
- [28] Yi,Y.Implementing A Cognitive Diagnostic Assessment in an Institutional Test:A New Networking Model in Language Testing and Experiment with a New Psychometric Model and Task Type[D].Urbana-Champaign:University of Illinois at Urbana-Champaign,2012.
- [29] Yi,Y.Probing the relative importance of different attributes in L2 reading and listening comprehension items:An application of cognitive diagnostic models[J].Language Testing,2017(3).
- [30] You,X.,Li,M.& H.Liu.The feedback of the Chinese learning diagnosis system for personalized learning in classrooms[J].Frontiers in Psychology,2019(10).
- [31] 陈慧麟,陈劲松.G-DINA认知诊断模型在语言测验中的验证[J].心理科学,2013(6).
- [32] 罗娟.基于大学英语分级测试的阅读能力认知诊断研究[D].长沙:湖南大学,2019.
- [33] 罗凯洲.英语阅读能力的认知诊断研究[M].北京:外语教学与研究出版社,2020.
- [34] 涂东波.高级认知诊断[M].北京:北京师范大学出版社,2019.
- [35] 张海云,石运章.基于校本测试的大学英语阅读群体及个性化诊断研究[J].外语电化教学,2020(5).