A Framework for Constructing Cognitive Diagnostic Reports on English Reading for Chinese University Students

Authors

  • zhe zhang

    Faculty of Education, Universiti Kebangsaan Malaysia, Bangi 43600, Selangor, Malaysia
  • Mohd Isa Hamzah

    Faculty of Education, Universiti Kebangsaan Malaysia, Bangi 43600, Selangor, Malaysia
  • Khairul Azhar Jamaludin

    Faculty of Education, Universiti Kebangsaan Malaysia, Bangi 43600, Selangor, Malaysia

DOI:

https://doi.org/10.30564/fls.v7i3.8674
Received: 6 February 2024 | Revised: 25 February 2024 | Accepted: 3 March 2025 | Published Online: 13 March 2025

Abstract

In the context of higher education in China, improving students’ English language proficiency has become a critical task, as English plays an increasingly important role in academic development and career success. However, traditional summative assessment methods, such as the College English Test Band 4 and Band 6 (CET-4 and CET-6), mainly provide scores or rankings. These abstract results fail to offer detailed insights into students’ strengths and weaknesses in reading comprehension. As a result, they do not fully serve the purpose of assessment or meet students’ practical needs. With the advancement of information technology, the application of computer-based approaches in education has gained growing attention. Cognitive diagnostic models, which provide detailed and fine-grained analysis, align well with Chinese students’ needs for personalized feedback. This study adopts the Generalized DINA (G-DINA) model to analyze students’ English reading performance and generate personalized diagnostic feedback reports. The results show that the G-DINA model fits the college English reading test data effectively and yields meaningful diagnostic information. A survey of students’ feedback and suggestions reveals that most students responded positively to the content and design of the feedback reports. They believed that personalized feedback enhanced their learning experience and contributed to instructional improvement. By incorporating cognitive diagnostic assessment into English reading instruction, this study proposes a more accurate, data-driven feedback approach. It addresses the limitations of traditional assessments and supports more targeted teaching improvements in English education at Chinese universities.

Keywords:

College English Reading; Cognitive Diagnostic Assessment; G-DINA Model; Diagnostic Feedback

References

[1] Baoqi, S., Hu, G., Curdt-Christiansen, X.L., 2020. Metalinguistic contribution to reading comprehension: A comparison of Primary 3 students from China and Singapore. Applied Psycholinguistics. 41(3), 657–684.

[2] Liu, J.D., Han, B.C., 2018. Theoretical considerations for developing use-oriented Chin's Standards of English. Modern Foreign Languages. 41(1), 78–90.

[3] Zeng, M., Bao, Z.J. 2022. The Dilemma of College English Education and Teaching and Innovative Practices under the Guidance of College English Teaching Guide (2020 Edition). Journal of Jilin College of Education. 38(10), 26–30.

[4] Yanwei, J., 2019. Action Research as a Model for the Enhancement of Communicative Competence among Learners of English as a Foreign Language in Mainland China. In Proceedings of the 2019 3rd International Conference on Education Technology and Economic Management; Xi'an, China, 1–5 September 2019. pp. 909–913.

[5] Zhang, H., Shi, Y., 2020. The group and individualized diagnosis on EFL reading in university-based final test. Technology Enhanced Foreign Language Education. 2020(5), 79–85.

[6] Zheng, R., 2023. Chinese university students' English reading strategies: An analysis of the current situation and a proposal for enhancement. Pacific International Journal. 6(2), 226–231.

[7] Lin, C., Shao, Z.C., Hui, G., 2023. Research and analysis of factors influencing the passing rate of CET-4 in local universities. Lavai-International Journal of Education. 19(29), 30–41.

[8] Han, F., 2021. Washback of the reformed college English test band 4 (CET-4) in English learning and teaching in China, and possible solutions. In: Lanteigne, B., Coombe, C., Brown, J.D. (eds.). Challenges in Language Testing Around the World: Insights for language test users. Springer: Singapore. pp. 35–46.

[9] Zhou, S., McKinley, J., Rose, H., et al., 2022. English medium higher education in China: Challenges and ELT support. English Language Teaching Journal. 76(2), 261–271.

[10] Najarzadegan, S., 2022. The effect of learning a CDA model on promoting EFL undergraduates' reading comprehension ability across different proficiency levels. Journal of Modern Research in English Language Studies. 9(4), 75–92.

[11] Wu, Y., 2018. The current situation and innovative reform path of university English teaching under the background of “Internet+”. Educational Theory and Practice. 6(2), 57–58.

[12] Leighton, J.P., Gierl, M.J., 2007. Defining and evaluating models of cognition used in educational measurement to make inferences about examinees' thinking processes. Educational Measurement: Issues and Practice. 26(2), 3–16.

[13] Alderson, J.C., 2017. The challenge of (diagnostic) testing: Do we know what we are measuring. In: Fox, J., Wesche, M., Bayliss, D., et al. (eds.). Language Testing Reconsidered. University of Ottawa Press: Ottawa, Canada. pp. 21–39.

[14] Kunnan, A.J., Jang, E.E., 2009. Diagnostic feedback in language assessment. In: Michael, H., Catherine, L., Doughty, J. (eds.). The Handbook of Language Teaching. Wiley-Blackwell Publishing Ltd.: Malden, USA. pp. 610–627.

[15] Nichols, P.D., 1994. A framework for developing cognitively diagnostic assessments. Review of Educational Research. 64(4), 575–603. DOI: https://doi.org/10.3102/00346543064004575

[16] De la Torre, J., Sorrel, M.A., 2023. Cognitive diagnosis models. In: Ashby, F. G., Colonius, H., Dzhafarov, E.N. (eds.). New handbook of mathematical psychology, Volume 3: Perceptual and cognitive processes. Cambridge University Press: Cambridge, UK. pp. 15–24.

[17] Leighton, J.P., 2022. Cognitive Diagnostic Testing. Routledge: London, UK. pp. 50–65.

[18] Jang, E.E., 2009. Cognitive diagnostic assessment of L2 reading comprehension ability: Validity arguments for Fusion Model application to LanguEdge assessment. Language Testing. 26(1), 31–73.

[19] Buck, G., Tatsuoka, K., 1998. Application of the rule-space procedure to language testing: Examining attributes of a free response listening test. Language testing. 15(2), 119–157.

[20] Mei, H., Chen, H., 2024. Cognitive diagnosis in language assessment: A thematic review. RELC Journal. 55(2), 529–537.

[21] Tatsuoka, K.K., 2009. Cognitive Assessment: An Introduction to the Rule Space Method. Routledge: New York, NY, USA. pp. 80–98.

[22] Tatsuoka, K.K., 2013. Toward an integration of item-response theory and cognitive error diagnosis. In: Frederiksen, N., Glaser, R., Lesgold, A., et al. (eds.). Diagnostic Monitoring of Skill and Knowledge Acquisition. Routledge: Hillsdale, NJ, USA. pp. 453–488.

[23] Rupp, A., Templin, J., Henson, R., 2010. Diagnostic Measurement: Theory, Methods, and Applications. The Guilford Press: New York, USA. pp. 102–110.

[24] Wei, J., 2016. Bridging the Gap Between Research and Practice: Construction and Validation of a CDA-informed English Reading Test for China's Twelfth Graders [Doctoral dissertation]. University of Illinois at Urbana-Champaign: Champaign, IL, USA. pp. 45–61.

[25] Harding, L., Alderson, J.C., Brunfaut, T., 2015. Diagnostic assessment of reading and listening in a second or foreign language: Elaborating on diagnostic principles. Language Testing. 32(3), 317–336.

[26] Sun, H., Kang, Y., 2022. A review of cognitive diagnosis assessment in language from 2000 to 2021: A visualized analysis with CiteSpace II. Journal of Humanities and Social Sciences Studies. 4(3), 182–191.

[27] Chen, Q.M., Zhang, M.Q., 2010. Development of cognitive diagnosis models and their application methods. Advances in Psychological Science. 18(03), 522.

[28] De La Torre, J., 2011. The generalized DINA model framework. Psychometrika. 76(2), 179–199.

[29] Nájera, P., Abad, F.J., Chiu, C.Y., et al., 2023. The restricted DINA model: A comprehensive cognitive diagnostic model for classroom-level assessments. Journal of Educational and Behavioral Statistics. 48(6), 719–749.

[30] Chen, H., Chen, J., 2016. Retrofitting non-cognitive-diagnostic reading assessment under the generalized DINA model framework. Language Assessment Quarterly. 13(3), 218–230.

[31] Boori, A.A., Ghazanfari, M., Ghonsooly, B., et al., 2024. Cognitive diagnostic modeling analysis of the reading comprehension section of an Iranian high-stakes language proficiency test. International Journal of Language Testing. 14(1), 17–33.

[32] Hemmat, S.J., Baghaei, P., Bemani, M., 2016. Cognitive diagnostic modeling of L2 reading comprehension ability: Providing feedback on the reading performance of Iranian candidates for the university entrance examination. International Journal of Language Testing. 6(2), 92–100.

[33] Wang, H., 2021. Analysis and prediction of CET4 scores based on data mining algorithm. Complexity. 2021(1), 5577868.

[34] Huang, C., 2023. Assessing reading comprehension in CET-4: A cross-sectional case study. Interactive Learning Environments. 31(10), 7149–7158.

[35] Wang, C., Gierl, M.J., 2011. Using the attribute hierarchy method to make diagnostic inferences about examinees' cognitive skills in critical reading. Journal of Educational Measurement. 48(2), 165–187.

[36] Du, W., Ma, X., 2018. CDA-based diagnostic model construction for EFL reading tests. Foreign Language Teaching and Research. 50(1), 74–88.

[37] Luo, J., 2019. Cognitive Diagnostic Assessment for Reading Comprehension Based on College English Placement Test [Doctoral dissertation]. Hunan University: Changsha, China. pp. 78–90.

[38] Zhang, H.Y., 2022. Application and evaluation of diagnostic feedback report on college English reading--Taking G-DINA model as an example. Foreign language e-Learning. 2, 39–47+117.

[39] Fan, T., Sun, B., Zeng, Y., 2023. A comparative study of different cognitive diagnosis models on English reading tests. China Examinations. (05), 53–61. DOI: http://doi.org/10.19360/j.cnki.11-3303/g4.2023.05.007

[40] Fan, T., Zeng, Y., 2019. A reading ability diagnostic model based on the China English Proficiency Scale. Chinese Foreign Languages. (03), 21–31.

[41] Henderson, M., Ryan, T., Boud, D., et al., 2021. The usefulness of feedback. Active Learning in Higher Education. 22(3), 229–243.

[42] Zhang, Z.V., Hyland, K., 2022. Fostering student engagement with feedback: An integrated approach. Assessing Writing. 51, 100586.

[43] Roberts, M.R., Gierl, M.J., 2010. Developing score reports for cognitive diagnostic assessments. Educational Measurement: Issues and Practice. 29(3), 25–38.

[44] Bernacki, M.L., Greene, M.J., Lobczowski, N.G., 2021. A systematic review of research on personalized learning: Personalized by whom, to what, how, and for what purpose (s)? Educational Psychology Review. 33(4), 1675–1715.

[45] Huang, C., 2023. Assessing reading comprehension in CET-4: A cross-sectional case study. Interactive Learning Environments. 31(10), 7149–7158.

[46] Alamri, H., Lowell, V., Watson, W., et al., 2020. Using personalized learning as an instructional approach to motivate learners in online higher education: Learner self-determination and intrinsic motivation. Journal of Research on Technology in Education. 52(3), 322–352.

Downloads

How to Cite

zhang, zhe, Hamzah, M. I., & Jamaludin, K. A. (2025). A Framework for Constructing Cognitive Diagnostic Reports on English Reading for Chinese University Students. Forum for Linguistic Studies, 7(3), 643–655. https://doi.org/10.30564/fls.v7i3.8674

Issue

Vol. 7 , Iss. 3 (March 2025)

Article Type

Article

License

Copyright © 2025 zhe zhang, Mohd Isa Hamzah, Khairul Azhar Jamaludin

Creative Commons License

This is an open access article under the Creative Commons Attribution-NonCommercial 4.0 International (CC BY-NC 4.0) License.