A cross-cultural study of differential item functioning analysis of beliefs about Language Learning Inventory (BALLI)

Authors

  • Zahra Shahsavar

    Department of English Language, School of Paramedical Sciences, Shiraz University of Medical Sciences
  • Reza Kafipour

    Department of English Language, School of Paramedical Sciences, Shiraz University of Medical Sciences
  • Sara Kashefian-Naeeini

    Department of English Language, School of Paramedical Sciences, Shiraz University of Medical Sciences;
    Philosophy of Life and Healthy Lifestyle Research Center, Shiraz University of Medical Sciences
  • Peyman Jafari

    Department of Biostatistics, School of Medicine, Shiraz University of Medical Sciences
  • Nooreen Noordin

    Faculty of Educational Studies, Universiti Putra Malaysia
  • Sayyidatul Fadlilah

    Department of English Language Education, Universitas Islam Negeri Walisongo Semarang

DOI:

https://doi.org/10.59400/fls.v5i3.1701

Abstract

This research examines students' beliefs about language learning by evaluating the measurement equivalence of the beliefs about Language Learning Inventory (BALLI). The graded response model (GRM) was used to examine differential item functioning (DIF) in the BALLI across four different countries, namely: Iran, Malaysia, Indonesia, and Bangladesh. The sample was drawn from 1613, including 500 males and 1113 females who completed the online version of the BALLI, comprising five subscales of beliefs about foreign language aptitude, the difficulty of language learning, the nature of language learning, learning and communication strategies, and motivations and expectations. Most BALLI items showed non-uniform DIF. This finding implies that students in different countries had different perceptions of the BALLI items. Therefore, researchers should be very cautious about using the BALLI in different countries. This cross-cultural comparison may generate new insights into revising the BALLI items or developing another scale to compare students' beliefs about language learning in different countries.

Keywords:

BALLI, cross culture, differential item functioning, language belief, perceptions, university students

References

[1] Abdi H, Asadi B (2015). A synopsis of researches on teachers’ and students’ beliefs about language learning. International Journal on Studies in English Language and Literature 3(4): 104–114.

[2] Ajzen I (2005). Attitudes, personality, and behavior. Maidenhead: Open.

[3] Akter A, Islam A, Naznin N (2022). The beliefs of physiotherapy, occupational therapy, and speech and language therapy undergraduate students about learning English language. World Journal of Advanced Research and Reviews 13(1): 576–582. doi: 10.30574/wjarr.2022.13.1.0060

[4] Al Bataineh KB (2019). English language learning beliefs of Jordanian students: The effect of gender. International Journal of English Linguistics 9(2): 219–228. doi: 10.5539/ijel.v9n2p219

[5] Alhamami M (2019). Learners’ beliefs about language-learning abilities in face-to-face & online settings. International Journal of Educational Technology in Higher Education 16(31): 1–23. doi: 10.1186/s41239-019-0162-1

[6] Al-malki EA, Javid CZ (2018). Identification of language learning beliefs among Saudi EFL learners. Arab World English Journal 9(4): 186–199. doi: 10.24093/awej/vol9no4.13

[7] Altan MX (2006). Beliefs about language learning of foreign language-major university students. Australian Journal of Teacher Education 31(2): 44–45. doi: 10.14221/ ajte. 2006v31n2.5

[8] Altan MZ (2012). Pre-service EFL teachers’ beliefs about foreign language learning. European Journal of Teacher Education 35(4): 481–493. doi: 10.1080/02619768.2011. 643399

[9] Amrullah A, Vianty M, Fiftinova F (2018). Language learning beliefs of Indonesian English education study program students. The Journal of English Literacy Education: The Teaching and Learning of English as a Foreign Language 5(1): 62–70.

[10] Ariogul S Unal DC, Onursal I (2009). Foreign language learners’ beliefs about language learning: A study on Turkish university students. Procedia Social and Behavior Sciences 1(1): 1500–1506. doi: 10.1016/j.sbspro.2009.01.265

[11] Arslan G, Kafes H (2021). Turkish prep school EFL students’ beliefs about language learning. International Online Journal of Education and Teaching 8(2): 1312–1330.

[12] Asbjornson B (2000). Do beliefs matter in language learning achievement? A pilot study. Retrieved on https://www.tuj.ac.jp/grad-ed/publications/working-papers/vol-14/asbjornson (accessed on 10 April 2023).

[13] Balan S (2021). English as the language of research: But are we missing the mark? Exploratory Research in Clinical and Social Pharmacy 2(3): 100043. doi: 10.1016/j.rcsop.2021.100043

[14] Bernat E (2006). Assessing EAP learners’ beliefs about language learning in the Australian context. Online Asian-EFL 8(2): 1–19.

[15] Carter BA (1999). Begin with beliefs: exploring the relationship between beliefs and learner autonomy among advanced students. Texas Papers in Foreign Language Education 4(1): 1–20.

[16] Cui Y (2014). Beliefs about Language Learning: A Study of Post-secondary Non-Native Learners of Chinese and Teachers of Chinese in North America [PhD thesis]. University of Victoria.

[17] Daif-Allah AS. (2012). Beliefs about Foreign Language Learning and Their Relationship to Gender. English Language Teaching 5(10): 20–33. doi: 10.5539/elt.v5n10p20

[18] Dörnyei Z (2005). The Psychology of the Language Learner: Individual Differences in Second Language Acquisition. Routledge.

[19] Ehrlich S (1997). Gender as social practice. Implications for second language acquisition. Studies in Second Language Acquisition 19(4): 421–446. doi: 10.1017/s0272263197004014

[20] Ehrman M and Oxford RL (1989). Effects of sex differences, career choice, and psychological type on adult language learning strategies. The Modern Language Journal 73(1): 1–13. doi: 10.1111/j.1540-4781.1989.tb05302.x

[21] Gürsoy E, Eken E (2018). Identifying children’s language learning strategies: Turkish example. Porta Linguarum, 30: 43–56. doi: 10.30827/Digibug.54037

[22] Harrington S, Hertel T (2000). Foreign language methods students’ beliefs about language learning and teaching. Texas Papers in Foreign Language Education 5: 53–68.

[23] Horwitz E (2007). Becoming a Language Teacher: A Practical Guide to Second Language Learning and Teaching. Pearson.

[24] Horwitz EK (1987). Surveying student beliefs about language learning. In: Wenden A, Rubin J (editors). Learner Strategies in Language Learning. Prentice-Hall International. pp. 119–129.

[25] Horwitz EK (1988). The beliefs about language learning of beginning university foreign language students. The Modern Language Journal 72(3): 283–294. doi: 10.1111/j.1540-4781.1988.tb04190.x

[26] Horwitz EK (1999). Cultural and situational influences on foreign language learners’ beliefs about language learning: A review of BALLI studies. System 27(4): 557–576. doi: 10.1016/s0346-251x(99)00050-0

[27] Indra R, Kustati M, Saregar A, Warnis W, et al. (2020). The effect of principals’ leadership towards effective learning at an Indonesian secondary school. European Journal of Educational Research 9(3): 1063–1074. doi: 10.12973/eu-jer.9.3.1063

[28] Jee MJ (2016). Beliefs about language learning: A study of American University students learning Korean. Language Research 49(2): 399–418.

[29] Kashefian-Naeeini S, Sheikhnezami-Naeini Z (2020). Communication skills among school masters of different gender in Shiraz, Iran. International Journal of Advanced Science and Technology 29(2): 1607–1611.

[30] Kim-Yoon H (2000). Learner beliefs about language learning, motivation and their relationship: A study of EFL learners in Korea. Dissertation Abstracts International 61(8): 3041.

[31] Kormos J, Csizér K, Menyhárt A, Török D (2008). “Great expectations”: The motivational profile of Hungarian English majors. Arts & Humanities in Higher Education 7(1): 65–82. doi: 10.1177/1474022207084884

[32] Kustati M, Yusuf YQ, Hallen, Al-Azmi H, Sermal (2020). EFL Teachers’ attitudes towards language learners: A case of multicultural classrooms. International Journal of Instruction 13(1): 353–370. doi: 10.29333/iji.2020.13124a

[33] Mantle-Bromley C. (1995). Positive attitudes and realistic beliefs: Links to proficiency. The Modern Language Journal 79(3): 372–386. doi: 10.1111/j.1540-4781.1995.tb01114.x

[34] Nikitina L, Furuoka F (2006). Re-examining Horwitz’s Beliefs About Language Learning Inventory (BALLI) in the Malaysian context. Electronic Journal of Foreign Language Teaching 3(2): 209–219.

[35] Nourinezhad S, Kashefian-Naeeini S (2020). Iranian EFL university learners and lecturers’ attitude towards translation as a tool in reading comprehension considering background variables of age, major and years of experience. Cogent Education 7(1): 1–23. doi: 10.1080/2331186x.2020.1746104

[36] Oh MJ (1996). Beliefs about language learning and foreign language anxiety: A study of American university students learning Japanese [PhD thesis]. The University of Texas.

[37] Oxford RL (1996). Language Learning Strategies Around the World: Cross-Cultural Perspectives. National Foreign Language Resource Center.

[38] Oxford RL, Burry-Stock JA (1995). Assessing the use of language learning strategies worldwide with the ESL/EFL version of the strategy inventory of language learning (SILL). System 23(1): 1–23. doi: 10.1016/0346-251x(94)00047-a

[39] Oxford RL, Nyikos M (1989). Variables affecting choice of language learning strategies by university students. The Modern Language Journal 73(3): 291–300. doi: 10.1111/j.1540-4781.1989.tb06367.x

[40] Park GP (1997). Language learning strategies and English proficiency in Korean University students. Foreign Language Annal 30(2): 211–221. doi: 10.1111/j.1944-9720.1997.tb02343.x

[41] Parks S, Raymond P (2004). Strategy use by nonnative-English-speaking students in an MBA program: Not business as usual. Modern Language Journal 88(3): 374–389. doi: 10.1111/j.0026-7902.2004.00235.x

[42] Politzer R, McGroarty M (1985). An exploratory study of learning behaviors and their relationship to gains in linguistic and communicative competence. TESOL Quarterly 19(1): 103–124. doi: 10.2307/3586774

[43] Puchta H (1999). Beyond materials, techniques, and linguistic analysis: The role of motivation, beliefs, and identity. In: Proceedings of the Plenary session at the 33rd International IATEFL Annual Conference; 28 March–1 April 1999; Edinburgh, Scotland.

[44] Ramirez AG (1986). Language learning strategies used by adolescents studying French in New York schools. Foreign Language Annals 19(2): 131–138. doi: 10.1111/j.1944-9720.1986.tb03108.x

[45] Ramos PR, Colchero EG, Calvo VB, Garcia FG (2022). Degraded beauty: Contextual art and landscape education through a project in secondary school. ARTSEDUCA (32): 107–120.

[46] Sadeghi K, Abdi H (2015). Comparison of EFL teachers and students’ beliefs about language learning. MEXTESOL Journal 39(1): 1–14.

[47] Santos JC, Veiga V (2022). Tertiary ecuadorian students’ beliefs about learning a foreign language: A descriptive study. Journal of English Language Teaching and Applied Linguistic 4(1): 22–29. doi: 10.32996/jeltal.2022.4.1.2

[48] Shahsavar Z, Jafari P (2018). Examining gender differences in students’ attitude toward blogs using measurement invariance. The International Journal of Diversity in Education 18(2): 13–25. doi: 10.18848/2327-0020/cgp/v18i01/13-25

[49] Shahsavar Z, Kourepaz H (2020). Postgraduate students’ difficulties in writing their theses literature review. Cogent Education 7(1): 1–11. doi: 10.1080/2331186x.2020.1784620

[50] Siebert LL (2003). Student and teacher beliefs about language learning. Foreign Language Annals 33(4): 394–420.

[51] Solikhah I, Budiharso T (2022). Linguistic landscape to improve quality of language learning and its relationship with blended learning, learning motivation and teacher competence. Eurasian Journal of Applied Linguistics 8(3): 55–69.

[52] Stevick EW (1980). Teaching languages: A Way and Ways. Newbury House Publishers, Inc.

[53] Thaba A, Baharuddin MR (2022). Influence of parental attention, self-concept, and independent learning on students’ learning achievement in the Indonesian language subjects. Eurasian Journal of Educational Research 97(97): 103–113.

[54] Tleubay ST, Zhauynshiyeva ZB, Yessimkulova SS, et al. (2023). The emotional intelligence development of future English language teachers. International Journal of Innovative Research and Scientific Studies 6(3): 667–681. doi: 10.53894/ijirss.v6i3.1742

[55] Vibulphol J (2004). Beliefs about language learning and teaching approaches of pre-service EFL teachers in Thailand [Bachelor’s thesis]. Oklahoma State University.

[56] Wahsheh NA (2023). Language skills level among students with mental disabilities at Ajloun Governorate. Nurture 17(3): 368–377. doi: 10.55951/nurture.v17i3.354

[57] Yang ND (1999). The relationship between EFL learners’ beliefs and learning strategy use. System 27: 515–535.

Downloads

Issue

Vol. 5 , Iss. 3 (December 2023)

Article Type

Article

License

Copyright © 2023 Zahra Shahsavar, Reza Kafipour, Sara Kashefian-Naeeini, Peyman Jafari, Nooreen Noordin, Sayyidatul Fadlilah

Creative Commons License

This is an open access article under the Creative Commons Attribution 4.0 International License.