Captioning for Clarity: Mastering Stress with Word-Based vs. Phonetic Video Transcriptions

Authors

  • Shaimaa Mohamed Mahmoud Helal

    Faculty of Language Studies, Arab Open University, Riaydh, Saudi Arabia
  • Hassan Saleh Mahdi

    Faculty of Language Studies, Arab Open University, Riaydh, Saudi Arabia
  • Mustafa Abdulmuhsen Thabet

    Faculty of Language Studies, Arab Open University, Riaydh, Saudi Arabia

DOI:

https://doi.org/10.30564/fls.v6i4.6779
Received: 20 June 2024 | Revised: 26 July 2024 | Accepted: 16 August 2024 | Published Online: 19 September 2024

Abstract

This study explores an understudied aspect of video captioning in language learning: the use of phonetic transcription. While extensive research has examined the effects of traditional word-based captioning, the potential benefits of phonetic transcription captions remain largely unexplored. To address this knowledge gap, a quasi-experimental study was conducted comparing two captioning conditions: traditional word-based captions and phonetic transcription captions. Two groups of English as a Foreign Language (EFL) learners were purposively selected based on their course enrollment, with participants volunteering for the study. The control group viewed videos with standard word captions, while the experimental group watched videos captioned with phonetic transcriptions. Pre- and post-tests were administered to assess improvements in word stress pronunciation. The results revealed no statistically significant difference between the post-test scores of the control and experimental groups. This suggests that both captioning methods - words and phonetic transcription - positively impact stress pronunciation learning. The findings indicate that enhanced stress pronunciation may contribute to overall language intelligibility and fluency, potentially leading to improved language learning outcomes. This study opens avenues for future research on the application of phonetic transcription in other areas of pronunciation, such as intonation and connected speech.

Keywords:

EFL learners; Pronunciation; Stress; Video captioning

References

Abbas, N., Ali Qassim, T., 2020. Investigating the effectiveness of YouTube as a learning tool among EFL students at Baghdad University. Arab World English Journal (AWEJ) Special Issue on CALL. (6).

Abdar, M., Kollati, M., Kuraparthi, S., et al. (2023). A review of deep learning for video captioning. arXiv preprint arXiv:2304.11431.

Alkhuli, M.A., 2002. A contrastive transformational grammar. Al Manhal.

Alwehaibi, H.O., 2015. The Impact of Using Youtube in EFL Classroom on Enhancing EFL Students’ Content Learning. Journal of College Teaching & Learning. 12(2), 121–126.

Alzi’abi, S.E., 2023. Arab learners’ stress perception and production of English multisyllable items. Journal of Experimental Phonetics. 32, 111–130.

Anani, M., 1989. Incorrect Stress Placement in the Case of Arab Learners of English. IRAL: International Review of Applied Linguistics in Language Teaching. 27(1), 15–22. DOI: https://doi.org/10.1515/iral.1989.27.1.15

Avello, D., Muñoz, C., 2023. The development of receptive language skills from captioned video viewing in primary school EFL learners. Education Sciences. 13(5), 479. DOI: https://doi.org/10.3390/educsci13050479

Aziz, Y.Y., 1980. Some Problems of English Word-Stress for the Iraqi Learner. English Language Teaching Journal. 34(2), 104–109. DOI: https://doi.org/10.1093/elt/34.2.104

Basalama, M.S., 1990. A study of certain aspects of suprasegmental of Arabic, and their influence on the pronunciation of Arab teachers from the Western Zone of Saudi Arabic [PhD thesis]. London: University of London.

Beeston, A.F.L., 2016. The Arabic language today. Routledge.

Betti, M.J., Ulaiwi, W.A., 2018. Stress in English and Arabic: A contrastive study. English Language and Literature Studies. 8(1), 83–91. DOI: https://doi.org/10.5539/ells.v8n1p83

Bird, S.A., Williams, J.N., 2002. The effect of bimodal input on implicit and explicit memory: An investigation into the benefits of within-language subtitling. Applied psycholinguistics. 23(4), 509–533. DOI: https://doi.org/10.1017/S0142716402004022

Boonmee, P., Jitngernmadan, P., Kubola, K., et al. (2022). Accuracy of Natural Language Processing Algorithms in Representing Stressed Words in Closed Captioning. In 2022 27th Asia Pacific Conference on Communications (APCC) (pp. 348–352). IEEE. DOI: https://doi.org/10.1109/APCC55198.2022.9943727

Borrás, I., Lafayette, R.C., 1994. Effects of multimedia courseware subtitling on the speaking performance of college students of French. The Modern Language Journal. 78(1), 61–75. DOI: https://doi.org/10.2307/329253

Cengiz, B.C., 2023. Computer-assisted pronunciation teaching: An analysis of empirical research. Participatory Educational Research. 10(3), 72–88. DOI: https://doi.org/10.17275/per.23.45.10.3

Chai, J., Erlam, R., 2008. The effect and the influence of the use of video and captions on second language learning. New Zealand Studies in Applied Linguistics. 14(2), 25–44.

Chen, C.M., Sun, Y.C., 2012. Assessing the effects of different multimedia materials on emotions and learning performance for visual and verbal style learners. Computers & Education. 59(4), 1273–1285. DOI: https://doi.org/10.1016/j.compedu.2012.05.006

Chun, D.M., Plass, J.L., 1997. Research on text comprehension in multimedia environments. Language Learning &Technology. 1(1), 60–81.

Chung, J.M., 1999. The effects of using video texts supported with advance organizers and captions on Chinese college students’ listening comprehension: An empirical study. Foreign Language Annals. 32(3), 295–308. DOI: https://doi.org/10.1111/j.1944-9720.1999.tb01342.x

Cutler, A., 2015. Lexical stress in English pronunciation. The handbook of English pronunciation. 106–124. DOI: https://doi.org/10.1002/9781118346952.ch6

Danan, M., 1992. Reversed subtitling and dual coding theory: New directions for foreign language instruction. Language learning. 42(4), 497–527. DOI: https://doi.org/10.1111/j.1467-1770.1992.tb01042.x

Danan, M., 2004. Captioning and subtitling: Undervalued language learning strategies. Meta. 49(1), 67–77. DOI: https://doi.org/10.7202/009021ar

Dao, P., Nguyen, M.X.N.C., Nguyen, N.B.C., 2021. Effect of pronunciation instruction on L2 learners’ listening comprehension. Journal of Second Language Pronunciation. 7(1), 10–37. DOI: https://doi.org/10.1075/jslp.19012.dao

Darcy, I., Rocca, B., 2022. Comprehensibility improvements in integrated pronunciation instruction: A comparison of instructional methods and task effects. Journal of Second Language Pronunciation. 8(3), 328–362. DOI: https://doi.org/10.1075/jslp.21035.dar

Davenport, M., Hannahs, S.J., 2020. Introducing phonetics and phonology (4th ed.). Routledge. DOI: https://doi.org/10.4324/9781351042789

Davey, R., Parkhill, F., 2012. Raising adolescent reading achievement: The use of sub-titled popular movies and high interest literacy activities. English in Aotearoa. (78), 61–71.

Duffy, P., 2008. Using Youtube: Strategies for using new media in teaching and learning. In Enhancing learning through technology: research on emerging technologies and pedagogies (pp. 31–43). DOI: https://doi.org/10.1142/9789812799456_0003

Garza, T.J., 1991. Evaluating the use of captioned video materials in advanced foreign language learning. Foreign language annals, 24(3), 239-258. DOI: https://doi.org/10.1111/j.1944-9720.1991.tb00469.x

Gernsbacher, M.A., 2015. Video captions benefit everyone. Policy insights from the behavioral and brain sciences. 2(1), 195–202. DOI: https://doi.org/10.1177/2372732215602130

Ghaith, S., 1993. The assignment of primary stress to words by some Arab speakers. System, 21(3), 381-390. DOI: https://doi.org/10.1016/0346-251X(93)90028-F

Ghosh, M., Levis, J.M., 2021. Vowel quality and direction of stress shift in a predictive model explaining the varying impact of misplaced word stress: Evidence from English. Frontiers in Communication. 6, 628780. DOI: https://doi.org/10.3389/fcomm.2021.628780

Giegerich, H.J., 1992. English phonology: An introduction. Cambridge: Cambridge University Press.

Helal, S., 2014. Stress in English: Prosodic and rhythmic complexity for Arab learners. Concordia Working Papers in Applied Linguistics. 5, 361–294.

Hogg, R.M., McCully, C.B., 1987. Metrical phonology: a course book. Cambridge University Press.

Hsieh, Y., 2020. Effects of video captioning on EFL vocabulary learning and listening comprehension. Computer Assisted Language Learning. 33(5–6), 567–589. DOI: https://doi.org/10.1080/09588221.2019.1577898

Hsu, C.K., Hwang, G.J., Chang, Y.T., et al., 2013. Effects of video caption modes on English listening comprehension and vocabulary acquisition using handheld devices. Journal of Educational Technology & Society. 16(1), 403–414.

Huwari, I.F., Mehawesh, M., 2015. Review of the importance of teaching pronunciation in the Arab society. International Journal on Studies in English Language and Literature (IJSELL). 3(6), 31–37.

Hwang, Y.L., 2003. The effect of the use of videos captioning on English as a foreign language (EFL) on college students’ language learning in Taiwan. The University of Mississippi.

IBM Corp. (2020). IBM SPSS Statistics for Windows (Version 29.0) [Computer software]. IBM Corp. https://www.ibm.com/analytics/spss-statistics-software

Jenkins, J., 2002. A sociolinguistically based, empirically researched pronunciation syllabus for English as an international language. Applied linguistics. 23(1), 83–103. DOI: https://doi.org/10.1093/applin/23.1.83

Kreidler, C.W., 2008. The pronunciation of English: A course book. John Wiley & Sons.

Ladefoged, P. Johnson, K., 2014. A Course in Phonetics. Belmont, CA: Cengage Learning.

Ladefoged, P., 2011. A course in phonetics (6th ed.). Cengage Learning.

Larudee, F., 1973. Word Stress in the Spoken Arabic of Cairo. Language Sciences. 26, 31–34.

Lo, S., 2024. Vocabulary learning through viewing dual-subtitled videos: Immediate repetition versus spaced repetition as an enhancement strategy. ReCALL. 1–16.

Mahdi, H.S., 2017. The use of keyword video captioning on vocabulary learning through mobile-assisted language learning. International journal of English linguistics. 7(4), 1–7. DOI: https://doi.org/10.5539/ijel.v7n4p1

Markham, P., 1999. Captioned videotapes and second‐language listening word recognition. Foreign Language Annals. 32(3), 321–328. DOI: https://doi.org/10.1111/j.1944-9720.1999.tb01344.x

Markham, P., 2001. The influence of culture-specific background knowledge and captions on second language comprehension. Journal of Educational Technology Systems. 29(4), 331–343. DOI: https://doi.org/10.2190/15TA-GX8P-74XP-YUA1

Markham, P.L., Peter, L.A., McCarthy, T.J., 2001. The effects of native language vs. target language captions on foreign language students’ DVD video comprehension. Foreign language annals. 34(5), 439–445. DOI: https://doi.org/10.1111/j.1944-9720.2001.tb02083.x

Markham, P., Peter, L., 2003. The influence of English language and Spanish language captions on foreign language listening/reading comprehension. Journal of Educational Technology Systems. 31(3), 331–341. DOI: https://doi.org/10.2190/BHUH-420B-FE23-ALA0

Maspufah, M., 2022. Utilizing YouTube video as media in teaching students’ word stress pronunciation. Pendekar: Jurnal Pendidikan Berkarakter. 5(4), 23–28.

Mayer, R.E., 2003. The promise of multimedia learning: using the same instructional design methods across different media. Learning and instruction. 13(2), 125–139. DOI: https://doi.org/10.1016/S0959-4752(02)00016-6

Mitchell, T.F., 1960. Prominence and Syllabication in Arabic1. Bulletin of the School of Oriental and African Studies. 23(2), 369–389. DOI: https://doi.org/10.1017/S0041977X00149997

Mitterer, H., McQueen, J.M., 2009. Foreign subtitles help but native-language subtitles harm foreign speech perception. PloS one. 4(11), e7785. DOI: https://doi.org/10.1371/journal.pone.0007785

Mohsen, M.A., Mahdi, H.S., 2021. Partial versus full captioning mode to improve L2 vocabulary acquisition in a mobile-assisted language learning setting: words pronunciation domain. Journal of Computing in Higher Education. 33(2), 524–543. DOI: https://doi.org/10.1007/s12528-021-09276-0

Morley, J., 1991. The pronunciation component in teaching English to speakers of other languages. TESOL quarterly. 25(3), 481–520. DOI: https://doi.org/10.2307/3586981

Nation, I.S.P., 2001. Learning vocabulary in another language (Vol. 10, pp. 126–132). Cambridge: Cambridge university press.

Paivio, A., 2014. Mind and its evolution: A dual coding theoretical approach. Psychology press.

Perez, M.M., 2022. Second or foreign language learning through watching audio-visual input and the role of on-screen text. Language Teaching. 55(2), 163–192. DOI: https://doi.org/10.1017/S0261444821000501

Perez, M.M., Peters, E., Desmet, P., 2014. Is less more? Effectiveness and perceived usefulness of keyword and full captioned video for L2 listening comprehension. ReCALL. 26(1), 21–43. DOI: https://doi.org/10.1017/S0958344013000256

Plass, J.L., Chun, D.M., Mayer, R.E., et al. (1998). Supporting visual and verbal learning preferences in a second-language multimedia learning environment. Journal of educational psychology. 90(1), 25.

Qiao, W., Yijun, C., 2023. The role of live transcripts in synchronous online L2 classrooms: Learning outcomes and learner perceptions. Education and Information Technologies. 28(11), 14783–14804. DOI: https://doi.org/10.1007/s10639-023-11784-8

Roach, P., 2009. English phonetics and phonology paperback with audio CDs (2): A practical course. Cambridge university press.

Sa’di, R.A., Sharadgah, T.A., Yaseen, M.S. (2022a). Stress Misassignment in the Pronunciation of English by Arabicspeaking Learners: Erratic Practice or Crosslinguistic Influence? International Journal of Arabic-English Studies (IJAES). 22(1). DOI: https://doi.org/10.33806/ijaes2000.22.1.5

Sa’di, R.A., Sharadgah, T.A., Yaseen, M.S. (2022b). An Investigation of Common Stress Placement Errors in English Word Roots and their Suffixed Derivatives by Arabic-Speaking EFL Learners. Arab World English Journal. 13(3). DOI: https://doi.org/10.24093/awej/vol13no3.4

Sharma, L.R., 2023. Dealing with the word and sentence stress in English language. International Journal of Multidisciplinary Comprehensive Research. 2(1), 31–37. DOI: https://doi.org/10.54660/ijmcr.2023.2.1.31-37

Sinyashina, E., Balteiro, I., 2023. Incidental Learning of Word Stress with Captioned Authentic Videos: The Effect of Repetition. RAEL: Revista Electrónica de Lingüística Aplicada. 21(1), 19–39. DOI: https://doi.org/10.58859/rael.v21i1.494

Steinfeld, A., 1998. The benefit of real-time captioning in a mainstream classroom as measured by working memory. Volta review. 100(1).

Syodorenko, T., 2010. Modality of input and vocabulary acquisition. Language Learning & Technology. 14, 50–73.

Teng, M.F., 2023. Incidental vocabulary learning from captioned videos: Learners’ prior vocabulary knowledge and working memory. Journal of Computer Assisted Learning. 39(2), 517–531. DOI: https://doi.org/10.1111/jcal.12756

Tohe, A., 2021. YouTube, Learning, and Transformative Critical Pedagogy. KnE Social Sciences. 15–29. DOI: https://doi.org/10.1017/S0272263120000029

Treiman, R., Kessler, B., 2023. Spelling-to-sound translation for English disyllables: Use of long and short vowels before single medial consonants. Journal of Experimental Psychology: Learning, Memory, and Cognition. 49(12), 2034–2047. DOI: https://doi.org/10.1037/xlm0001260

Vázquez, L.Q., 2022. Synchronous computer-mediated communication in pronunciation teaching: A survey study. Revista de Estilos de Aprendizaje. 15, 123–134. DOI: https://doi.org/10.55777/rea.v15iEspecial.4431

Watson, J.C.E., 2011. Word stress in Arabic. In M. Oostendorp, C. Ewen, E. Hume, et al. (eds.). The Blackwell companion to phonology (Vol. 5) (pp. 2990–3019). Wiley-Blackwell. DOI: https://doi.org/10.1002/9781444335262.wbctp0124

Winke, P., Gass, S., Sydorenko, T., 2010. The effects of captioning videos used for foreign language listening activities. Language Learning & Technology. 14, 65–86.

Wisniewska, N., Mora, J.C., 2017. Pronunciation learning trough captioned videos. Pronunciation in Second Language Learning and Teaching Proceedings. 9(1).

Wisniewska, N., Mora, J.C., 2020. Can captioned video benefit second language pronunciation? Studies in Second Language Acquisition. 42(3), 599–624. DOI: https://doi.org/10.1017/S0272263120000029

Yeldham, M., 2018. Viewing L2 captioned videos: what’s in it for the listener?. Computer Assisted Language Learning. 31(4), 367–389. DOI: https://doi.org/10.1080/09588221.2017.1406956

Downloads

How to Cite

Helal, S. M. M., Mahdi, H. S., & Thabet, M. A. (2024). Captioning for Clarity: Mastering Stress with Word-Based vs. Phonetic Video Transcriptions. Forum for Linguistic Studies, 6(4), 82–96. https://doi.org/10.30564/fls.v6i4.6779

Issue

Vol. 6 , Iss. 4 (October 2024)

Article Type

Article

License

Copyright © 2024 Shaimaa Mohamed Mahmoud Helal, Hassan Saleh Mahdi, Mustafa Abdulmuhsen Thabet

Creative Commons License

This is an open access article under the Creative Commons Attribution 4.0 International License.