Examining the Quality of Machine Translation Subtitling for Saudi Series: Tash Ma Tash a Model

Authors

  • Renad Mubarak Alhubayshi

    Department of English Language and Translation, College of Science and Theoretical Studies, Saudi Electronic University, Riyadh 11673, Saudi Arabia

  • Soha Mohammed Fallata

    Department of English Language and Translation, College of Science and Theoretical Studies, Saudi Electronic University, Riyadh 11673, Saudi Arabia

  • Noha Abdullah Alowedi

    Department of English Language and Translation, College of Science and Theoretical Studies, Saudi Electronic University, Riyadh 11673, Saudi Arabia

DOI:

https://doi.org/10.30564/fls.v7i10.10617
Received: 21 June 2025 | Revised: 1 July 2025 | Accepted: 4 July 2025 | Published Online: 22 September 2025

Abstract

This study examines the quality of machine-translated subtitles for the Saudi comedy series Tash Ma Tash using YouTube-generated subtitles. The research focuses on assessing how well machine translation (MT) tools convey the meaning of the source text, with a particular emphasis on the challenges posed by idiomatic expressions, dialectal vocabulary, and humor in Arabic to English translation. A thematic analysis was conducted to examine the application of Pedersen's FAR model, focusing on its three main dimensions: Functional Equivalence (do the subtitles convey speaker meaning?); Acceptability (do the subtitles sound correct and natural in the target language?); and Readability (can the subtitles be read in a fluent and non-intrusive way?). Particular attention was paid to how machine translation (MT) systems handle culturally and linguistically complex content. The findings indicated that although machine translation is effective in translating straightforward terms, it frequently struggles to convey more profound cultural meanings and subtleties, resulting in considerable mistranslations. This research emphasizes the vital need to comprehend the cultural context during translation processes, as numerous idiomatic expressions and culturally specific references are often either lost or inaccurately represented in machine-generated subtitles. Additionally, the study highlights the importance of human involvement in the subtitling process to improve the accuracy and effectiveness of translations. The implications of this research go beyond the particular instance of Tash Ma Tash, suggesting that similar issues may occur in the translation of other culturally nuanced audiovisual materials and so this study contributes to the effectiveness of the machine translation.

Keywords:

Arabic Machine Translation; Saudi TV Series; Subtitling Process; YouTube Subtitles

References

[1] O’Hagan, M., 2023. The Routledge Handbook of Translation and Technology. Routledge: London, UK.

[2] Li, S., Chen, J., Yuan, S., et al., 2024. Translate Meanings, Not Just Words: IdiomKB’s Role in Optimizing Idiomatic Translation with Language Models. Proceedings of the AAAI Conference on Artificial Intelligence. 38(17), 18554–18563. DOI: https://doi.org/10.1609/aaai.v38i17.29664

[3] Ministry of Culture - Saudi Film Commission. Saudi Film Commission initiatives. Available from: https://film.moc.gov.sa/en/initiatives (cited 10 March 2025).

[4] Alharthi, D., Almehmadi, K., 2024. When Saudis Stop Being Humorous: The subtitling and reception of Saudi dark humour in Masameer County. Theory and Practice in Language Studies. 14(6), 1872–1882. DOI: https://doi.org/10.17507/tpls.1406.28

[5] Tian, L., 2023. Applying machine translation to Chinese–English subtitling: Constraints and challenges. Linguistica Antverpiensia New Series–Themes in Translation Studies. 22. DOI: https://doi.org/10.52034/lans-tts.v22i.752

[6] Hagström, H., Pedersen, J., 2022. Subtitles in the 2020s: The influence of machine translation. Journal of Audiovisual Translation. 5(1), 207–225. DOI: https://doi.org/10.47476/jat.v5i1.2022.195

[7] Bywood, L., Georgakopoulou, P., Etchegoyhen, T., 2017. Embracing the threat: machine translation as a solution for subtitling. Perspectives. 25(3), 492–508. DOI: https://doi.org/10.1080/0907676x.2017.1291695

[8] Alharbi, S., 2024. A study of the translation strategies used in subtitling humor in Almaktab Saudi series [PhD Thesis]. Jeddah, Saudi Arabia: Effat University.

[9] Jibreel, I., 2023. Online Machine translation efficiency in translating fixed expressions between English and Arabic (Proverbs as a Case-in-Point). Theory and Practice in Language Studies. 13(5), 1148–1158. DOI: https://doi.org/10.17507/tpls.1305.07

[10] Jia, H., Cheng, X., 2023. Research on the Subtitle Translation of Green Book from the Perspective of Register Theory. Lecture Notes on Language and Literature. 6(13), 7–19.

[11] Nikolic, K., Bywood, L., 2021. Audiovisual Translation: The Road Ahead. Journal of Audiovisual Translation. 4(1), 50–70. DOI: https://doi.org/10.47476/jat.v4i1.2021.156

[12] Karakanta, A., 2021. Machine Translation in Subtitling Workflows. Journal of Audiovisual Translation. 4(1), 45–60.

[13] Calvo-Ferrer, J.R., 2023. Can you tell the difference? A study of human vs machine-translated subtitles. Perspectives. 32(6), 1115–1132. DOI: https://doi.org/10.1080/0907676x.2023.2268149

[14] Llanos Martínez, H., 2021. Spanish translators protest the "mediocre" machine-made subtitles for 'Squid Game'. Available from: https://elpais.com/television/2021-10-14/los-traductores-espanoles-protestan-por-los-mediocres-subtitulos-de-el-juego-del-calamar-hechos-por-una-maquina.html (cited 10 March 2025) (in Spanish)

[15] Tuominen, T., Koponen, M., Vitikainen, K., et al., 2023. Exploring the gaps in linguistic accessibility of media: The potential of automated subtitling as a solution. The Journal of Specialised Translation. (39), 77–98.

[16] Zakraoui, J., Saleh, M., Al-Maadeed, S., et al., 2021. Arabic Machine Translation: A Survey with Challenges and Future Directions. IEEE Access. 9, 161445–161468. DOI: https://doi.org/10.1109/access.2021.3132488

[17] Habash, N., 2012. MT and Arabic Language Issues. Conference of the Association for Machine Translation in the Americas. Available from: https://www.aclweb.org/anthology/2012.amta-tutorials.3.pdf (cited 12 March 2025).

[18] Al Sawi, I.A., Allam, R., 2024. Exploring challenges in audiovisual translation: A comparative analysis of human- and AI-generated Arabic subtitles in Birdman. PLoS ONE. 19(10), e0311020. DOI: https://doi.org/10.1371/journal.pone.0311020

[19] Pöchhacker, F., 2021. The Changing Role of Subtitlers in the Age of Automation. Translation Studies. 14(3), 112–128.

[20] Díaz-Cintas, J., 2023. Fan Subtitling and Machine Translation: A Hybrid Future. Media and Communication. 11(2), 78–94.

[21] Lommel, A., Burchardt, A., 2021. Evaluating MT Quality in Subtitling: Beyond BLEU. Computational Linguistics. 47(4), 201–220.

[22] Pedersen, J., 2017. The FAR Model: Assessing Quality in Interlingual Subtitling. The Journal of Specialised Translation. 28, 210–229.

[23] Vermeer, H.J., 2021. Skopos and Commission in Translational Action. In: Chesterman, A. (ed.). Readings in Translation Theory. Oy Finn Lectura Ab: Helsinki, Finland.

[24] Venuti, L., 1995. The Translator’s Invisibility: A History of Translation. Routledge: London, UK.

[25] Schierl, F., 2023. Reception of machine-translated and human-translated subtitles–A case study. In Proceedings of Machine Translation Summit XIX, Vol. 2: Users Track; Macau SAR, China, 4–8 September 2023; pp. 42–53.

Downloads

How to Cite

Alhubayshi, R. M., Fallata, S. M., & Alowedi, N. A. (2025). Examining the Quality of Machine Translation Subtitling for Saudi Series: Tash Ma Tash a Model. Forum for Linguistic Studies, 7(10), 36–46. https://doi.org/10.30564/fls.v7i10.10617