Influence of Language On the Interpretation of Satisfaction Surveys in Professional Training: A Systematic Review and Linguistic Perspective

Authors

  • Jessica Uribe Navarrete

    University of Salamanca, Salamanca, Spain

    University Institute of Educational Sciences (IUCE), Salamanca, Spain

DOI:

https://doi.org/10.30564/fls.v7i4.8818
Received: 21 February 2025 | Revised: 21 March 2025 | Accepted: 24 March 2025 | Published Online: 26 March 2025

Abstract

This systematic review examines how linguistic structures influence the interpretation of satisfaction surveys within professional training contexts. Guided by Critical Discourse Analysis (CDA) and the Theory of Discourse Evaluation (TDE), this study analyzes 39 empirical articles published between 2018 and 2024 in Scopus-indexed journals. Following PRISMA 2020 guidelines, studies were systematically identified, screened, and synthesized, while the GRADE methodology was applied to assess evidence quality. The findings reveal that linguistic elements, such as ambiguous wording, implicit evaluative terms, and culturally biased phrasing, significantly impact the validity of survey responses. The reviewed literature shows a dominance of quantitative methodologies, with limited integration of mixed-methods and discourse analysis. Three major gaps were identified: the absence of comparative studies on survey models, the lack of research addressing emotional and motivational factors in satisfaction assessment, and the narrow contextual focus on academic and corporate settings. The study emphasizes the necessity of incorporating CDA and TDE frameworks in survey design to mitigate discursive biases and enhance instrument validity. It also calls for linguistic validation practices and the inclusion of socio-emotional dimensions in satisfaction measurement. The review contributes to applied linguistics and training evaluation by providing practical recommendations for survey designers to ensure culturally sensitive, reliable, and methodologically robust instruments. Ultimately, this research underscores that language is a key determinant of data quality in training evaluations and not merely a technical aspect of survey construction.

Keywords:

Language in Surveys; Satisfaction in Training; Training Evaluation; PRISMA Methodology; GRADE Analysis

References

[1] Romero-Saldaña, M., Sánchez-Thevenet, P., Almodóvar-Fernández, I., et al., 2024. Development and validation of a new satisfaction scale for objective structured clinical assessments (S-OSCA): A multicenter cross-sectional study. Nurse Education Today. 141, 106308. DOI: https://doi.org/10.1016/j.nedt.2024.106308

[2] Guerrero Fernández, A., Rodríguez Marín, F., Solís Ramírez, E., et al., 2022. Validación de un cuestionario sobre Alfabetización Ambiental mediante juicio de expertos. Revista Eureka sobre Enseñanza y Divulgación de las Ciencias. 19(3), 3101. DOI: https://doi.org/10.25267/Rev_Eureka_ensen_divulg_cienc.2022.v19.i3.3101

[3] Rivas-Valenzuela, J., Álvarez, J.J., Sandoval-Obando, E., 2025). Emotional intelligence in primary and secondary physical education: A systematic review. Retos: New Trends in Physical Education, Sport and Recreation, 62, 850–861. DOI: https://doi.org/10.47197/retos.v62.123456

[4] Yang, X., Zheng, D., Wan, P., et al., 2023. Standard ophthalmology residency training in China: An evaluation of resident satisfaction on training program in Guangdong Province. BMC Medical Education. 23(550), 2–9. DOI: https://doi.org/10.1186/s12909-023-04527-3

[5] Higgins J.P.T, Thomas J, Chandler J, et al., 2024. Cochrane Handbook for Systematic Reviews of Interventions version 6.5 (updated August 2024). Cochrane Collaboration and John Wiley & Sons Ltd.: London, UK.

[6] Agrawal, S., Oza, P., Kakkar, R., et al., 2024. Analysis and recommendation system-based on PRISMA checklist to write systematic review. Assessing Writing. 61, 100866. DOI: https://doi.org/10.1016/j.asw.2024.100866

[7] Aguilera-Eguía, R.A., Roco Videla, Á., Fuentes-Barría, H., et al., 2024. Is it possible to enhance literature reviews through artificial intelligence? Angiología, 76(3), 123–125. DOI: https://doi.org/10.20960/angiologia.00602

[8] Thompson, G., 2014. Introducing functional grammar (3rd ed.). Routledge: London, UK.

[9] Guyatt, G.H., Oxman, A.D., Vist, G.E., et al., 2008. GRADE: An emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 336(7650), 924–926. DOI: https://doi.org/10.1136/bmj.39489.470347.AD

[10] De Wit, M., Zipfel, N., Horreh, B., et al., 2022. Training on involving cognitions and perceptions in the occupational health management and work disability assessment of workers: Development and evaluation. BMC Medical Education. 22(1), 20. DOI: https://doi.org/10.1186/s12909-021-03084-x

[11] Gordon, G., Oxman, A.D., Vist, G., et al., 2008. GRADE: An emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 336, 924–926. DOI: https://doi.org/10.1136/bmj.39489.470347.AD

[12] Ouzzani, M., Hammady, H., Fedorowicz, Z., et al., 2016. Rayyan—a web and mobile app for systematic reviews. Systematic Reviews. 5(1), 210. DOI: https://doi.org/10.1186/s13643-016-0384-4

[13] Kaliszewski, K., Makles, S., Frątczak, A., et al., 2024. Patient perceptions of medical students' involvement in clinical classes: A cross-sectional survey. Patient Preference and Adherence, 18, 301–313. DOI: https://doi.org/10.2147/PPA.S444797

[14] Astudillo-Araya, A., Montoya-Cáceres, P., León-Pino, J. M., 2023. Satisfaction with high-fidelity clinical simulation before and after clinical practice in nursing students. Index de Enfermería. 32(2), e14358. DOI: https://doi.org/10.58807/indexenferm20235797

[15] Elahifar, R., Parvizi, M.M., Fatemian, H., et al., 2024. The validity and reliability properties of a Persian version of the evidence-based practice profile (EBP2) questionnaire among Iranian students of health-related fields. BMC Medical Education. 24(1143), pp 2–11. DOI: https://doi.org/10.1186/s12909-024-06139-x

[16] Zulaiha, D., Triana, Y., 2023. Students' perception toward the use of open educational resources to improve writing skills. Studies in English Language and Education. 10(1), 174–196. DOI: https://doi.org/10.24815/siele.v10i1.25797

[17] Han, C., 2015. How to do critical discourse analysis: A multimodal introduction. Australian Journal of Linguistics. (35), 415–418. DOI: https://doi.org/10.1080/07268602.2015.1033673

[18] Lillis, T., 2007. Review of the book Discourse: A Critical Introduction by Jan Blommaert. International Journal of Applied Linguistics. 17(1), 146–152. DOI: https://doi.org/10.1111/j.1473-4192.2007.00141.x

[19] Martin, J.R., White, P.R.R., 2007. The language of evaluation: Appraisal in English (1st ed.). Palgrave Macmillan. DOI: https://doi.org/10.1057/9780230511910.

[20] Hunston, S., Thompson, G. (Eds.)., 2000. Evaluation in text: Authorial stance and the construction of discourse: Authorial stance and the construction of discourse. Oxford University Press: Oxford, UK. DOI: https://doi.org/10.1093/oso/9780198238546.001.0001

[21] Bednarek, M., 2006. Evaluation in media discourse: Analysis of a newspaper corpus.

[22] Continuum International Publishing Group: London, UK.

[23] de Lima Lopes, R.E., Vian Jr, O., 2007. The language of evaluation: appraisal in English. DELTA: Documentação e Estudos em Linguística Teórica e Aplicada. 23(2), 371–381.

[24] Lillis, T., 2007. Review of Discourse: A critical introduction by Jan Blommaert. International Journal of Applied Linguistics. 17(1), 146–152. DOI: https://doi.org/10.1111/j.1473-4192.2007.00141.x

[25] Liu, M., 2013. Representational pattern of discursive hegemony. Open Journal of Modern Linguistics. 3(2), 135–140. https://doi.org/10.4236/ojml.2013.32018

[26] Van Dijk, T.A., 2015. Critical Discourse Analysis. In D. Tannen, H. E. Hamilton, & D. Schiffrin (Eds.), The Handbook of Discourse Analysis (2nd ed.) . John Wiley & Sons, Inc.: Hoboken, NJ, USA. pp. 466–485. DOI: https://doi.org/10.1002/9781118584194.ch22

[27] Alsuliman, T., Alasadi, L., Mouki, A., 2019. Language of written medical educational materials for non-English speaking populations: An evaluation of a simplified bi-lingual approach. BMC Medical Education. 19(418), 2–9. https://doi.org/10.1186/s12909-019-1846-x

[28] Zulaiha, D., Triana, Y., 2023. Students' perception toward the use of open educational resources to improve writing skills. Studies in English Language and Education. 10(1), 174–196. DOI: https://doi.org/10.24815/siele.v10i1.25797

[29] Babenko, O., Mosewich, A., Sloychuk, J., 2020. Students' perceptions of learning environment and their leisure-time exercise in medical school: Does sport background matter? Perspectives on Medical Education. 9(2), 92–97. DOI: https://doi.org/10.1007/s40037-020-00560-w

[30] Yang, T., Wooster, J., 2022. Evaluation of pharmacy students' knowledge and perceptions of transitions of care services. Pharmacy Education. 22(1), 10–15. DOI: https://doi.org/10.46542/pe.2022.221.1015

[31] Borakati, A., 2021. Evaluation of an international medical e-learning course with natural language processing and machine learning. BMC Medical Education. 21(181). DOI: https://doi.org/10.1186/s12909-021-02609-8

[32] Bouzaiane, B., Dayananda, C.S., 2023. Effectiveness of WhatsApp as a pedagogical tool in learning phrasal verbs: A case study at a higher educational institute in Oman. Journal of Language Teaching and Research. 14(3), 552–559. DOI: https://doi.org/10.17507/jltr.1403.02

[33] Moher, D., Liberati, A., Tetzlaff, J., et al., 2009. Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. Open Medicine. 3(2), e123–e130.

[34] Rayyan. (n.d.), 2024. Rayyan—Intelligent systematic review. Rayyan Systems Inc.: Cambridge, MA, USA.

[35] Enyoojo, S.F., Ijah, C.E., Etukudo, E.M., et al., 2024. Satisfaction and learning experience of students using online learning platforms for medical education. BMC Medical Education. 24(1), 1398. DOI: https://doi.org/10.1186/s12909-024-06411-0

[36] Alonso-Coello, P., Schünemann, H.J., 2008. GRADE: An emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 336(7650), 924–926. DOI: DOI: https://doi.org/10.1136/bmj.39489.470347.AD

[37] Fairclough, N., 2010. Critical discourse analysis: The critical study of language (2nd ed.). Routledge: London, UK. DOI: DOI: https://doi.org/10.4324/9781315834368

[38] Garg, M., 2021. A survey on different dimensions for graphical keyword extraction techniques. Artificial Intelligence Review. 54, 4731–4770. DOI: https://doi.org/10.1007/s10462-021-10010-6

[39] Ge, Y., Takeda, Y., Liang, P., et al., 2022. Improving the communication skills of medical students: A survey of simulated patient-based learning in Chinese medical universities. BMC Medical Education. 22(1), 539.

[40] Sharma, S.R., Karjodkar, F.R., Sansare, K.P., et al., 2021. Awareness towards forensic dentistry: A questionnaire-based cross-sectional study. Journal of Indian Academy of Oral Medicine and Radiology. 33(4), 385–390. DOI: https://doi.org/10.4103/jiaomr.jiaomr_211_21

[41] Güzel, O., Vizuete-Luciano, E., Merigó-Lindahl, J.M., 2025. A systematic literature review of the Pay-What-You-Want pricing under PRISMA protocol. European Research on Management and Business Economics. 31(1), 100266.

[42] Sharma, S., Singh, A., Rathod, V., et al., 2021. Awareness towards forensic dentistry: A questionnaire-based cross-sectional study. Journal of Indian Academy of Oral Medicine and Radiology. 33(4), 385–390. DOI: https://doi.org/10.4103/jiaomr.jiaomr_211_21

[43] Kasai, H., Asahina, M., Tajima, H., et al., 2024. Effectiveness of a report writing training program using peer review: Evidence from first-year medical students. BMC Medical Education. 24(1132). DOI: https://doi.org/10.1186/s12909-024-06041-6

[44] Khorammakan, R., Roudbari, S.H., Omid, A., et al., 2024. Continuous training based on the needs of operating room nurses using web application: A new approach to improve their knowledge. BMC Medical Education. 24(342), pp 2–17. DOI: https://doi.org/10.1186/s12909-024-05315-3

[45] Han, C., 2015. How to do critical discourse analysis: A multimodal introduction. Australian Journal of Linguistics. 35(2), 1–4. DOI: https://doi.org/10.1080/07268602.2015.1033673

[46] Loda, T., Erschens, R., Nikendei, C., et al., 2020. A novel instrument of cognitive and social congruence within peer-assisted learning in medical training: Construction of a questionnaire by factor analyses. BMC Medical Education. 20(214), 2–8. DOI: https://doi.org/10.1186/s12909-020-02129-x

[47] Nguyen, K.T., Dao, M.L., Nguyen, K.N. et al. Perception of learners on the effectiveness and suitability of MyDispense: a virtual pharmacy simulation and its integration in the clinical pharmacy module in Viet Nam. BMC Medical Education. 23, 790 (2023). DOI: https://doi.org/10.1186/s12909-023-04773-5

[48] Ngo, T.T.A., Tran, T.T., An, G.K., et al., 2023. Students' perception towards learning massive open online courses on Coursera platform: Benefits and barriers. International Journal of Emerging Technologies in Learning (iJET). 18(14), 4–23. DOI: https://doi.org/10.3991/ijet.v18i14.39903

[49] Ogbe, M., 2023. Natural language processing of spatially crowdsourced data in petroleum revenue management. GeoJournal. 88(Suppl 1), 321–341. DOI: https://doi.org/10.1007/s10708-022-10775-5

[50] Ngo, T.T.A., 2023. The perception by university students of the use of ChatGPT in education. International Journal of Emerging Technologies in Learning (iJET). 18(17), 4–19. DOI: https://doi.org/10.3991/ijet.v18i17.39019

[51] Shohani, M., Bastami, M., Gheshlaghi, L.A., et al., 2023. Nursing student's satisfaction with two methods of CBL and lecture-based learning. BMC Medical Education. 23, 48. DOI: https://doi.org/10.1186/s12909-023-04028-3

[52] Ayenew, T., Tadesse, A.F., Fikru, T. et al. Satisfaction of medical and health science students with their clinical learning environment and its determinant factors at Debre Markos University, northwest Ethiopia. BMC Medical Education. 24, 1113 (2024). DOI: https://doi.org/10.1186/s12909-024-06114-6

[53] Astudillo-Araya, Angela, Montoya-Cáceres, et al., 2023. Satisfacción con la simulación clínica de alta fidelidad previo y posterior a prácticas clínicas en estudiantes de enfermería. Index de Enfermería. 32(2), e14358. DOI: https://dx.doi.org/10.58807/indexenferm20235797

[54] Avakyan, E.I., Taylor, D.C.M., 2024. The effect of flipped learning on students' basic psychological needs and its association with self-esteem. BMC Medical Education. 24(1127). DOI: https://doi.org/10.1186/s12909-024-06113-7

[55] Kasai, H., Asahina, M., Tajima, H. et al. Effectiveness of a report writing training program using peer review: evidence from first- year medical students. BMC Medical Education. 24, 1132 (2024). DOI: https://doi.org/10.1186/s12909-024-06041-6

[56] Rajeh, M.T., Abduljabbar, F.H., Alqahtani, S.M., et al., 2021. Students' satisfaction and continued intention toward e-learning: A theory-based study. Medical Education Online. 26(1), 1961348. DOI: https://doi.org/10.1080/10872981.2021.1961348

[57] Garg, M., 2021. A survey on different dimensions for graphical keyword extraction techniques. Artificial Intelligence Review. 54, 4731–4770. DOI: https://doi.org/10.1007/s10462-021-10010-6

[58] Park, S.Y., Kim, J.-H., 2022. Instructional design and educational satisfaction for virtual environment simulation in undergraduate nursing education: the mediating effect of learning immersion. BMC Medical Education. 22, 673. DOI: https://doi.org/10.1186/s12909-022-03728-6

[59] Li, W., Liu, C., Liu, S. et al. Perceptions of education quality and influence of language barrier: graduation survey of international medical students at four universities in China. BMC Medical Education. 20, 410 (2020), 2–13. DOI: https://doi.org/10.1186/s12909-020-02340-w

[60] Matthews, J.J., Olszewski, A., Petereit, J., 2020. Knowledge, Training, and Attitudes of Students and Speech-Language Pathologists About Providing Communication Services to Individuals Who Are Transgender. American journal of speech-language pathology. 29(2), 597–610. DOI: https://doi.org/10.1044/2020_AJSLP-19-00148

[61] Ge, Y., Takeda, Y., Liang, P. et al., 2022. Improving the communication skills of medical students ——A survey of simulated patient-based learning in Chinese medical universities. BMC Medical Education. 22, 539 . DOI: https://doi.org/10.1186/s12909-022-03596-0

[62] Lee, Y., Kim, K.J., 2018. Enhancement of student perceptions of learner-centeredness and community of inquiry in flipped classrooms. BMC Medical Education. 18, 242. DOI: https://doi.org/10.1186/s12909-018-1347-3

[63] Nikolaeva, S., Synekop, O., 2020. Social aspect of student's language learning style in differentiated ESP instruction. Universal Journal of Educational Research. 8(9), 4224–4233. DOI: https://doi.org/10.13189/ujer.2020.080949

[64] Urquhart, C., Brettle, A., 2022. Validation of a generic impact survey for use by health library services indicates the reliability of the questionnaire. Health Information & Libraries Journal. 39(4), 323–335. DOI: https://doi.org/10.1111/hir.12427

[65] Guerrero Fernández, A., Rodríguez Marín, F., Solís Ramírez, E., et al., 2022. Validación de un cuestionario sobre Alfabetización Ambiental mediante juicio de expertos. Revista Eureka sobre Enseñanza y Divulgación de las Ciencias. 19(3), 3101. DOI: https://doi.org/10.25267/Rev_Eureka_ensen_divulg_cienc.2022.v19.i3.3101

[66] Martín Martínez, L., Vela Llauradó, E., 2020. Questionnaire on the training profile of a learning therapy specialist: Creation and validation of the instrument. Sustainability. 12(21), 9159. DOI: https://doi.org/10.3390/su12219159

[67] Cabbar, F., Burdurlu, M.Ç., Ozcakir Tomruk, C., et al., 2019. Students' perspectives on undergraduate oral surgery education. BMC Medical Education. 19(1), 265. DOI: https://doi.org/10.1186/s12909-019-1703-y

[68] Gulzar, R., Sharma, S., Mahalakshmi., 2020. A questionnaire-based evaluation of the awareness among dental practitioners on minimally invasive approach for superficial enamel stains. Indian Journal of Forensic Medicine & Toxicology, 14(4), 5879–5887. DOI: https://doi.org/10.37506/ijfmt.v14i4.12526

Downloads

How to Cite

Navarrete, J. U. (2025). Influence of Language On the Interpretation of Satisfaction Surveys in Professional Training: A Systematic Review and Linguistic Perspective. Forum for Linguistic Studies, 7(4), 128–141. https://doi.org/10.30564/fls.v7i4.8818