Developing and Validating EFL Learners’ Perception of Machine Translation Questionnaire

Document Type : research article

Author

faculty member

Abstract

With huge improvements in the quality of Machine Translation (MT) in recent years, more interest has also been directed to its application in language learning; however, there is no standard questionnaire to assess English as a Foreign Language (EFL) learners’ perception of this technology. Therefore, this paper reports an attempt to describe the processes undertaken to validate a questionnaire developed for the first time to measure EFL students’ perception of Machine Translation. The validation processes employed were face and content validity, factor analysis informed construct validity, reliability via internal consistency using test-retest reliability as well as Cronbach’s Alpha correlation efficient. The exploratory factor analysis yielded four factors, namely, prior familiarity, degree of use, fear of detection and the importance of training among such students. The items on the questionnaire yielded factor loading ≥0.5. Reliability checking indicated that Machine Translation questionnaire was reliable. Cronbach’s Alpha obtained was 0.94 for the whole questionnaire and between 0.80-0.91 for the four subscales. Test-retest statistic examination displayed stability of the responses at two time points eight weeks apart. The final questionnaire consisted of 29 items and the psychometric analysis indicated that it was both reliable and valid. Therefore, this questioanaire can be used to gain more understanding of Machine Translation.

Keywords


Adel, S., Egtesadi, A., Sadeghi, F. (2019). Construction and Validation of a Critical Pedagogy Questionnaire to Assess ELT Teachers: A Mixed-Method Study. Issues in Language Teaching, 8(1), 333-375. doi: 10.22054/ilt.2020.46289.421
Anderson, D. (1995). Machine Translation as a Tool in Second Language Learning. CALICO, 13(1), 68-97. doi:http://www.jstor.org/stable/24147744
Ashrafi Asgarabad A, Khanjani N, Samareh Fekri M, GhotbiRavandi M R. Designing and Validating The Persian Version of a Questionnaire for Estimating Exposure to Occupational Dust among Stone Carving and Stone Cutting Workers. Health Develop J. 2015; 4 (4): 277-286. URL: http://jhad.kmu.ac.ir/article-1-120-fa.html
Beanland, C., Scheneideer, Z., Lobiondo-Wood, G., & Haber, J. (1999). Nursing Research: methods, critical appraisal and utilisation. Sydney: Mosby.
Cetiner, C., & Isiag, K. (2019). Undergraduate Level Translation Students’ Attitudes towards Machine Translation Post-Editing Training. International Journal of Languages’ Education and Teaching, 7(1), 110-120. doi:22.01.2019 20.02.2019 25.03.2019 10.18298/ijlet.3242
Dordi-nezhad F. (2015) Construction, Validation and Reliability of the Foreign Language Attitude and Motivation Questionnaire. IQBQ.; 6 (2): 107-128. URL: http://lrr.modares.ac.ir/article-14-10922-fa.html
Holt, A., Overgaard, D., & Engel, L. (2020). Health literacy, digital literacy and eHealth literacy in Danish nursing students at entry and graduate level: a cross sectional study. BMC Nurse, 19(22). doi:https://doi.org/10.1186/s12912-020-00418-w
Jimenez-Crespo, M. (2018). The role of translation technologies in Spanish language learning, Journal of Spanish Language Teaching. Jounral of Spanish Language Teaching, 1-13. doi:10.1080/23247797.2017.1408949
Khaleghizadeh, S., Pahlavannezhad, M., Vakilifard, A., Kamyabi Gol, A. (2020). Validation of Persian Language Learning Motivation Questionnaireas a Second Language. Journal of Teaching Persian to Speakers of Other Languages, 9(20), 25-63. doi: 10.30479/jtpsol.2020.9935.1421
Khalili, N., Vaziri-Harami, R., Jahani, Y. (2017). Construction and Validation of the Narcissism and Vulnerable Narcissism Scale in a Non-clinical Sample in Iran. Journal of Clinical Research, 2(Issue (1-2)), 23-37. doi: 10.22122/ajcr.2017.48985
Khatib, M., Rahimi, A. (2015). Attitudes towards English Language Norms in the Expanding Circle: Development and Validation of a new Model and Questionnaire. Journal of Teaching Language Skills, 34(1), 51-81. doi: 10.22099/jtls.2015.3234
Kheiri Langroudi, S. A, Badsar A R, Hosseini Z, Rouhi M. Validation of the Persian version of the Dundee Ready Educational Environment Measure (DREEM). Rme. 2012; 4 (2) :24-33. URL: http://rme.gums.ac.ir/article-1-133-fa.html
Lee, S. (2019). The impact of using machine translation on EFL students’ writing. Computer Assisted Language Learning. doi:10.1080/09588221.2018.1553186
Mirhosseini, Seyyed-Abdolhamid, Badri, Narges Sadat (2020). Studying the Awareness of Iranian University Students about the International Policies for the Spread of English. Journal of Foreign Language Research, 10 (2), 300-315. DOI: 10.22059/jflr.2020.292031.699
Modaresifar M, Abolfathi Momtaz Y, Delbari A. Validity and Reliability of the Persian Version of Relationship of Grandchild- Grandparents. Salmand: Iranian Journal of Ageing. 2020; 15 (1): 53-42. URL: http://salmandj.uswr.ac.ir/article-1-1702-en.html
Modarresi, G., Shams Hosseini, H. (2015). Construction, Validation and Application of CALL Knowledge Scale for EFL Learners and its Relationship with their L2 Writing Skills. Foreign Language Research Journal, 5(2), 309-333. doi: 10.22059/jflr.2015.62552
Nasiripour, A., Golalizadeh, A., Komeili, A., Tabibi, S., Mahmoudi, M. (2019).Designing and Validating a Questionnaire for the Health Insurance Management of the People with Mental Disorders . Journal of Medical Council of Iran. 37 (2) :102-109. URL: http://jmciri.ir/article-1-2908-fa.html
Nino, A. (2004). Recycling MT: A course on foreign language writing via MT post-editing.
Nino, A. (2008). Evaluating the use of machine translation post-editing in the foreign language class. Computer Assisted Language Learning, 21(1), 29-49. doi:http://dx.doi.org/10.1080/09588220701865482
Rasafiani M, Sahaf R, Shams A, Vameghi R, Zareian H, Akrami R. Validity and Reliability of the Persian Version of the World Health Organization Quality of Life Questionnaire – the Older Adults Edition. Salmand: Iranian Journal of Ageing. 2020; 15 (1) :41-28. URL: http://salmandj.uswr.ac.ir/article-1-1622-en.html
Salehi, M., Homaee Shandiz, F., Najaf Najafi, M., Salehi, M. (2014). Development and Validation of a Questionnaire to Assess the Attitudes of Mastectomy Patients about Breast Reconstruction. The Iranian Journal of Obstetrics, Gynecology and Infertility, 16(90), 16-24. doi: 10.22038/ijogi.2014.2592