Washback effects of Turkish Foreign Language Proficiency Exam YDS: A scale development study

Murat Polat

Abstract


Investigating the possible washback effects of Foreign Language Proficiency Exam called YDS which has been administered in Turkey since 2013, could provide valuable data on how testees feel about taking this exam. Test takers in Turkey mainly take this test to document their foreign language levels, however there are many concerns related to the content and the washback effects of this test on testees. In this study, it was aimed to design a scale and collect data regarding the possible washback effects of YDS. In the initial phase, with the help of volunteer participants, a 19-item-scale was developed having taken the feedback of 6 experts who were professionals in ELT, scale development and language assessment. Secondly, the scale was piloted in order to carry out exploratory and confirmatory factor analyses. Thirdly, the newly developed scale’s psychometric qualities (validity and reliability) were measured. After it was confirmed that the scale which had 4 factors and 13 items was a valid and reliable tool, the data including the views of Turkish academicians were gathered focusing on the washback effects of the YDS via this scale in the final phase. The overall data of this study were obtained from 84 state universities with the contribution of 2683 academicians from different disciplines. The findings revealed that YDS has negative backwash effects on Turkish academicians regarding certain sub-categories including test strategy, motivation, perception and psychological effects.

Full Text:

PDF

References


Akın, G. (2016). Evaluation of national foreign language test in Turkey. Asian Journal of Educational Research, 4(3), 11-21. Retrieved in March, 2019 from: http://www.multidisciplinaryjournals.com/wp-content/uploads/2016/04/FULLPAPER

Alderson, J.C. (1986). Innovations in language testing. In M. Portal (Ed.), Innovations in language testing: Proceedings of the IUS/NFER conference (pp. 93-105). Windsor.

Alderson, J.C. & Wall, D. (1986). Does washback exist? Applied linguistics. 14, 115-129.

Büyüköztürk, Ş. (2013). Sosyal bilimler için veri analizi el kitabı. Ankara: Pegem.

Cheng, L. & Curtis, A. (2004). Washback in Language Testing. Retrieved in May, 2019 from: https://www.researchgate.net/publication/277405452_Washback_in_language_testing_Research_contexts_and_methods

Ching, P. Y. (2009). A review of washback and its pedagogical implications. VNU Journal of science, foreign languages. 25, 257-263.

Cinkara, E., Tosun, Ö. (2017). Face validity study of a small-scale test in a tertiary level intensive EFL program. B.U. Journal of Faculty of Education, 6(2), 395- 410.

Cohen, R. J., & Swerdlik, M. E. (2013). Psikolojik test ve değerlendirme, testler ve ölçmeye giriş (E. Tavşancıl, Trans.). Ankara: Nobel.

Crocker, L., & Algina, J. (1986). Introductıon to classical and modern test theory. USA: CBS Collage Publishers Campany.

De Vellis, R. F. (2014). Ölçek geliştirme, kuram ve uygulamalar (T. Totan, Trans.). Ankara: Nobel.

Doğan, İ., & Doğan, N. (2014). Adım adım çözümlü parametrik olmayan istatistiksel yöntemler. Ankara: Detay.

Fish, J. (1988). Responses to mandated standardized testing. Educational researcher. 18, 27-32.

Green, A. (2007). IELTS washback in context: Preparation for academic writing in higher education. Retrieved in April, 2019 from: http://hosted.jalt.org/test/PDF/Dunkley2.pdf

Green, S. B. & Salkind, N. J. (2008). Using SPSS for Windows and Macintosh: Analyzing and Understanding Data. Upper Saddle River: Pearson; Prentice Hall.

Hatipoğlu, Ç. 2016. The impact of the university entrance exam on EFL education in Turkey: Pre-service English language teachers’ perspective. Procedia-Social and Behavioral Sciences, 232, 136-144.

Kline, R. B. (2005). Principles and practice of structural equation modeling. NewYork: The Guilford Press.

Külekçi, E. 2016. A concise analysis of the Foreign Language Examination (YDS) in Turkey and its possible washback effects. International Online Journal of Education and Teaching, 3(4), 303-315. Retrieved in March, 2019 from: http://iojet.org/index.php/IOJET/article/view/141/143

Linn, R. L. (2000). Assessments and accountability. Educational

McEwen, N. (1995). Introducing accountability in education in Canada. Canadian Journal of Education. 20, 1-17.

Noble, A.J. & Smith, M. L. (1994). Measurement-driven reform: research on policy, practice, repercussion. Tempe, Arizona University.

Özdamar, K. (2013). Paket programlar ile istatistiksel veri analizi. Eskişehir: Nisan, 2013.

Özmen, K.S. (2011). Washback Effects of Inter University Foreign Language Examination on Foreign Language Competences of Candidate Academics. Novitas Royal (Research on Youth and Language). 5(2). 215-228.

Pearson, I. (1988). Tests as levers for change. Practice and evaluation (pp. 98-107). London.

Polat, M. (2018). Akademisyenlerin Yabancı Dil Bilgisi Seviye Tespit Sınavı’nın (YDS) Geçerliğiyle İlgili Tutumlarının Belirlenmesi. Retrieved in March, 2019 from: https://dergipark.org.tr/download/article-file/693327

Şeker, H., & Gençdoğan, B. (2014). Psikolojide ve eğitimde ölçme aracı geliştirme. Ankara: Nobel.

Shohammy. E. (2006). Language Policy. Hidden Agendas and New Approaches. Routledge, New York.

Siegel, S. (1977). Davranış bilimleri için parametrik olmayan istatistikler (Y. Topsever, Trans.). Ankara: Ankara Üniversitesi Basımevi.

Smith, M. L. (1991). Put to the test: The effects of external testing on teachers. Educational researcher. 20, 8-11.

Vieira, A. L. (2011). Preparation of the analysis. Interactive LISREL in practice. London: Springer.

Wall, D. (1996). Introducing new tests into traditional systems: Insights from general education and from innovation theory. Language testing. 13, 334-354.

Wall, D. (2000). The impact of high-stakes testing on teaching and learning: Can this be predicted or controlled? System, 28, 499-509.

Yavuzer, H., Göver, Ä. H. 2012. Akademik personelin yabancı dil durumu ve yabancı dil sınavlarına bakısı: Nevsehir örneÄŸi. NEÃœ Sos. Bil. Enst. Dergisi, 1(2), 136-158.

Yesilyurt, S. 2016. An attempt for the exploration of academicians’ experiences of the standard foreign language tests held in Turkey through metaphors. International Journal of Higher Education, 5(2), 263-274.


Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Journal of Language and Linguistic Studies
ISSN 1305-578X (Online)
Copyright © 2005-2022 by Journal of Language and Linguistic Studies