Readability of Reading Texts as Authentic Materials Issued by ChatGPT: A Systemic Functional Perspective
DOI:
https://doi.org/10.21093/ijeltal.v8i2.1546Keywords:
readability, lexical density, grammatical intricacy, lexical variation, ChatGPTAbstract
Selecting the appropriate texts as the authentic material for English teaching, particularly at the university level, matched with students’ mastery level is still challenging. This study attempts to investigate the readability level of reading texts through the framework of Systemic Functional Linguistics (SFL) issued by ChatGPT, focused on whether the complexity level of the texts matches the standard level of the Common European Framework of Reference (CEFR) by proposed British Council. Through the qualitative design with content analysis, this study examines eighteen texts classified following CEFR levels issued by ChatGPT. It analyzes their lexical density, grammatical intricacy, and lexical variation to know the complexity of the texts. The analysis revealed that the complexity level of the texts issued by ChatGPT has not thoroughly followed the standard level of the texts used by the British Council on the CEFR level, indicating that several texts are inappropriate with their complexity levels. It is found that the complexity level of the texts issued by ChatGPT is determined by the length of the texts that increase from the basic level to the proficient level seen from the number of words in each text, not by their lexical density, grammatical intricacy, and lexical variation indexes. The study provides implications for the lecturer to carefully select the text used as teaching material issued by ChatGPT by relying on the lexico-grammatical analysis of the text to help students achieve the comprehension stage.References
Anthony, L. (2007). AntConc (3.2.1w) [Computer Software. Waseda University. https://www.laurenceanthony.net/software/antconc/
Arikan, A. (2015). The CEFR and Reading: A Document Analysis. Procedia - Social and Behavioral Sciences, 199, 501–504. https://doi.org/10.1016/j.sbspro.2015.07.538
Bailin, A., & Grafstein, A. (2015). Readability: Text and Context. https://doi.org/10.1057/9781137388773
Bani Amer, M., & Baarah, H. (2021). Readability and Lexical Density of Reading Sections of Tenth Grade English Textbooks in Jordan and Sultanate of Oman: A Comparative Study. Budapest International Research and Critics in Linguistics and Education (BirLE) Journal, 4, 1138–1148. https://doi.org/10.33258/birle.v4i3.2438
Beck, I. L., McKeown, M. G., & Worthy, J. (1995). Giving a Text Voice Can Improve Students’ Understanding. Reading Research Quarterly, 30(2), 220–238. https://doi.org/10.2307/748033
Cekiso, M. (2017). Teachers’ perceptions of reading instruction in selected primary schools in the Eastern Cape. Reading & Writing, 8(1), 1–8. https://doi.org/10.4102/rw.v8i1.158
Creswell, J. W. (2012). Educational Research: Planning, Conducting, and Evaluating Quantitative and Qualitative Research. Pearson. https://books.google.co.id/books?id=4PywcQAACAAJ
Dijk, T. A. van, & Kintsch, W. (1983). Strategies of Discourse Comprehension. Academic Press.
Dubay, W. (2004). The Principles of Readability. CA, 92627949, 631–3309.
Eggins, S. (2004). Introduction to Systemic Functional Linguistics: 2nd Edition. A&C Black.
Europe, C. of. (2020). Common European Framework of Reference for Languages: Learning, Teaching, assessment: Companion volume. Council of Europe.
Fadhil, A., Gunawan, W., & Wirza, Y. (2023). Lexical Density in EFL Indonesian Textbooks: A Comparative Analysis. JALL (Journal of Applied Linguistics and Literacy), 7(1), Article 1. https://doi.org/10.25157/jall.v7i1.9727
Fitriana, P., Hadijah, D., & Lestari, Z. (2019). The Use of Authentic Material to Improve Students’ Reading Comprehension. ELTIN JOURNAL, Journal of English Language Teaching in Indonesia, 7, 8. https://doi.org/10.22460/eltin.v7i1.p8-11
Freebody, P. (2003). Qualitative Research in Education: Interaction and Practice. SAGE Publications.
Gashti, Y. B. (2018, October 1). The Effect of Authentic and Simplified Literary Texts on the Reading Comprehension of Iranian Advanced EFL Learners. https://www.semanticscholar.org/paper/The-Effect-of-Authentic-and-Simplified-Literary-on-Gashti/ad1e9b25ae234a94aa0f71e88381ea1268bfd25f
Gerot, L., & Wignell, P. (1994). Making Sense of Functional Grmmar. Gerd Stabler.
Gregori-Signes, C., & Clavel-Arroitia, B. (2015). Analysing Lexical Density and Lexical Diversity in University Students’ Written Discourse. Procedia - Social and Behavioral Sciences, 198, 546–556. https://doi.org/10.1016/j.sbspro.2015.07.477
Grimaldi, G., & Ehrler, B. (2023). AI et al.: Machines Are About to Change Scientific Publishing Forever. ACS Energy Letters, 8, 878–880. https://doi.org/10.1021/acsenergylett.2c02828
Halliday, M. A. K., & Matthiessen, C. M. I. M. (2004). An introduction to functional grammar (3rd ed). Arnold ; Distributed in the United States of America by Oxford University Press.
Ismail, N. M., Yoestara, M., & Jamilah, S. (2023). Comparing lexical density in teacher talks: elementary school and higher education level. LLT Journal: A Journal on Language and Language Teaching, 26(1), Article 1. https://doi.org/10.24071/llt.v26i1.4971
Khaleel, R. (2021). The Effect of Using Semantic Map Technique in Teaching Reading Comprehension on Students’ Achievement. Al-Adab Journal, 2, 43–52. https://doi.org/10.31973/aj.v2i137.1186
Kim, H.-S. (2015). Using Authentic Videos to Improve EFL Students’ Listening Comprehension. International Journal of Contents, 11, 15–24. https://doi.org/10.5392/IJoC.2015.11.4.015
Lund, B. (2023). A Brief Review of ChatGPT: Its Value and the Underlying GPT Technology. https://doi.org/10.13140/RG.2.2.28474.06087
Maley, A., & Tomlinson, B. (2017). Authenticity in Materials Development for Language Learning. Cambridge Scholars Publishing.
Mara, R. R., & Mohamad, M. (2021). The Use of Authentic Materials in Teaching Reading to Secondary School Students in Malaysia: A Literature Review. Creative Education, 12(7), Article 7. https://doi.org/10.4236/ce.2021.127129
Martin, R. A. (2007). Approaches to the Sense of Humor: A Historical Review. 47.
McCannon, B. C. (2019). Readability and Research Impact. Economics Letters, 180, 76–79. https://doi.org/10.1016/j.econlet.2019.02.017
Mohammed, F. G. (2021). The Effects of Teaching Through Authentic Material on Efl Learners. Docens Series in Education, 1, 73–86.
Namaziandost, E., Razmi, M. H., Ahmad Tilwani, S., & Pourhosein Gilakjani, A. (2022). The Impact of Authentic Materials on Reading Comprehension, Motivation, and Anxiety Among Iranian Male EFL Learners. Reading & Writing Quarterly, 38(1), 1–18. https://doi.org/10.1080/10573569.2021.1892001
Natova, I. (2021). Estimating CEFR reading comprehension text complexity. The Language Learning Journal, 49(6), 699–710. https://doi.org/10.1080/09571736.2019.1665088
Noviyenti, L. (2021). Analysis of English Alive Textbook in Terms of Genres and Lexical Density. AL-ISHLAH: Jurnal Pendidikan, 13(2), Article 2. https://doi.org/10.35445/alishlah.v13i2.587
Poonpon, K. (2010). Text Complexity and Reading Comprehension Tests. Erik Castello. Bern: Peter Lang,2008. Pp. 352. Studies in Second Language Acquisition, 32(3), 512–513. https://doi.org/10.1017/S0272263110000197
Putra, D., & Lukmana, I. (2017). Text Complexity in Senior High School English Textbooks: A Systemic Functional Perspective. Indonesian Journal of Applied Linguistics, 7, 198. https://doi.org/10.17509/ijal.v7i2.8352
Rahman, M., Terano, H. J., Rahman, M., Salamzadeh, A., & Rahaman, Md. S. (2023). ChatGPT and Academic Research: A Review and Recommendations Based on Practical Examples. 3, 1–12. https://doi.org/10.52631/jemds.v3i1.175
Renandya, W. A., Hamied, F. A., & Joko, N. (2018). English Language Proficiency in Indonesia: Issues and Prospects. The Journal of AsiaTEFL, 15(3), 618–629. https://doi.org/10.18823/asiatefl.2018.15.3.4.618
Rizkiani, D., Mahdi, S., & Sujatna, E. T. S. (2022). Lexical Density and Readability of the Facil’s ‘Advanced Learning Textbook’ for Indonesian High School Students. AL-ISHLAH: Jurnal Pendidikan, 14(1), Article 1. https://doi.org/10.35445/alishlah.v14i1.1157
Sujatna, E. T. S., Emilia, E., & Kurniasih, N. (2022). Readability of PISA-like Reading Texts: A Lesson Learned from Indonesian Teachers. World Journal of English Language, 13(1), Article 1. https://doi.org/10.5430/wjel.v13n1p9
Sujatna, E. T. S., Heriyanto, H., & Andri, S. (2021). Lexical Density and Variation in Indonesian Folklores in English Student Textbooks: An Sfl Study. Leksika: Jurnal Bahasa, Sastra Dan Pengajarannya, 15, 62. https://doi.org/10.30595/lks.v15i2.11102
Syarif, H. (2019, January 1). Lexical Density V.S. Grammatical Intricacy: How Are They Related? https://doi.org/10.2991/icoelt-18.2019.3
To, V., Fan, S., & Thomas, D. (2013). Lexical Density and Readability: A Case Study of English Textbooks. The International Journal of Language, Society and Culture.
