Readability of Reading Texts as Authentic Materials Issued by ChatGPT: A Systemic Functional Perspective

Reski Ramadhani; Hilmi Aulawi; Risma Liyana Ulfa

doi:10.21093/ijeltal.v8i2.1546

Readability of Reading Texts as Authentic Materials Issued by ChatGPT: A Systemic Functional Perspective

Reski Ramadhani, Hilmi Aulawi, Risma Liyana Ulfa

Abstract

Selecting the appropriate texts as the authentic material for English teaching, particularly at the university level, matched with students’ mastery level is still challenging. This study attempts to investigate the readability level of reading texts through the framework of Systemic Functional Linguistics (SFL) issued by ChatGPT, focused on whether the complexity level of the texts matches the standard level of the Common European Framework of Reference (CEFR) by proposed British Council. Through the qualitative design with content analysis, this study examines eighteen texts classified following CEFR levels issued by ChatGPT. It analyzes their lexical density, grammatical intricacy, and lexical variation to know the complexity of the texts. The analysis revealed that the complexity level of the texts issued by ChatGPT has not thoroughly followed the standard level of the texts used by the British Council on the CEFR level, indicating that several texts are inappropriate with their complexity levels. It is found that the complexity level of the texts issued by ChatGPT is determined by the length of the texts that increase from the basic level to the proficient level seen from the number of words in each text, not by their lexical density, grammatical intricacy, and lexical variation indexes. The study provides implications for the lecturer to carefully select the text used as teaching material issued by ChatGPT by relying on the lexico-grammatical analysis of the text to help students achieve the comprehension stage.

Keywords

readability; lexical density; grammatical intricacy; lexical variation; ChatGPT

Full Text:

Download PDF

References

Anthony, L. (2007). AntConc (3.2.1w) [Computer Software. Waseda University. https://www.laurenceanthony.net/software/antconc/

Arikan, A. (2015). The CEFR and Reading: A Document Analysis. Procedia - Social and Behavioral Sciences, 199, 501–504. https://doi.org/10.1016/j.sbspro.2015.07.538

Bailin, A., & Grafstein, A. (2015). Readability: Text and Context. https://doi.org/10.1057/9781137388773

Bani Amer, M., & Baarah, H. (2021). Readability and Lexical Density of Reading Sections of Tenth Grade English Textbooks in Jordan and Sultanate of Oman: A Comparative Study. Budapest International Research and Critics in Linguistics and Education (BirLE) Journal, 4, 1138–1148. https://doi.org/10.33258/birle.v4i3.2438

Beck, I. L., McKeown, M. G., & Worthy, J. (1995). Giving a Text Voice Can Improve Students’ Understanding. Reading Research Quarterly, 30(2), 220–238. https://doi.org/10.2307/748033

Cekiso, M. (2017). Teachers’ perceptions of reading instruction in selected primary schools in the Eastern Cape. Reading & Writing, 8(1), 1–8. https://doi.org/10.4102/rw.v8i1.158

Creswell, J. W. (2012). Educational Research: Planning, Conducting, and Evaluating Quantitative and Qualitative Research. Pearson. https://books.google.co.id/books?id=4PywcQAACAAJ

Dijk, T. A. van, & Kintsch, W. (1983). Strategies of Discourse Comprehension. Academic Press.

Dubay, W. (2004). The Principles of Readability. CA, 92627949, 631–3309.

Eggins, S. (2004). Introduction to Systemic Functional Linguistics: 2nd Edition. A&C Black.

Europe, C. of. (2020). Common European Framework of Reference for Languages: Learning, Teaching, assessment: Companion volume. Council of Europe.

Fadhil, A., Gunawan, W., & Wirza, Y. (2023). Lexical Density in EFL Indonesian Textbooks: A Comparative Analysis. JALL (Journal of Applied Linguistics and Literacy), 7(1), Article 1. https://doi.org/10.25157/jall.v7i1.9727

Fitriana, P., Hadijah, D., & Lestari, Z. (2019). The Use of Authentic Material to Improve Students’ Reading Comprehension. ELTIN JOURNAL, Journal of English Language Teaching in Indonesia, 7, 8. https://doi.org/10.22460/eltin.v7i1.p8-11

Freebody, P. (2003). Qualitative Research in Education: Interaction and Practice. SAGE Publications.

Gashti, Y. B. (2018, October 1). The Effect of Authentic and Simplified Literary Texts on the Reading Comprehension of Iranian Advanced EFL Learners. https://www.semanticscholar.org/paper/The-Effect-of-Authentic-and-Simplified-Literary-on-Gashti/ad1e9b25ae234a94aa0f71e88381ea1268bfd25f

Gerot, L., & Wignell, P. (1994). Making Sense of Functional Grmmar. Gerd Stabler.

Gregori-Signes, C., & Clavel-Arroitia, B. (2015). Analysing Lexical Density and Lexical Diversity in University Students’ Written Discourse. Procedia - Social and Behavioral Sciences, 198, 546–556. https://doi.org/10.1016/j.sbspro.2015.07.477

Grimaldi, G., & Ehrler, B. (2023). AI et al.: Machines Are About to Change Scientific Publishing Forever. ACS Energy Letters, 8, 878–880. https://doi.org/10.1021/acsenergylett.2c02828

Halliday, M. A. K., & Matthiessen, C. M. I. M. (2004). An introduction to functional grammar (3rd ed). Arnold ; Distributed in the United States of America by Oxford University Press.

Ismail, N. M., Yoestara, M., & Jamilah, S. (2023). Comparing lexical density in teacher talks: elementary school and higher education level. LLT Journal: A Journal on Language and Language Teaching, 26(1), Article 1. https://doi.org/10.24071/llt.v26i1.4971

Khaleel, R. (2021). The Effect of Using Semantic Map Technique in Teaching Reading Comprehension on Students’ Achievement. Al-Adab Journal, 2, 43–52. https://doi.org/10.31973/aj.v2i137.1186

Kim, H.-S. (2015). Using Authentic Videos to Improve EFL Students’ Listening Comprehension. International Journal of Contents, 11, 15–24. https://doi.org/10.5392/IJoC.2015.11.4.015

Lund, B. (2023). A Brief Review of ChatGPT: Its Value and the Underlying GPT Technology. https://doi.org/10.13140/RG.2.2.28474.06087

Maley, A., & Tomlinson, B. (2017). Authenticity in Materials Development for Language Learning. Cambridge Scholars Publishing.

Mara, R. R., & Mohamad, M. (2021). The Use of Authentic Materials in Teaching Reading to Secondary School Students in Malaysia: A Literature Review. Creative Education, 12(7), Article 7. https://doi.org/10.4236/ce.2021.127129

Martin, R. A. (2007). Approaches to the Sense of Humor: A Historical Review. 47.

McCannon, B. C. (2019). Readability and Research Impact. Economics Letters, 180, 76–79. https://doi.org/10.1016/j.econlet.2019.02.017

Mohammed, F. G. (2021). The Effects of Teaching Through Authentic Material on Efl Learners. Docens Series in Education, 1, 73–86.

Namaziandost, E., Razmi, M. H., Ahmad Tilwani, S., & Pourhosein Gilakjani, A. (2022). The Impact of Authentic Materials on Reading Comprehension, Motivation, and Anxiety Among Iranian Male EFL Learners. Reading & Writing Quarterly, 38(1), 1–18. https://doi.org/10.1080/10573569.2021.1892001

Natova, I. (2021). Estimating CEFR reading comprehension text complexity. The Language Learning Journal, 49(6), 699–710. https://doi.org/10.1080/09571736.2019.1665088

Noviyenti, L. (2021). Analysis of English Alive Textbook in Terms of Genres and Lexical Density. AL-ISHLAH: Jurnal Pendidikan, 13(2), Article 2. https://doi.org/10.35445/alishlah.v13i2.587

Poonpon, K. (2010). Text Complexity and Reading Comprehension Tests. Erik Castello. Bern: Peter Lang,2008. Pp. 352. Studies in Second Language Acquisition, 32(3), 512–513. https://doi.org/10.1017/S0272263110000197

Putra, D., & Lukmana, I. (2017). Text Complexity in Senior High School English Textbooks: A Systemic Functional Perspective. Indonesian Journal of Applied Linguistics, 7, 198. https://doi.org/10.17509/ijal.v7i2.8352

Rahman, M., Terano, H. J., Rahman, M., Salamzadeh, A., & Rahaman, Md. S. (2023). ChatGPT and Academic Research: A Review and Recommendations Based on Practical Examples. 3, 1–12. https://doi.org/10.52631/jemds.v3i1.175

Renandya, W. A., Hamied, F. A., & Joko, N. (2018). English Language Proficiency in Indonesia: Issues and Prospects. The Journal of AsiaTEFL, 15(3), 618–629. https://doi.org/10.18823/asiatefl.2018.15.3.4.618

Rizkiani, D., Mahdi, S., & Sujatna, E. T. S. (2022). Lexical Density and Readability of the Facil’s ‘Advanced Learning Textbook’ for Indonesian High School Students. AL-ISHLAH: Jurnal Pendidikan, 14(1), Article 1. https://doi.org/10.35445/alishlah.v14i1.1157

Sujatna, E. T. S., Emilia, E., & Kurniasih, N. (2022). Readability of PISA-like Reading Texts: A Lesson Learned from Indonesian Teachers. World Journal of English Language, 13(1), Article 1. https://doi.org/10.5430/wjel.v13n1p9

Sujatna, E. T. S., Heriyanto, H., & Andri, S. (2021). Lexical Density and Variation in Indonesian Folklores in English Student Textbooks: An Sfl Study. Leksika: Jurnal Bahasa, Sastra Dan Pengajarannya, 15, 62. https://doi.org/10.30595/lks.v15i2.11102

Syarif, H. (2019, January 1). Lexical Density V.S. Grammatical Intricacy: How Are They Related? https://doi.org/10.2991/icoelt-18.2019.3

To, V., Fan, S., & Thomas, D. (2013). Lexical Density and Readability: A Case Study of English Textbooks. The International Journal of Language, Society and Culture.

DOI: http://dx.doi.org/10.21093/ijeltal.v8i2.1546

Refbacks

There are currently no refbacks.

IJELTAL (Indonesian Journal of English Language Teaching and Applied Linguistics) by http://ijeltal.org is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.