Evaluating EAP Textbooks for Indonesian University Students Using Impressionistic and In-depth Assessment

Imroatus Solikhah

Abstract


This study was qualitative content analysis that evaluated the quality of English for University Teaching (EUT), English for Specific Purposes (ESP), and English for Academic Purposes (EAP) textbooks through impressionistic and in-depth analysis.   The participants were 9 EAP teachers and 15 EAP students from three universities in Surakarta, Indonesia. Instruments to collect data were checklist and interview guide. The checklist consisted of impressionistic analysis to see (1) cover, (2) content scope, (3) learning activities, (4) book organization, and (5) layout; and the in-depth analysis, namely (1) aim and approach, (2) organization design, language and content, (3) language skills, and (4) practical consideration. Data were collected using checklist and Focus Group Discussion. Data were analyzed through summative content analysis with seven stages: transforming data into narrative text, determining unit of analysis, developing categories, coding, coding the entire text, checking consistency of coding, and drawing conclusion. Results show EUT and ESP have low quality based on the impressionistic evaluation, and fair quality of their in-depth evaluation.  Both books are register and grammar oriented.  EAP textbook is good in general, and very good in depth.  EAP presents its contents in terms of genre reading, academic speaking, academic reading, academic writing and grammar.

Keywords


English for Academic Purposes, impressionistic, in-depth evaluation, textbook

Full Text:

PDF

References


Broadfoot, P., Murphy, R. and Torrance, H. (eds). (1990). Changing Educational Assessment: International Perspectives and Trends. London: Routledge.

Cunningsworth, A. (1984). Evaluating and selecting EFL teaching materials. London: Heinemann Educational Books.

De Wever, B., Schellens, T., Valcke, M., & Van Keer, H. (2006). Content analysis schemes to analyze transcripts of online asynchronous discussion groups: A review. Computer & Education, 46, 6-28.

Dubin, Fraida, and Elite Olshtain. (1986). Course design: Developing Programs and Materials for Language Learning. Cambridge: Cambridge University Press.

Ellis, Rod. (1997). The empirical evaluation of language teaching materials. ELT Journal, 51(1), pp. 36-42

Griffiths, C. (1995). Evaluating materials for teaching English to adult speakers of other languages. Forum 33(3): 50. Retrieved from http://forum.state.gov/vols/vol33/ no3/p50.htm

Hsieh, H.-F., & Shannon, S.E. (2005). Three approaches to qualitative content analysis. Qualitative Health Research, 15(9), 1277-1288.

Hycroft, J. (1998). An Introduction to English Language Teaching. New York & London: Longman.

Hutchinson, T and & Torres, E. (1994). The Textbook as an Agent of Change. ELT Journal, 48(4).

Hutchinson, T. & Waters, A. (1987). English for specific purposes: A learning-centered approach. Cambridge: Cambridge University Press.

Kondracki, N. L., & Wellman, N. S. (2002). Content analysis: Review of methods and their applications in nutrition education. Journal of Nutrition Education and Behavior, 34, 224-230.

Kulm, G., Roseman, J. E., Treistman, M. (1999). A Benchmarks-Based Approach to Textbook Evaluation. Science Books & Films, 35 (4). Available at: http://www.project2061.org/publications/textbook/articles/approach.htm

Lawrence, Wing Pak Wong. (2011). Textbook Evaluation: A Framework for Evaluating the Fitness of the Hong Kong New Secondary School (NSS) Curriculum. Master’s Thesis. Hong Kong: City University of Hong Kong.

Longman dictionary of contemporary English (4th ed.). (2003). Harlow, England: Longman.

Masuhara, H. & Tomlinson, B. (2008). Materials for General English. In B.Tomlinson (Ed), English Teaching Materials: A Critical Review (pp. 17-37). London: Continuum.

McGrath, Ian. (2001). Materials Evaluation and Design for Language Teaching. Edinburgh: Edinburgh University Press.

McGrath, Ian. (2002). Materials Evaluation and Design for Language Teaching. Edinburgh: Edinburgh

Monbec, Laetitia. (2020). Systematic Functional Linguistics for the EGAP Module: Revisiting the Common Core. Journal of English for Academic Purposes, 43: 1-14. https://doi.org/10.1016/j.jeap.2019.100794

Montasser, A. Wahab. (2013). Developing an English Language Textbook Evaluative Checklist. IOSR Journal of Research & Method in Education, 1(3), 55-70. www.iosrjournal.org.

Mukundan, J., Hajimohammadi, R. and Nimehchisalem, V. (2011). Developing An English Language Textbook Evaluation Checklist. Contemporary Issues in Education Research – June 2011. Volume 4, Number 6

Oakey, David. (2020). Phrases in EAP academic writing pedagogy: Illuminating Halliday’s influence on research and practice, Journal of English for Academic Purposes, 44. 1-16. https://doi.org/10.1016/j.jeap.2019.100829

Okitasari, I. & Palupi, D. (2019). Teachers' perceptions toward EFL textbook. ELT in Focus, 2(2), 77-86.

Patton, M.Q. (2002). Qualitative Research and Evaluation Methods. Thousand Oaks, CA: Sage.

Peacock, M. (1997). Choosing the right book for your class. Retrieved from http: //www.sx.ac.uk/linguistics/pgr/egspll/volume1/ PDFs/PEACOCK1.pdf

Purwati, Ratna Annisa. (2019). Evaluation on ESP Course Book: Get Along with English for Hotel Industry. Journal of English Educator Society, 4(2), 106-116. DOI: 10.21070/jess.v4i2.2432.

Rahimy, R. (2007). A coursebook evaluation. ESP World, 6, Issue 2(15). Retrieved from http://www.esp-world.info/contents.htm.

Ramadhana, A. Muhammad; Indah Dwi Opik & Suhardi. (2019). An Evaluation of English Language Textbook: Interlanguage English for Senior High School Students. Jurnal Studi Guru dan Pembelajaran, 2(1), 32-40.

Richards, J. C. (2001). Curriculum development in language teaching. Cambridge: Cambridge University Press.

Sahim, Senem. (2020). Developing a Checklist for English Language Teaching Course Book Analysis. International Journal of Education and Research. 8(1): 107-120. www.ijern.com

Sheldon, L. E. (1988). Evaluating ELT textbooks and materials. ELT Journal, 42(4):237-246.

Solikhah, Imroatus. (2014). Buku Teks Akademik Berbasis Kompetensi untuk Mahasiswa Jurusan Non-Bahasa Inggris (Penelitian dan Pengembangan di Perguruan Tinggi Negeri di Jawa Tengah dan DIY). Ph.D dissertation. Doctorate Program in Indonesian Language Education. Surakarta: Universitas Sebelas Maret.

Solikhah, Imroatus. (2015). Designing Academic Literacy Framework of EAP Program for Indonesian Learners. Journal of Language and Literature, 6(2): 34-38.

Tesch, R. (1990). Qualitative Research: Analysis Types & Software Tools. Bristol, PA: Falmer Press.

Ur, P. (1996). A course in language teaching: Practice and theory. Cambridge: Cambridge University Press.

Weber, R. P. (1990). Basic content analysis. Beverly Hills, CA: Sage.

Yapici, Burcin, Org. (2019). Textbook Evaluation in English Language Teaching: Solutions, Preintermediate. KUSAD, 2(1), 62-74.

Zhang, Yan & Wildemuth, Barbara. (2016). Qualitative Analysis of Content. Available online at:https://www.semanticscholar.org/paper/Qualitative-Analysis-of-Content-by-Zhang-Wildemuth/b269343ab82ba8b7a343b893815a0bae6472fcca. Retrieved on 2 August, 2020.




DOI: http://dx.doi.org/10.21093/ijeltal.v4i2.606

Refbacks

  • There are currently no refbacks.


Creative Commons License
IJELTAL (Indonesian Journal of English Language Teaching and Applied Linguistics) by http://ijeltal.org is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

 

Abstracting and Indexing

                  


Contact Us: IJELTAL (Indonesian Journal of English Language Teaching and Applied Linguistics; Address: FTIK, IAIN Samarinda; Jl. H.A.M. Rifadin, Samarinda, Kalimantan Timur, Indonesia. Email: ijeltalj@gmail.com