Exposing the Gap: AI-Assisted AQRF Evaluation of Grade 12 English Textbooks in Indonesia’s Kurikulum Merdeka for Edu-Revolution
DOI:
https://doi.org/10.54855/paic.2693Keywords:
Artificial Intelligence, Kurikulum Merdeka, Reading for Emotions, Aesthetic PrinciplesAbstract
As Indonesia advances toward the Indonesia Emas 2045 vision, English education is expected to prepare learners for global collaboration. However, debates remain on whether Kurikulum Merdeka textbooks foster higher-order thinking, emotional engagement, and aesthetic literacy. While many studies analyze textbooks, few incorporate emotional and aesthetic dimensions, and even fewer explore AI as an assessor in textbook analysis. This study examines the extent to which a Grade 12 Kurikulum Merdeka English textbook develops competencies aligned with AQRF Level 4, such as independent problem solving, critical engagement, and applying knowledge in unfamiliar contexts. Situated in the context of Grade 12 English learning in Indonesia, this pilot study analyzes a narrative text, The Breakers of Limitations from Gurung Mali, using AI-assisted textual analysis with ChatGPT, Qwen, and Gemini. Guided by Reading for Emotions and neuroaesthetic principles with AQRF-informed prompts, the findings show cultural richness and engaging narratives but limited emotional depth, aesthetic appeal, and higher-order reasoning, highlighting the need for an AI-driven, AQRF-informed redesign.
References
Ansori, R. W. (2021). Ancangan Indonesia Emas 2045 dalam Buku Teks Bahasa Indonesia Terbitan Kementerian, Pendidikan, dan Kebudayaan Tahun 2017. Jurnal Pendidikan: Riset dan Konseptual, 5(4), 551–557. https://doi.org/10.28926/riset_konseptual.v5i4.410.
ASEAN Secretariat. (2012). ASEAN Qualifications Reference Framework (AQRF). https://asean.org/.
Atchley, P., Pannell, H., Wofford, K., Hopkins, M., & Atchley, R. A. (2024). Human and AI collaboration in the higher education environment: Opportunities and concerns. Cognitive Research: Principles and Implications, 9(1), 20. https://doi.org/10.1186/s41235-024-00547-9
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021). On the dangers of stochastic parrots: Can language models be too big? In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency (pp. 610–623). Association for Computing Machinery. https://doi.org/10.1145/3442188.3445922.
Bengtsson, M. (2016). How to Plan and Perform a Qualitative Study Using Content Analysis. Nursing Plus Open, 2, 8-14. https://doi.org/10.1016/j.npls.2016.01.001.
Cadwell, D., & White, P. R. R. (2017). That’s not a narrative; this is a narrative: NAPLAN and pedagogies of storytelling. Australian Journal of Language and Literacy, 40(1), 16–27. https://doi.org/10.1007/BF03651981.
Carvajal, A. L. P., & Vicente, R. S. (2024). The development and analysis of a framework for enhancing the Philippines' competitiveness in ASEAN surveying. International Journal of Open-access, Interdisciplinary and New Educational Discoveries of ETCOR Educational Research Center (iJOINED ETCOR), 3(1), 401-413.https://etcor.org/storage/iJOINED/Vol.%20III(1),%20401-413.pdf.
Celik, I., Dindar, M., Muukkonen, H., & Järvelä, S. (2022). The promises and challenges of artificial intelligence for teachers: A systematic review of research. TechTrends, 66(4), 616-630. The Promises and Challenges of Artificial Intelligence for Teachers: a Systematic Review of Research | TechTrends | Springer Nature Link
Damayanti, I., & Mukarto, F. X. (2024). The analysis of tasks presented in Kurikulum Merdeka textbook English for Nusantara. Premise: Journal of English Education, 13(1), 21. http://dx.doi.org/10.24127/pj.v13i1.9065.
Dewey, J. (1938). Experience and Education. New York, NY: Macmillan. https://archive.org/details/Experienc eAndEducation .
EF Education First. (2024). EF English Proficiency Index 2024. https://www.ef.com/assetscdn/WIBIwq6RdJvcD9bc8RMd/cefcom-epi-site/reports/2024/ef-epi-2024-english.pdf
Freire, P. (1970). Pedagogy of the oppressed. New York, NY: Continuum Publishing. https://fsi-ebcao.princeton.edu/sites/g/files/toruqf1411/files/media/freire .
Gasani, L., Nugraha, M. A., & Purnama, D. W. (2025). Exploring Factors Enhancing English Speaking Proficiency. Biormatika: Jurnal Ilmiah Fakultas Keguruan dan Ilmu Pendidikan, 11(1), 52–62. https://doi.org/10.35569/biormatika.v11i1.2273.
Hardini, S. R., Merdianto, A., Marjenny, Nurhayati, R., Syathroh, I. L., & Dadan. (2022). Bahasa Inggris: Life today untuk SMA/MA kelas XII. Pusat Perbukuan Badan Standar, Kurikulum, dan Asesmen Pendidikan. https://buku.kemendikdasmen.go.id/katalog/bahasa-inggris-life-today-untuk-smama-kelas-xii
Ji, H., Han, I., & Ko, Y. (2023). A systematic review of conversational AI in language education: Focusing on the collaboration with human teachers. Journal of Research on Technology in Education, 55(1), 48-63. https://doi.org/10.1080/15391523.2022.2142873.
Karademir, K., & Alper, A. (2024). Evaluating the evaluators: A comparative study of AI and teacher assessments in higher education. Digital Education Review, (45), 124-140. https://doi.org/10.1344/der.2024.45.124-140.
Komite Nasional Kualifikasi Indonesia (KNKI). (2020). ASEAN Qualifications Reference Framework: Referencing Report of Indonesia (Jakarta: Kementerian Pendidikan dan Kebudayaan). http://kkni.ristekdikti.go.id.
Krakowski, S. (2025). Human-AI agency in the age of generative AI. Information and Organization, 35(1), 100560. https://doi.org/10.1016/j.infoandorg.2025.100560.
Kuroda, K., Sugimura, M., Kitamura, Y., & Asada, S. (2018). Internationalization of higher education and student mobility in Japan and Asia. Internationalization of higher Education and student mobility in Japan and Asia; 2018 .
Lian, A. B. (2017). Reading for emotion with ICT tools. In Chen, W. et al. (Eds.), Proceedings of the 25th International Conference on Computers in Education. https://library.apsce.net/index.php/ICCE/article/view/2191.
Lian, A., & Sussex, R. (2018). Toward a Critical Epistemology for Learning Languages and Cultures in Twenty-First Century Asia. In Multilingual Education (Vol. 24). https://doi.org/10.1007/978-3-319-69995-0_3.
Liang, P., Bommasani, R., Lee, T., Tsipras, D., Soylu, D., Yasunaga, M., Zhang, Y., Narayanan, D., Wu, Y., Kumar, A., Newman, B., Selvaraj, S., Abeysinghe, A., Bernal, E., Mandal, P., Hwang, C., Holtzman, A., Jiang, S., Kalluri, P., … Stanford CRFM. (2022). Holistic evaluation of language models (arXiv:2211.09110). arXiv. https://arxiv.org/abs/2211.09110.
Lotto, B. (2017). Deviate: The Science of Seeing Differently (O. P. Group, Ed.). https://books.google.co.id/books/about/Deviate.html?id=OtjYjgEACAAJ&redir_esc=y .
Mahligawati, F., Allanas, E., Butarbutar, M. H., & Nordin, N. A. N. (2023, September). Artificial intelligence in physics education: A comprehensive literature review. In Journal of Physics: Conference Series (Vol. 2596, No. 1, p. 012080). IOP Publishing. Artificial intelligence in Physics Education: a comprehensive literature review - IOPscience
Marliana, R. (2024). Analyzing English's Impact on Global Competitiveness and Sustainable Progress. Jurnal Riset Ilmu Pendidikan, 4(4), 255-260. https://doi.org/10.56495/jrip.v4i4.932.
Mouta, A., Pinto-Llorente, A. M., & Torrecilla-Sánchez, E. M. (2025). “Where is agency moving to?”: Exploring the interplay between AI technologies in education and human agency. Digital Society, 4(2), 49. https://doi.org/10.1007/s44206-025-00203-9.
Nguyen, A., Gardner, L., & Sheridan, D. (2020). Data analytics in higher education: An integrated view. Journal of Information Systems Education, 31(1), 61–71. http://jise.org/Volume31/n1/JISEv31n1p61.html.
Pham, N. N. H. (2025). The Use of ChatGPT in EFL students as a Learning Assistant in their Writing Skills: A literature review. International Journal of AI in Language Education, 2(1), 38-54. https://doi.org/10.54855/ijaile.25213.
Piaget, J., & Inhelder, B. (1969). The psychology of the child. Basic Books. https://www.basicbooks.com/titles/jean-piaget/the-psychology-of-the-child/9780465095001/ .
Ramachandran, V. S., & Hirstein, W. (1999). The Science of Art: A Neurological Theory of Aesthetic Experience. Journal of Consciousness Studies, 6, 15-51. https://philarchive.org/rec/RAMTSO-5 .
Republic of Indonesia. (2025). Presidential Instruction No. 1 of 2025 on Budget Efficiency. https://peraturan.bpk.go.id/Details/313401/inpres-no-1-tahun-2025 .
Russell, S., & Norvig, P. (2021). Artificial Intelligence: A modern approach (4th ed.). Pearson. https://aima.cs.berkeley.edu/ .
Selwyn, N. (2019). Should robots replace teachers? AI and the Future of Education. (1st ed.) Polity Press. https://research.monash.edu/en/publications/should-robots-replace-teachers-ai-and-the-future-of-education .
Senowarsito, Senowarsito & Suwandi, Suwandi & Musarokah, Siti & Ardini, Sukma. (2023). The Analysis of Feasibility in EFL Textbook: A Contribution to Kurikulum Merdeka. Arab World English Journal. 305-319. https://dx.doi.org/10.24093/awej/call9.21.
Sudimantara, L. B., Baehaqi, L., Lian, A., & Lian, A. (2025). Multisensory CALL for Under-Resourced Universities and Schools in Indonesia. Palgrave Macmillan. https://link.springer.com/book/10.1007/978-3-031-91387-7.
Sudarma, U. (2022). Pendidikan karakter dalam mewujudkan sumber daya manusia berdaya saing menuju Indonesia Emas 2045. Sharia: Jurnal Kajian Islam, 1(1), 37–55. https://doi.org/10.59757/sharia.v1i1.4.
Tenny, S., Brannan, J., & Brannan, G. (2025). Qualitative Study. StatPearls. http://www.ncbi.nlm.nih.gov/books/NBK470395/.
Trikoili, A., Georgiou, D., Pappa, C. I., & Pittich, D. (2025). Critical Thinking Assessment in Higher Education: A Mixed-Methods Comparative Analysis of AI and Human Evaluator. International Journal of Human–Computer Interaction, 1–14. https://doi.org/10.1080/10447318.2025.2499164.
Urmeneta, A., & Romero, M. (2025). AI as a creative partner: A PRISMA review of AI's role in supporting creativity in education. In Frontiers in Education, 10, 1602151. https://doi.org/10.3389/feduc.2025.1602151.
Wachyuniah, Y., Wirza, Y., & Karnedi, K. (2024). Comparison Of Two English Textbooks Used in Indonesia Secondary Education: English as a Second Language (Cambridge Igcse) Vs English for Nusantara (Kurikulum Merdeka). Klasikal: Journal Of Education, Language Teaching And Science, 6(3), 957-968. https://doi.org/10.52208/klasikal.v6i3.1244.
Williamson, B. and Eynon, R. (2020) Historical Threads, Missing Links, and Future Directions in AI in Education. Learning, Media and Technology, 45, 223-235. https://doi.org/10.1080/17439884.2020.1798995.
Wirawan, R. (2025). From Seci to Bima – Toward regenerative knowledge management through bridging intelligence, mindfulness, and awareness [White paper]. International Society for the Systems Sciences Conference.
Zull, J. E. (2011). From brain to mind: Using neuroscience to guide change in education (1st ed.). Stylus Publishing. https://doi.org/10.4324/9781003444886.
Zull, J. E. (2002). The art of changing the brain: Enriching the practice of teaching by exploring the biology of learning (1st ed.). Stylus Publishing. https://doi.org/10.4324/9781003447573.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Muhammad Azkiya Bahtsulkhoir, Salsabilla, Ananditamala Syalwa Heryana
This work is licensed under a Creative Commons Attribution 4.0 International License.
Copyright
The copyright of all articles published in the Proceedings of the AsiaCALL International Conference (paic) remains with the Authors, i.e. Authors retain full ownership of their article. Permitted third-party reuse of the open access articles is defined by the applicable Creative Commons (CC) end-user license which is accepted by the Authors upon submission of their paper. All articles in the aicp are published under the CC BY-NC 4.0 license, meaning that end users can freely share an article (i.e. copy and redistribute the material in any medium or format) and adapt it (i.e. remix, transform and build upon the material) on the condition that proper attribution is given (i.e. appropriate credit, a link to the applicable license and an indication if any changes were made; all in such a way that does not suggest that the licensor endorses the user or the use) and the material is only used for non-commercial purposes.
