Exploring Students’ Engagement with Multimodal Texts in English Learning Activities
Keywords:
Students engagement, multimodal text, English subjectAbstract
This study explores students’ engagement with multimodal texts in the English learning activities at a senior high school in Yogyakarta. As digital technologies continue to reshape the educational landscape, students are increasingly immersed in diverse forms of texts that integrate written, visual, audio, and interactive elements during the subject. These multimodal texts require a broader set of literacy skills that go beyond traditional reading and writing. While such texts are becoming more common in 21st-century classrooms, especially in language learning environments, the ways in which students engage with them in practice remain insufficiently examined, particularly within the Indonesian English as foreign language context. This qualitative case study involved some classes of Grade XII students of Ali Maksum Islamic Senior High School and the English teacher as participants. The data were collected through classroom observations, student interviews, and document analysis of teaching materials. The findings revealed that students engage with multimodal texts in three key dimensions: cognitive (understanding content), behavioural (participation and task completion), and affective (interest and motivation). Visual, audio, and video-based texts and other interactive elements were found to enhance student interest, engagement, literacy and comprehension. The study highlights the importance of integrating multimodal literacy practices into English instruction to support students' active engagement and improve learning outcomes in 21st-century classrooms along with the required skills.
References
Agustina, D., & Cahyono, B. Y. (2017). Multimodal texts in Indonesian EFL classrooms: Teachers’ practices and challenges. Indonesian Journal of Applied Linguistics, 7(2), 283–291. https://doi.org/10.17509/ijal.v7i2.8350
Ajayi, L. (2009). English as a second language learners’ exploration of multimodal texts in a junior high school. Journal of Adolescent & Adult Literacy, 52(7), 585–595. https://doi.org/10.1598/JAAL.52.7.4
Borthwick, A., Hansen, R., Gray, L., & Ziemann, I. (2021). Deep learning for multimodal learning analytics: Potentials and challenges. Computers & Education: Artificial Intelligence, 2, 100027. https://doi.org/10.1016/j.caeai.2021.100027
Cholifatunisa, N., Aulia, R., Marlina, D., & Iskandar, A. (2025). Pengembangan Kurikulum Merdeka dengan pendekatan deep learning dalam meningkatkan kompetensi siswa sekolah dasar. Jurnal Pendidikan Dasar, 12(1), 45–56. https://ejournal.upi.edu/index.php/jppd/article/view/84240
Cope, B., & Kalantzis, M. (2009). “Multiliteracies”: New literacies, new learning. Pedagogies: An International Journal, 4(3), 164–195. https://doi.org/10.1080/15544800903076044
Cope, B., & Kalantzis, M. (2015). The things you do to know: An introduction to the pedagogy of multiliteracies. In A. Healy (Ed.), Multiliteracies and diversity in education: New pedagogies for expanding landscapes (pp. 1–36). Oxford University Press.
Dörnyei, Z. (2009). The psychology of second language acquisition. Oxford University Press.
Fredricks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004). School engagement: Potential of the concept, state of the evidence. Review of Educational Research, 74(1), 59–109. https://doi.org/10.3102/00346543074001059
Godwin-Jones, R. (2021). Emerging technologies: Digital literacies revisited. Language Learning & Technology, 25(3), 1–7. https://doi.org/10.10125/73410
Hafner, C. A. (2014). Embedding digital literacies in English language teaching: Students’ digital video projects as multimodal ensembles. TESOL Quarterly, 48(4), 655–685. https://doi.org/10.1002/tesq.138
Hapsari, I. I. (2021). Teachers’ perceptions and challenges in implementing multimodal literacy in Indonesian classrooms. Journal of English Language Teaching and Linguistics, 6(2), 349–361. https://doi.org/10.21462/jeltl.v6i2.542
Insani, N. H., Suwarna, & Triyono, S. (2024). Effect of multimodal literacy on reading ability of Indonesian Javanese learners. Issues in Language Studies, 13(1), 23–38. https://publisher.unimas.my/ojs/index.php/ILS/article/view/6472
Jewitt, C., Bezemer, J., & O’Halloran, K. (2016). Introducing multimodality. Routledge.
Kress, G., & van Leeuwen, T. (2001). Multimodal discourse: The modes and media of contemporary communication. Arnold.
Kusumaningrum, S. R., Utami, T. S., & Wulandari, S. (2024). Multimodal texts implementation in Indonesian primary and secondary EFL classrooms: Prospects and challenges. Jurnal Pendidikan Progresif, 14(1), 1–15. https://jurnal.fkip.unila.ac.id/index.php/jpp/article/view/31676
Li, X., Chen, Y., & Zhang, H. (2022). Multimodal deep learning for educational applications: A systematic review. Educational Technology Research and Development, 70(4), 1503–1525. https://doi.org/10.1007/s11423-022-10123-y
Luckin, R. (2022). Machine learning and artificial intelligence in education: Promises and pitfalls. British Journal of Educational Technology, 53(6), 1341–1356. https://doi.org/10.1111/bjet.13217
Mercer, S., & Dörnyei, Z. (2020). Engaging language learners in contemporary classrooms. Cambridge University Press.
Mills, K. A. (2016). Literacy theories for the digital age: Social, critical, multimodal, spatial, material and sensory lenses. Multimodal Literacies and Emerging Genres, 32(2), 214–229. https://doi.org/10.1080/15427587.2016.1141143
New London Group. (1996). A pedagogy of multiliteracies: Designing social futures. Harvard Educational Review, 66(1), 60–92. https://doi.org/10.17763/haer.66.1.17370n67v22j160u
Philp, J., & Duchesne, S. (2016). Exploring engagement in tasks in the language classroom. Annual Review of Applied Linguistics, 36, 50–72. https://doi.org/10.1017/S0267190515000094
Prensky, M. (2001). Digital natives, digital immigrants. On the Horizon, 9(5), 1–6. https://doi.org/10.1108/10748120110424816
Rowsell, J., & Walsh, M. (2011). Rethinking literacy education in new times: Multimodality, multiliteracies, & new literacies. Brock Education Journal, 21(1), 53–62. https://doi.org/10.26522/brocked.v21i1.236
Serafini, F. (2012). Expanding perspectives for comprehending visual images in multimodal texts. Journal of Adolescent & Adult Literacy, 54(5), 342–350. https://doi.org/10.1598/JAAL.54.5.4
Walsh, M. (2010). Multimodal literacy: What does it mean for classroom practice? Australian Journal of Language and Literacy, 33(3), 211–239.
Xu, J., Wang, Q., & Yang, L. (2023). Deep learning for multimodal educational data mining: Opportunities and challenges. Journal of Educational Computing Research, 61(2), 435–458. https://doi.org/10.1177/07356331221084722
Downloads
Published
How to Cite
Conference Proceedings Volume
Section
License
Copyright (c) 2026 Khusnul Harsul Lisan, Adhan Kholis, Ulul Azmi

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.









