Exploring Students’ Engagement with Multimodal Texts in English Learning Activities

Authors

  • Khusnul Harsul Lisan Universitas Nahdlatul Ulama Yogyakarta
  • Adhan Kholis Universitas Nahdlatul Ulama Yogyakarta
  • Ulul Azmi Universitas Nahdlatul Ulama Yogyakarta

Keywords:

Students engagement, multimodal text, English subject

Abstract

This study explores students’ engagement with multimodal texts in the English learning activities at a senior high school in Yogyakarta. As digital technologies continue to reshape the educational landscape, students are increasingly immersed in diverse forms of texts that integrate written, visual, audio, and interactive elements during the subject. These multimodal texts require a broader set of literacy skills that go beyond traditional reading and writing. While such texts are becoming more common in 21st-century classrooms, especially in language learning environments, the ways in which students engage with them in practice remain insufficiently examined, particularly within the Indonesian English as foreign language context. This qualitative case study involved some classes of Grade XII students of Ali Maksum Islamic Senior High School and the English teacher as participants. The data were collected through classroom observations, student interviews, and document analysis of teaching materials. The findings revealed that students engage with multimodal texts in three key dimensions: cognitive (understanding content), behavioural (participation and task completion), and affective (interest and motivation). Visual, audio, and video-based texts and other interactive elements were found to enhance student interest, engagement, literacy and comprehension. The study highlights the importance of integrating multimodal literacy practices into English instruction to support students' active engagement and improve learning outcomes in 21st-century classrooms along with the required skills.

References

Agustina, D., & Cahyono, B. Y. (2017). Multimodal texts in Indonesian EFL classrooms: Teachers’ practices and challenges. Indonesian Journal of Applied Linguistics, 7(2), 283–291. https://doi.org/10.17509/ijal.v7i2.8350

Ajayi, L. (2009). English as a second language learners’ exploration of multimodal texts in a junior high school. Journal of Adolescent & Adult Literacy, 52(7), 585–595. https://doi.org/10.1598/JAAL.52.7.4

Borthwick, A., Hansen, R., Gray, L., & Ziemann, I. (2021). Deep learning for multimodal learning analytics: Potentials and challenges. Computers & Education: Artificial Intelligence, 2, 100027. https://doi.org/10.1016/j.caeai.2021.100027

Cholifatunisa, N., Aulia, R., Marlina, D., & Iskandar, A. (2025). Pengembangan Kurikulum Merdeka dengan pendekatan deep learning dalam meningkatkan kompetensi siswa sekolah dasar. Jurnal Pendidikan Dasar, 12(1), 45–56. https://ejournal.upi.edu/index.php/jppd/article/view/84240

Cope, B., & Kalantzis, M. (2009). “Multiliteracies”: New literacies, new learning. Pedagogies: An International Journal, 4(3), 164–195. https://doi.org/10.1080/15544800903076044

Cope, B., & Kalantzis, M. (2015). The things you do to know: An introduction to the pedagogy of multiliteracies. In A. Healy (Ed.), Multiliteracies and diversity in education: New pedagogies for expanding landscapes (pp. 1–36). Oxford University Press.

Dörnyei, Z. (2009). The psychology of second language acquisition. Oxford University Press.

Fredricks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004). School engagement: Potential of the concept, state of the evidence. Review of Educational Research, 74(1), 59–109. https://doi.org/10.3102/00346543074001059

Godwin-Jones, R. (2021). Emerging technologies: Digital literacies revisited. Language Learning & Technology, 25(3), 1–7. https://doi.org/10.10125/73410

Hafner, C. A. (2014). Embedding digital literacies in English language teaching: Students’ digital video projects as multimodal ensembles. TESOL Quarterly, 48(4), 655–685. https://doi.org/10.1002/tesq.138

Hapsari, I. I. (2021). Teachers’ perceptions and challenges in implementing multimodal literacy in Indonesian classrooms. Journal of English Language Teaching and Linguistics, 6(2), 349–361. https://doi.org/10.21462/jeltl.v6i2.542

Insani, N. H., Suwarna, & Triyono, S. (2024). Effect of multimodal literacy on reading ability of Indonesian Javanese learners. Issues in Language Studies, 13(1), 23–38. https://publisher.unimas.my/ojs/index.php/ILS/article/view/6472

Jewitt, C., Bezemer, J., & O’Halloran, K. (2016). Introducing multimodality. Routledge.

Kress, G., & van Leeuwen, T. (2001). Multimodal discourse: The modes and media of contemporary communication. Arnold.

Kusumaningrum, S. R., Utami, T. S., & Wulandari, S. (2024). Multimodal texts implementation in Indonesian primary and secondary EFL classrooms: Prospects and challenges. Jurnal Pendidikan Progresif, 14(1), 1–15. https://jurnal.fkip.unila.ac.id/index.php/jpp/article/view/31676

Li, X., Chen, Y., & Zhang, H. (2022). Multimodal deep learning for educational applications: A systematic review. Educational Technology Research and Development, 70(4), 1503–1525. https://doi.org/10.1007/s11423-022-10123-y

Luckin, R. (2022). Machine learning and artificial intelligence in education: Promises and pitfalls. British Journal of Educational Technology, 53(6), 1341–1356. https://doi.org/10.1111/bjet.13217

Mercer, S., & Dörnyei, Z. (2020). Engaging language learners in contemporary classrooms. Cambridge University Press.

Mills, K. A. (2016). Literacy theories for the digital age: Social, critical, multimodal, spatial, material and sensory lenses. Multimodal Literacies and Emerging Genres, 32(2), 214–229. https://doi.org/10.1080/15427587.2016.1141143

New London Group. (1996). A pedagogy of multiliteracies: Designing social futures. Harvard Educational Review, 66(1), 60–92. https://doi.org/10.17763/haer.66.1.17370n67v22j160u

Philp, J., & Duchesne, S. (2016). Exploring engagement in tasks in the language classroom. Annual Review of Applied Linguistics, 36, 50–72. https://doi.org/10.1017/S0267190515000094

Prensky, M. (2001). Digital natives, digital immigrants. On the Horizon, 9(5), 1–6. https://doi.org/10.1108/10748120110424816

Rowsell, J., & Walsh, M. (2011). Rethinking literacy education in new times: Multimodality, multiliteracies, & new literacies. Brock Education Journal, 21(1), 53–62. https://doi.org/10.26522/brocked.v21i1.236

Serafini, F. (2012). Expanding perspectives for comprehending visual images in multimodal texts. Journal of Adolescent & Adult Literacy, 54(5), 342–350. https://doi.org/10.1598/JAAL.54.5.4

Walsh, M. (2010). Multimodal literacy: What does it mean for classroom practice? Australian Journal of Language and Literacy, 33(3), 211–239.

Xu, J., Wang, Q., & Yang, L. (2023). Deep learning for multimodal educational data mining: Opportunities and challenges. Journal of Educational Computing Research, 61(2), 435–458. https://doi.org/10.1177/07356331221084722

Downloads

Published

2025-12-29

How to Cite

Lisan, K. H., Kholis, A., & Azmi, U. (2025). Exploring Students’ Engagement with Multimodal Texts in English Learning Activities. Proceedings of Forum for University Scholars in Interdisciplinary Opportunities and Networking, 1(1), 1–8. Retrieved from https://conference.ut.ac.id/index.php/fusion/article/view/6836

Conference Proceedings Volume

Section

Articles

Similar Articles

1 2 3 4 > >> 

You may also start an advanced similarity search for this article.