¹Marzuki,²Inda Indrawati,³Ismail Yunus

^1,2,3,4English Language Education Study Program, Universitas Madako Tolitoli, Central Sulawesi, Indonesia

There has been a significant increase in the development of reading assessment methods by educators and researchers. However, very few of these assessments have been integrated into a Learning Management System (LMS) platform, with current LMS usage primarily focused on course content delivery. This research aims to address this gap by developing a comprehensive LMS-based reading test to measure students' reading competence. Additionally, the study seeks to explore students' perspectives on the use of the developed instrument. The development of the instrument followed a Research & Development (R&D) approach using the 4D model, which consists of defining, designing, developing, and disseminating stages. The participants of this study were undergraduate English as a Foreign Language (EFL) students from Universitas Madako Tolitoli. In total, 50 reading test items were successfully developed. Both validity and reliability tests were conducted: the validity test was performed by experts in the field and followed by a pilot test with a small sample of students. The results indicated that the test items were reliable, with a Cronbach's Alpha score of 0.75. However, 6 of the items (12%) were deemed to need improvement or were considered invalid, while the remaining 44 items (88%) were judged to be valid. Students' perceptions of the LMS-based reading test were generally positive across three aspects: usability and accessibility, engagement and motivation, and the impact of the LMS on language learning outcomes. In light of the limitations of the current study, suggestions for improvement were also provided. These will serve to guide future research in this area, with the aim of refining the LMS-based reading test and further enhancing its potential benefits for student learning.

Developing, LMS-based reading, EFL Students, Test.

1) Adeniran, A. O. (2019). Application of Likert scale’s type and Cronbach’s alpha analysis in an airport perception study. Scholar Journal of Applied Sciences and Research, 2(4), 1-5. http://innovationinfo.org/articles/SJASR/SJASR-4- 223.pdf

2) Al-Baihaqi, M. F. (2020). Developing Graded Reading Materials to Enhance Extensive Reading for Students of Senior High School. Lingua Pedagogia, 2(1), 47-60. https://doi.org/10.21831/lingped.v2i1.32966

3) Alkinani, E. A., & Alzahrani, A. I. (2021). Evaluating the usability and effectiveness of madrasati platforms as a learning management system in Saudi Arabia for public education. International Journal of Computer Science & Network Security, 21(6), 275-285. https://www.researchgate.net/profile/Edrees-Alkinani/publication/354695549_

4) Alneyadi, S., Abulibdeh, E., & Wardat, Y. (2023). The Impact of Digital Environment vs. Traditional Method on Literacy Skills; Reading and Writing of Emirati Fourth Graders. Sustainability, 15(4), 3418. https://doi.org/10.3390/su15043418

5) Alsaeedi, Z. S. A., Ngadiran, N. M., Kadir, Z. A., Altowayti, W. A. H., & Al-Rahmi, W. M. (2021). Reading habits and attitudes among university students: A review. Journal of Techno-Social, 13(1), 44-53. https://doi.org/10.30880/jts.2021.13.01.006

6) Berestova, A., Burdina, G., Lobuteva, L., & Lobuteva, A. (2022). Academic Motivation of University Students and the Factors That Influence It in an E-Learning Environment. Electronic Journal of e-Learning, 20(2), 201-210. https://eric.ed.gov/?id=EJ1333733

7) Boubris, A. A., & Haddam, F. (2020). Reading Assessment: A Case Study of Teachers' Beliefs and Classroom Evaluative Practices. Arab World English Journal, 11(4), 236-253. https://dx.doi.org/10.2139/ssrn.3764266

8) Dalman, D., Mardiana, M., Hesti, H., Luviadi, A., & Sulistiyono, R. (2021, September). Development of Reading Comprehension Ability Assessment for Students. In Proceedings of the 2nd Borobudur International Symposium on Humanities and Social Sciences, BIS-HSS 2020, 18 November 2020, Magelang, Central Java, Indonesia. https://doi.org/10.4108/eai.18-11-2020.2311721

9) Elmunsyah, H., Nafalski, A., Wibawa, A. P., & Dwiyanto, F. A. (2023). Understanding the Impact of a Learning Management System Using a Novel Modified DeLone and McLean Model. Education Sciences, 13(3), 235. https://doi.org/10.3390/educsci13030235

10) Hasim, M. A., Jabar, J., Sufian, A., & Ibrahim, N. F. (2022). Validating the Component of E-Learning Antecedents, Digital Readiness and Usage Behavior towards E-Learning Performance: A Pilot Study. International Journal of Learning, Teaching and Educational Research, 21(10), 178-194. https://www.researchgate.net/profile/Mohamad- Hasim/publication/364915305

11) Jokhan, A., Chand, A. A., Singh, V., & Mamun, K. A. (2022). Increased digital resource consumption in higher educational institutions and the artificial intelligence role in informing decisions related to student performance. Sustainability, 14(4), 2377. https://doi.org/10.3390/su14042377

12) Katsumata, M. (2022). Design Considerations for a Multiple Smart-Device-Based Personalized Learning Environment. Advances in Intelligent Systems Research and Innovation, 173-184. https://link.springer.com/chapter/10.1007/978-3-030-78124-8_8

13) Kimberley, E., & Thursby, M. (2020). Framing the text: Understanding emotional barriers to academic reading. Journal of University Teaching & Learning Practice, 17(2), 2. https://doi.org/10.53761/1.17.2.2

14) Kucher, T. (2021). Principles and Best Practices of Designing Digital Game-Based Learning Environments. International Journal of Technology in Education and Science, 5(2), 213-223. https://eric.ed.gov/?id=EJ1297914

15) Larmuseau, C., Desmet, P., & Depaepe, F. (2019). Perceptions of instructional quality: Impact on acceptance and use of an online learning environment. Interactive Learning Environments, 27(7), 953-964. https://doi.org/10.1080/10494820.2018.1509874

16) Main, S., & Slater, E. (2022). Online continuous professional learning: A model for improving reading outcomes in regional and remote schools?. Journal of Teacher Education, 73(2), 201-214. https://journals.sagepub.com/doi/pdf/10.1177/00224871211009110

17) Mintii, I. S., Shokaliuk, S. V., Vakaliuk, T. A., Mintii, M. M., & Soloviev, V. N. (2020). Import test questions into Moodle LMS. arXiv preprint arXiv:2010.15577. https://arxiv.org/abs/2010.15577

18) Nayahangan, L. J., Lawaetz, J., Strøm, M., de la Motte, L., Rørdam, P., Gottschalksen, B. C., ... & Rai, A. (2020). Ensuring competency in open aortic aneurysm repair–development and validation of a new assessment tool. European Journal of Vascular and Endovascular Surgery, 59(5), 767-774. https://doi.org/10.1016/j.ejvs.2020.01.021

19) Nejadghanbar, H., Atai, M. R., & Snow, C. (2022). Exploring the academic reading challenges of graduate students of applied linguistics. ibérica, (44), 315-344. https://doi.org/10.17398/2340-2784.44.315

20) Nguyen, N. T. (2021). A study on satisfaction of users towards learning management system at International University– Vietnam National University HCMC. Asia Pacific Management Review, 26(4), 186-196. https://doi.org/10.1016/j.apmrv.2021.02.001

21) Oetomo, T., Musyarofah, L., & Widodo, J. P. (2022). The use of LMS Moodle to Improve Reading Comprehension Skill for the 10th Grade Students. Jurnal Basicedu, 6(3), 3908-3917. https://dx.doi.org/10.31004/basicedu.v6i3.2652

22) Qadir, J., Taha, A. E. M., Yau, K. L. A., Ponciano, J., Hussain, S., Al-Fuqaha, A., & Imran, M. A. (2020). Leveraging the force of formative assessment & feedback for effective engineering education. https://eprints.gla.ac.uk/202106/

23) Rivers, D. J., Nakamura, M., & Vallance, M. (2022). Online self-regulated learning and achievement in the era of change. Journal of Educational Computing Research, 60(1), 104-131. https://journals.sagepub.com/doi/pdf/10.1177/07356331211025108

24) Sabila, N. F., Pahlevi, M. R., & Miftakh, F. (2020). Incorporating Edmodo As Learning Management System of Summative Assessment in Efl Classroom. Eltin Journal: Journal of English Language Teaching in Indonesia, 8(2), 132-145. http://e- journal.stkipsiliwangi.ac.id/index.php/eltin/article/view/1964

25) Saiyad, S., Virk, A., Mahajan, R., & Singh, T. (2020). Online teaching in medical training: Establishing good online teaching practices from cumulative experience. International Journal of Applied and Basic Medical Research, 10(3), 149. https://doi.org/10.4103%2Fijabmr.IJABMR_358_20

26) Shukla, T., Dosaya, D., Nirban, V. S., & Vavilala, M. P. (2020). Factors extraction of effective teaching-learning in online and conventional classrooms. International Journal of Information and Education Technology, 10(6), 422-427. http://www.ijiet.org/vol10/1401-OC3023.pdf

27) Stahl, K. A. D., Flanigan, K., & McKenna, M. C. (2019). Assessment for reading instruction. Guilford Publications. https://eric.ed.gov/?id=ED603562

28) Stenner, A. J. (2022). Measuring reading comprehension with the Lexile framework. In Explanatory Models, Unit Standards, and Personalized Learning in Educational Measurement: Selected Papers by A. Jackson Stenner (pp. 63-88). Singapore: Springer Nature Singapore. https://link.springer.com/chapter/10.1007/978-981-19-3747-7_6

29) Støle, H., Mangen, A., & Schwippert, K. (2020). Assessing children's reading comprehension on paper and screen: A mode- effect study. Computers & Education, 151, 103861. https://doi.org/10.1016/j.compedu.2020.103861

30) Sumardi, D., Suryani, N., & Musadad, A. A. (2021). Website-Based learning management system (LMS) as a tool for learning in the covid-19 pandemic period for junior high schools. Journal of Education Technology, 5(3), 346-355. https://doi.org/10.23887/jet.v5i3.38371

31) Sürücü, L., & MASLAKÇI, A. (2020). Validity and reliability in quantitative research. Business & Management Studies: An International Journal, 8(3), 2694-2726. https://doi.org/10.15295/bmij.v8i3.1540

32) Suzanne, N., & Rozimela, Y. (2020, August). Developing Reading Task Evaluation Rubric to Identify Target Tasks for Particular Readers: An Analyzing Stage. In Eighth International Conference on Languages and Arts (ICLA-2019) (pp. 54- 58). Atlantis Press. https://doi.org/10.2991/assehr.k.200819.011

33) Triswidrananta, O. D., Pramudhita, A. N., & Wijaya, I. D. (2022). Learning Management System Based on Assessment for Learning to Improve Computational Thinking. IJIM, 16(04), 151. https://doi.org/10.3991/ijim.v16i04.28979

34) Ustun, A. B., Karaoglan Yilmaz, F. G., & Yilmaz, R. (2021). Investigating the role of accepting learning management system on students’ engagement and sense of community in blended learning. Education and Information Technologies, 26(4), 4751-4769. https://link.springer.com/article/10.1007/s10639-021-10500-8

35) Vidhiasi, D. M. (2022). The Implementation of Reading Assessment Method. International Journal of English and Applied Linguistics (IJEAL), 2(1), 54-61. https://doi.org/10.47709/ijeal.v2i1.1426

36) Villesseche, J., Le Bohec, O., Quaireau, C., Nogues, J., Besnard, A. L., Oriez, S., ... & Lavandier, K. (2019). Enhancing reading skills through adaptive e-learning. Interactive Technology and Smart Education, 16(1), 2-17. https://doi.org/10.1108/ITSE- 07-2018-0047

37) Wisniewski, B., Zierer, K., & Hattie, J. (2020). The power of feedback revisited: A meta-analysis of educational feedback research. Frontiers in Psychology, 10, 3087. https://www.frontiersin.org/articles/10.3389/fpsyg.2019.03087/full

38) Yang, B., Mallett, S., Takwoingi, Y., Davenport, C. F., Hyde, C. J., Whiting, P. F., ... & QUADAS-C Group†. (2021). QUADAS- C: a tool for assessing risk of bias in comparative diagnostic accuracy studies. Annals of internal medicine, 174(11), 1592- 1599.

VOLUME 06 ISSUE 06 JUNE 2023

There is an Open Access article, distributed under the term of the Creative Commons Attribution – Non Commercial 4.0 International (CC BY-NC 4.0) (https://creativecommons.org/licenses/by-nc/4.0/), which permits remixing, adapting and building upon the work for non-commercial use, provided the original work is properly cited.