eprintid: 80020 rev_number: 9 eprint_status: archive userid: 1290 dir: disk0/00/08/00/20 datestamp: 2024-01-12 03:10:10 lastmod: 2024-01-12 03:10:10 status_changed: 2024-01-12 03:10:10 type: thesis metadata_visibility: show creators_name: Fajariyah, Laily amin creators_name: Madya, Suwarsih title: Mengembangkan Model Asesmen Bahasa Inggris Berdiferensiasi untuk Siswa Sekolah Menengah Pertama ispublished: pub subjects: D2 subjects: E4 divisions: pps_lit_evazdik full_text_status: restricted keywords: asesmen, bahasa Inggris, berdiferensiasi, penilaian, kemampuan berbicara, tes abstract: Penelitian ini bertujuan: (1) menganalisa kebutuhan guru dan siswa akan model asesmen berdiferensiasi dalam pembelajaran Bahasa Inggris, (2) menganalisa desain dan produk dari model DELA atau model penilaian pembelajaran bahasa Inggris yang berdiferensiasi untuk siswa sekolah menengah pertama (SMP), (3) menganalisa kualitas model DELA, dan (4) menyelidiki sejauh mana DELA diimplementasikan dan diterima guru dan siswa dalam pembelajaran Bahasa Inggris. Penelitian ini merupakan penelitian berbasis desain (DBR) yang terdiri dari sembilan siklus mikro dalam tiga siklus-meso yang terdiri dari: (1) siklus mikro 1 (analisis dan eksplorasi), (2) siklus mikro 2 (desain dan konstruksi), dan (3) siklus mikro 3 (evaluasi dan refleksi). Siklus mikro 4 sampai 9 merupakan pengulangan dari ketiga siklus mikro tersebut. Validasi isi instrumen dilakukan oleh tujuh orang ahli dan dianalisis menggunakan rumus Aiken yang hasilnya menunjukkan Indeks Aiken semua instrumen di atas 0,75 atau dikategorikan valid. Selanjutnya, bukti validitas konstruk instrumen diperoleh dengan menggunakan analisa faktor konfirmatori sedangkan estimasi reliabilitas diperoleh dengan menggunakan reliabilitas konstruk. Teori Respon Butir dengan 2PL dan 3 PL digunakan untuk menganalisis item instrumen Asesmen awal dan tes unit, sedangkan GRM digunakan untuk menganalisis item dalam tes kemampuan berbicara. Data kualitatif dianalisa dengan pendekatan Bogdan & Biklen (1982). Evaluasi model dilakukan dalam tiga kali implementasi model dengan melibatkan 10 SMP negeri yang mewakili lima daerah di Provinsi Daerah Istimewa Yogyakarta. Hasil penelitian ini adalah sebagai berikut. Baik guru maupun siswa membutuhkan model Penilaian Bahasa Inggris berdiferensiasi (DELA) untuk mengakomodasi berbagai kebutuhan siswa. Desain dan produk model DELA mengakomodasi keragaman siswa terutama dalam hal kesiapan belajar, minat, dan profil belajar melalui (a) penilaian awal, (b) penilaian yang sedang berlangsung, dan (c) penilaian sumatif. Produk model DELA dikategorikan baik dan valid menurut para ahli dan secara empiris, produk tersebut terbukti valid, reliabel, dan memiliki parameter item yang baik. Penerapan model Differentiated English Language Assessment (DELA) terbukti dapat meningkatkan pengetahuan dan keterampilan berbicara siswa dan baik guru maupun siswa setuju bahwa model ini baik. Model DELA dapat diimplementasikan di kelas. date: 2023-11-02 date_type: published institution: Sekolah Pascasarjana department: Penelitian dan Evaluasi Pendidikan thesis_type: disertasi referencetext: Alderson, J.C., Brunfaut, T., & Harding, L. (2017). Bridging assessment and learning: a view from second and foreign language assessment, Assessment in Education: Principles, Policy & Practice, 24:3, 379-387, DOI: 10.1080/0969594X.2017.1331201 Ali, H.I.H. (2015). Toward Differentiated Assessment in a Public College in Oman. English Language Teaching; Vol. 8, No. 12. http://dx.doi.org/10.5539/elt.v8n12p27 Andrich, D. (1978). Application of a psychometric rating model to ordered categories which are scored with succesive integers. Applied Psychological Measurement 2 (4):581–94. Arellano, M. D. C. (2013). Gender differences in reading comprehension achievement in English as a foreign language in Compulsory Secondary Education. Tejuelo, 17, 67–84. Bachman, L. F. (1990). Fundamental considerations in language testing. Oxford: Oxford University Press. Bachman, L. F., & Palmer, A. S. (1982). The construct validation of some components of communicative language proficiency. TESOL Quarterly, 16, 449–465. Bachman, L. F., & Palmer, A. S. (2010). Language Assessment in Practice. Oxford: Oxford University Press Bachman, L.F dan Palmer, A. (1982). The construct validation of some components of communicative proficiency. TESOL Quarterly, Vol. 16, No. 4, (Dec. 1982), pp. 449-465 http://www.jstor.org/stable/3586464?origin=JSTOR-pdf Baghaei P., & Grotjahn R. (2014). Establishing the construct validity of conversational C-Tests using a multidimensional item response model. Psychological Test and Assessment Modeling, 56(1), 60–82. Baird, J.A, Andrich.D., Hopfenbeck,T.H. & Stobart,G. (2017) Assessment and learning: fields apart?, Assessment in Education: Principles, Policy & Practice, 24:3, 317-350, DOI: 10.1080/0969594X.2017.1319337 Black, P. J., & Wiliam, D. (1998). Assessment and classroom learning. Assessment in Education: Principles, Policy and Practice, 5(1), 7–74. 300 Black, P., & Wiliam, D. (2009). Developing the theory of formative assessment. Educational Assessment, Evaluation and Accountability, 21(1), 5–31. Black, P., & Wiliam, D. (2018): Classroom assessment and pedagogy, Assessment in Education: Principles, Policy & Practice, DOI: 10.1080/0969594X.2018.1441807 Boud, D., and Falchikov, N. (2007). “Developing Assessment for Informing Judgment.” In Rethinking Assessment for Higher Education: Learning for the Longer Term, edited by D. Boud and N. Falchikov, 181–97. London: Routledge Brookhart, S. M. (2007). Expanding views about formative assessment: A review of the literature. In J. H. McMillan (Ed.), Formative classroom assessment: Theory into practice (pp. 43–62). New York, NY: Teachers College Press. Brookhart, S. M. (2010). Mixing it up: Combining sources of classroom achievement information for formative and summative purposes. In H. L. Andrade, & G. J. Cizek (Eds.)., Handbook of formative assessment (pp. 279–296). New York, NY: Routledge Brown, G. T. L. (2013). “Student Self-assessment.” In Sage Handbook of Research on Classroom Assessment, edited by J. H. McMillan, 367–93. Los Angeles, CA: Sage. Brown, G., Bull, J., & Pendlebury, M. (2013). Assessing student learning in higher education. Abingdon: Routledge. Brown, H. D. (2007). Principles of Language Learning and Teaching. USA: Longman Brown, H. D. (2010). Language Assessment. USA: Longman Brzezińska, J. (2018): Item response theory models in the measurement theory, Communications in Statistics - Simulation and Computation, DOI: 10.1080/03610918.2018.1546399 Butlera, Y.G. and Sakurai, C. (2020). Developing a Classroom-based Language Assessment of Japanese for Children Who Speak Minority Languages in Japan: The Dialogic Language Assessment. Language Assessment Quarterly https://doi.org/10.1080/15434303.2020.18264 Canale, M., & Swain, M. (1980). Theoretical bases for communicative approaches to language teaching and testing. Applied Linguistics, 1, 1–47. 301 Canale, M., & Swain, M. (1980). Theoretical bases for communicative approaches to language teaching and testing. Applied Linguistics, 1, 1–47. Canale, M., & Swain, M. (1981). From communicative competence to pedagogy. In J. Richards & R. Schmidt (Eds.), Language and communication (pp. 2–27). London: Longman. Carr, J. &Pauwels, A. (2006). Boys and Foreign Language Learning-Real Boys Don’t Do Languages. Milan: Palgrave. Celce-Murcia, M. (2007). Rethinking the role of communicative competence in language teaching. E. Alcón Soler and M.P. Safont Jordà (eds.), Intercultural Language Use and Language Learning, 41–57. Springer. Chapelle, C. A., & Voss, E. (2017). Utilizing technology in language assessment. In E. Shohamy & I. G. Or (Eds.), Encyclopedia of language and education (3rd ed., S. May (Ed.). Language testing and assessment pp. 149–161). Cham, Switzerland: Springer Science + Business Media LLCPaIn. Chapman, C., & King, R. (2012). Differentiated assessment strategies: One tool doesn't fit all. Thousand Oaks, Calif: Corwin Press. Collins, M. A., & Amabile, T. M. (1999). Motivation and creativity. In R. J. Sternberg (Ed.), Handbook of creativity (pp. 297–312). New York: Cambridge University Press. Csikszentmihalyi, M. (1990a). The domain of creativity. In M. A. Runco & R. S. Albert (Eds.), Theories of creativity (pp. 190–212). Newbury Park, CA: Sage Cumming, J. J., & Maxwell, G. S. (2004). Assessment in Australian Schools: Current practices and trends. Assessment in Education, 11, 89–108. Davies, A., and LeMahieu, P. (2003). “Assessment for Learning: Reconsidering Portfolios and Research Evidence.” In Optimising New Modes of Assessment: In Search of Qualities and Standards, edited by M. Segers, F. Dochy, and E. Cascallar, 141–69. Boston, MA: Kluwer Academic. Davison, C., & Leung, C. (2009). Current issues in English language teacher-based assessment. TESOL Quarterly, 43(3), 393–415. Dunlop, P. (2018). Differentiating Assessment in High School. BU Journal of Graduate Studies in Education, Volume 10, Issue 2 302 Earl, L. M. (2003). Assessment as learning: Using classroom assessment to maximize student learning. Thousand Oaks, CA: Corwin. Elsner, D. (2011). Developing multiliteracies, plurilingual awareness and critical thinking in the primary language classroom with multilingual virtual talkingbooks. Encuentro, 20, 27–38. Eysink, T.H. S. and Schildkamp, K. (2021). A conceptual framework for Assessment- Informed Differentiation (AID) in the classroom, Educational Research, 63:3, 261-278, DOI: 10.1080/00131881.2021.1942118 Farhady, H. (1983). New directions for ESL proficiency testing. In J. W. Oller, Jr. (Ed.), Issues in language testing research (pp. 253–269). Rowley, MA: Newbury House. Ferris, D., and Hedgcock, J. (2014). Teaching L2 Composition: Purpose, Process, and Practice. 3rd ed. New York: Routledge. Frost, K., Elder, C., & Wigglesworth, G. (2012). Investigating the validity of an integrated listening-speaking task: A discourse-based analysis of test takers’ oral performances. Language Testing, 29(3), 345–369. doi:10.1177/0265532211424479 Griess, C.J. and Keat, J.B. (2014). Practice What We Preach: Differentiating Instruction and Assessment in a Higher Education Classroom as a Model of Effective Pedagogy for Early Childhood Teacher Education Candidates, Journal of Early Childhood Teacher Education, 35:1, 98-109, DOI: 10.1080/10901027.2013.874381 Gu, L. (2014). Language ability of young English language learners: Definition, configuration, and implications. Language Testing, 32(1), 21–38. Hadi, S., Retnawati, H., and Nugraha, A.C. (2016). Vocational High School teachers’ difficulties in implementing the assessment in curriculum 2013 in Yogyakarta Province of Indonesia. International Journal of Instruction, January 2016 Vol.9, No.1 pp 33-48. Hartnell, B.J. (2016). The effects of standards-based grading and differentiated reassessment on the metacognition, motivation, and end of course assessments of 9th grade American history students. Masters Theses/Capstone Projects. 10. https://digitalcommons.otterbein.edu/stu_master/10 303 Herrington, J., McKenney, S., Reeves, T. C., & Oliver, R. (2007). Design-based research and doctoral students: Guidelines for preparing a dissertation proposal. Retrieved from www.editlib.org/d/25967/ proceeding_25967.pdf Hidetoshi Saito & Shin’ichi Inoi (2017) Junior and Senior High School EFL Teachers’ Use of Formative Assessment: A Mixed-Methods Study. Language Assessment Quarterly, 14:3, 213-233, DOI: 10.1080/15434303.2017.1351975 Holi Ibrahim Holi Ali. (2015). Toward Differentiated Assessment in a Public College in Oman. English Language Teaching; Vol. 8, No. 12; 2015. Huba, M. E., and Freed, J. E. (2000). Learner-Centred Assessment on College Campuses: Shifting the Focus from Teaching to Learning. Boston, MA: Allyn & Bacon. Kartowagiran, B and Jaedun, A. (2016). Model asesmen autentik untuk menilai hasil belajar siswa sekolah menengah pertama (SMP): implementasi asesmen autentik di SMP. Jurnal Penelitian dan Evaluasi Pendidikan Volume 20, No 2, Desember 2016 (131-141) retrieved from http://journal.uny.ac.id/index.php/jpep Kaur, A., Noman, M. & Awang-Hashim, R. (2018). Exploring and evaluating differentiated assessment practices of in-service teachers for components of differentiation, Teaching Education, DOI: 10.1080/10476210.2018.1455084 Kingston, N., & Nash, B. (2011). Formative assessment: A meta-analysis and a call for research. Educational Measurement: Issues and Practice, 30(4), 28–37. doi:10.1111/emip.2011.30.issue-4 Knocha, U., & Sitajalabhorn, W. (2013). A closer look at integrated writing tasks: Towards a more focused definition for assessment purposes. Assessing Writing, 18, 300–308. Koshy, S. (2013). Differentiated assessment activities: customising to support learning 2013, 37-50. https://ro.uow.edu.au/dubaipapers/549 Kress, G., & Van Leeuwen, T. V. (2001). Multimodal discourse: The modes and media of contemporary communication. London, UK: Arnold. Lado, R. (1961). Language testing. New York: McGraw-Hill. 304 Lam, R. (2015): Assessment as learning: examining a cycle of teaching, learning, and assessment of writing in the portfolio-based classroom, Studies in Higher Education, DOI: 10.1080/03075079.2014.999317 Lee, H. W. (2015). Innovative assessment tasks for academic English proficiency: An integrated listening-speaking task vs. a multimediamediated speaking task (Graduate Theses and Dissertations. 14584). Retrieved from https://lib.dr.iastate.edu/etd/14584 Levine, T & Inbar-Lourie. (2020). Assessment literacy or language assessment Literacy: learning from the teachers. Language Assessment Quarterly 2020, VOL. 17, NO. 2, 168–182 https://doi.org/10.1080/15434303.2019.1692347 Lopez, A. A., Turkan, S., & Guzman-Orth, D. (2017). Assessing multilingual competence. In E. Shohamy (Ed.), Encyclopedia of language and education (S. May (Ed.). Volume on language assessment pp. 91–102). Cham, Switzerland: Springer Science + Business Media LLCPages. Lopriore, L. (2018). Reframing teaching knowledge in Content and Language Integrated Learning (CLIL): A European perspective. Language Teaching Research, 136216881877751. doi:10.1177/1362168818777518) Lord, F. M., and M. R. Novick. (1968). Statistical theories of mental test scores. Reading, MA: Addison-Wesley. Luoma, S. (2004). Assessing speaking. New York: Cambridge University Press. Macaro, E., Curle, S., Pun, J., An, J., & Dearden, J. (2018). A systematic review of english-medium instruction in higher education. Language Teaching, 51(1), 36–76. doi:10.1017/S0261444817000350 Madya, S. (2007). Searching for an appropriate EFL curriculum design for the Indonesian pluralistic society. TEFLIN Journal, Volume 18, Number 2, August 2007 pp 196-221. Mafenya, P.N. (2016) A Study of Students’ Experiences of Formative and Summative Assessment in Open Distance Learning: Insights from Meta-synthesis, International Journal of Educational Sciences, 15:3, 529-537, DOI: 10.1080/09751122.2016.11890563 McKenney, S., & Reeves, T. C. (2012). Conducting educational design research. London: Routledge. 305 Moon, T., Tomlinson, C., & Callahan, C. (1995). Academic diversity in the middle school: Results of a national survey of middle school administrators and teachers (Research Monograph 95124). Charlottesville: National Research Center on the Gifted and Talented, University of Virginia. Morrow, K. (1979). Communicative language testing: Revolution or evolution? In C. J. Brumfit & K. Johnson (Eds.), The communicative approach to language teaching. Oxford: Oxford University Press. New South Wales Board of Studies, Teaching and Educational Standards. (2012). Assessment for, of, and as learning. Retrieved from https://syllabus.bostes.nsw.edu.au/support-materials/ssment-for-as-and-of- learning/ Noman, M. and Kaur, A. (2014). Differentiated Assessment: A New Paradigm in Assessment Practices for Diverse Learners. International Journal of Education and Applied Sciences Volume 1, Number 4, 167-174, September 2014. Oller, J. W. (Ed.). (1983). Issues in language testing research. Rowely, MA: Newbury House. Paul, J and Laubscher, D. (2016). Design-based research: is this a suitable methodology for short-term projects? Educational Media International, 53:1, 42-52, DOI: 10.1080/09523987.2016.1189246 Permendikbud No 14 Year 2018 tentang Penerimaan Peserta Didik Baru pada Taman Kanak-Kanak, Sekolah Dasar, Sekolah Menengah Pertama, Sekolah Menengah Atas, Sekolah Menengah Kejuruan, atau Bentuk Lain yang Sederajat Permendiknas No 70 Year 2009 tentang Pendidikan Inklusif bagi Peserta Didik yang Memiliki Kelainan dan Memiliki Potensi Kecerdasan dan/atau Bakat Istimewa Plakans, L., & Gebril, A. (2012). A close investigation of source use in integrated writing tasks. Assessing Writing Journal, 17(1), 18–34. doi:10.1016/j.asw.2011.09.002 Poehner, M. E. (2013). Dynamic assessment in the classroom. In A. J. Kunnan (Ed.), The Companion to Language Assessment. doi:10.1002/9781118411360.wbcla033. 306 Puad, L.M.A.Z. & Ashton, K. (2020): Teachers’ views on classroom-based assessment: an exploratory study at an Islamic boarding school in Indonesia, Asia Pacific Journal of Education, DOI: 10.1080/02188791.2020.1761775 Purpura, J. E. (2016). Second and foreign language assessment. The Modern Language Journal, 100(S1), 190–206. doi:10.1111/modl.12308 Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Copenhagen, Danish Institute for Educational Research. Chicago: The University of Chicago Press. Reeves, T. C. (2006). Design research from a technology perspective. In J. van den Akker, K. Gravemeijer, S. McMcKenney, & N. Nieeven (Eds.), Educational design research (pp. 86–109). London: Routledge. Sawaki, Y., Stricker, L. J., & Oranje, A. H. (2009). Factor structure of the TOEFL internet-based test. Language Testing, 26(1), 5–30. Reisdorfer, C. (2020). Differentiated Assessments in a Social Studies Middle School Class. School of Education and Leadership Student Capstone Projects. 451. https://digitalcommons.hamline.edu/hse_cp/451 Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika Monograph Supplement 34 (4):Part 2. Spolsky, B. (1985). The limits of authenticity in language testing. Language Testing, 2(1), 31–40. Stiggins, R. J. (2010). Essential formative assessment competencies for teachers and school leaders. In H. L. Andrade, & G. J. Cizek (Eds.), Handbook of formative assessment (pp. 233–250). New York, NY: Routledge. Sudiyanto, Kartowagiran, B, and Muhyadi. (2015). Pengembangan model assessment as learning pembelajaran akuntansi di SMK. Jurnal Penelitian dan Evaluasi Pendidikan Volume 19, No 2, Desember 2015 (189-201) Tersedia Online: http://journal.uny.ac.id/index.php/jpep Taylor, L., & Weir, C. J. (2012). IELTS collected papers 2: Research in reading and listening assessment. Cambridge, UK: CUP. Tomlinson, C. A., & Moon, T. R. (2013). Assessment and student success in a differentiated classroom. Alexandria, Va.: ASCD. Tomlinson, C. A., & Imbeau, M. B. (2010). Leading and Managing a Differentiated 307 Classroom. Alexandria, VA ASCD Tomlinson, C.A. (2005). Grading and Differentiation: Paradox or Good Practice? Theory into Practice, Summer 2005; 44, 3 Turner, C. E., & Purpura, J. E. (2016). Learning-oriented assessment in second and foreign language classrooms. In D. Tsagari & J. Baneerjee (Eds.), Handbook of second language assessment (pp. 255–272). Boston, MA: De Gruyter,Inc. Varsavsky,C. and Rayner, G. (2013). Strategies that challenge: exploring the use of differentiated assessment to challenge high-achieving students in large enrolment Undergraduate cohorts. Assessment & Evaluation in Higher Education, 2013 Vol. 38, No. 7, 789–802, http://dx.doi.org/10.1080/02602938.2012.714739 Wang, F., & Hannafin, M. J. (2005). Design-based research and technology-enhanced learning environments. Educational Technology Research and Development, 53, 5–23 White, E. M. (2005). “The Scoring of Writing Portfolios: Phase 2.” College Composition and Communication. 56 (4): 581–99. Widdowson, H. G. (1978). Teaching language as communication. Oxford: Oxford University Press. Widdowson, H. G. (2000). On the limitations of linguistics applied. Applied Linguistics, 21, 3–25. Zaki, R. 2017. Validation of Instrument Measuring Continuous Variable, Advances in Statistical Methodologies and Their Application to Real Problems. Intech open Science. pp : 217-237. citation: Fajariyah, Laily amin and Madya, Suwarsih (2023) Mengembangkan Model Asesmen Bahasa Inggris Berdiferensiasi untuk Siswa Sekolah Menengah Pertama. S3 thesis, Sekolah Pascasarjana. document_url: http://eprints.uny.ac.id/80020/1/disertasi-laily%20amin%20fajariyah-19701261019.pdf