eprintid: 82755 rev_number: 9 eprint_status: archive userid: 1290 dir: disk0/00/08/27/55 datestamp: 2024-07-29 04:04:07 lastmod: 2024-07-29 04:04:07 status_changed: 2024-07-29 04:04:07 type: thesis metadata_visibility: show creators_name: Ayub, Made Rai Suci Shanti Nurani creators_name: Munadi, Sudji title: Pengembangan Tes Four Tier Untuk Mengukur Kemampuan Berpikir Tingkat Tinggi Mahasiswa Menurut Taksonomi Structure of the Observed Learning Outcome (SOLO). ispublished: pub subjects: D0 subjects: D4 divisions: pps_lit_evazdik full_text_status: restricted keywords: fourtier test, kemampuan berpikir tingkat tinggi, SOLO taksonomi abstract: Penelitian disertasi ini bertujuan untuk: (1) mengembangkan soal four tier test HOTS fisika (PhysHOT4T2), (2) menguji kualitas PhysHOT4T2 serta (3) memotret kemampuan berpikir tingkat tinggi mahasiswa Instrumen tes dikembangkan menggunakan penelitian model pengembangan Research and Development dengan pendekatan kuantitatif, model Wilson, Oriondo dan Antonio dengan mengacu pada keterbaruan empiris Paul Irving yang meliputi tahapan yaitu: (1) perancangan tes, (2) validasi, (3) uji coba, (4) analisa reliabilitas dan (5) interpretasi. Tes dirancang dalam dua paket A dan B, dengan masing-masing paket berisi 30 soal dengan soal anchor 10% dengan model soal HOT four tier test menurut taksonomi structure of observe learning outcome (SOLO). Validasi soal PhysHOT4T2 dilakukan oleh 5 orang ahli yang terdiri dari ahli media, penilaian dan materi. Tahap uji coba dilakukan pada responden, dengan rincian paket A 170 responden, paket B 120 responden. Analisa reliabilitas dilakukan dari hasil uji coba tes skala luas, yang diberikan kepada 187 responden paket A dan 168 paket B dilanjutkan dengan interpretasi. Tehnik analisi dilakukan pada pendekatan teori klasik dan teori modern Analisis respon butir menggunakan Partial Credit Model (PCM) menggunakan model penskorean politomus dilakukan dengan program R. Interpretasi data dilakukan dengan melihat kemampuan responden dan mengklusterkan menggunakan program JASP. Hasil penelitian sebagai berikut: (1) soal PhysHOT4T2 menurut SOLO taksonomi dikembangkan dengan manifest mengaplikasikan, menganalisa, dan mengintegrasikan untuk mengukur level reliasional, sedangkan mengeneralisasi dan menciptakan teori baru untuk mengukur level kemampuan extended abstract. (2) kualitas PhysHOT4T2 dikatakan baik dengan dibuktikan dari hasil validitas isi, konstruk yang tepat dengan model yang dibuat dan nilai realibilitas diatas 0,7. Rentang kesulitan butir berada pada -2,00 sampai dengan 2,00. (3) Potret kemampuan responden digambarkan sebagai beikut; 1,2% mempunyai kemampuan tinggi, 98,8 % mempunyai kemampuan sedang. Selain itu 88% responden memiliki kemampuan berpikir HOT level rasional dan 12 % yang mempunyai kemampuan berpikir HOT level extended abstrack. Kesimpulan didapatkan bahwa instrumen PhysHOT4T2 dapat mengukur kemampuan berpikir tingkat tinggi Fisika menurut taksonomi SOLO dengan tepat. date: 2024-03-19 date_type: published institution: Sekolah Program Pascasarjana department: Penelitian dan Evaluasi Pendidikan thesis_type: disertasi referencetext: Abosalem Y. (2016). Assessment Techniques and Students’ Higher-Order Thinking Skills. International Journal of Secondary Education. Vol. 4, No. 1, 2016, pp. 1- 11. doi: 10.11648/j.ijsedu.20160401.11 Aiken, L.R. (1980). Content validity and reliability of single items or questionnaires. Educational and Psychological Measurement, 40, hlm. 955-959. Airasian, R., Michael R., (2011), Classroom Assessment: Concepts and Applications, Library of Congress Cataloging in Publication Data. Al-A’ali, M. (2007). Implementation of an improved adaptive testing theory. Educational Technology dan Society. 10 (4). pp. 80-94. Allen M. J , W. M. Yen, 2001, Introduction to measurement theory, Waveland Persse ed. Ananiadou, K. and M. Claro (2009), 21st Century Skills and Competences for New Millennium Learners in OECD Countries”, OECD Education Working Papers, No. 41, Penerbit OECD http://dx.doi.org/10.1787/218525261154 Anderson C, Palm T, 2017, The impact of formative assessment on student achievement: A study of the effects of changes to classroom practice after a comprehensive professional development programme , Jurnal Learning and Instruction vol 49 , p 92-102 Andersons dkk (2001) New cognitive domain: Based upon R. http://oregonstate.edu/instruct/coursedev/models/id/taxonomy/#table H. Dave, as reported in R. J. Armstrong dkk., Developing and Writing Behavioural Objectives (Tucson, AZ: Educational Innovators Press, 1970) 166 Ariel, A., Linden, W.J., dan Veldkamp, B.P. (2006). A Strategi for Optimizing Item- Pool Management. Journal of Educational Measurement. 2, 85 – 96. Aris, J., Wulandari, D., Arifin, S., Soetanto, H., Kusumawardani, S. S., Wastutiningsih, S. P., Utama, M. S., Cahyono, Edy, & Hertono, G. F. (2023). PANDUAN PENYUSUNAN KURIKULUM PENDIDIKAN TINGGI DI ERA INDUSTRI 4.0 UNTUK MENDUKUNG MERDEKA BELAJAR - KAMPUS MERDEKA (S. S. Kusumawardani (ed.); IV). Direktorat Jenderal Pendidikan Tinggi Kementerian Pendidikan dan Kebudayaan. https://dikti.kemdikbud.go.id/ Assessment & Outcomes Based Education Handbook Tempus MED @ UP Dr Cathal Butler , University of Bedfordshire . (Issue January). (2018). Atherton, J. S. (2005) Learning and Teaching: SOLO taxonomy [On‐line] UK: Available: http://www.learningandteaching.info/learning/solo.htm Accessed: 17 February 200 Ayub M.R.S.S, Sutresno A., 2014, Pembuatan Media Pembelajaran Pengukuran Viskositas dengan Menggunakan Viskometer Dua Kumparan dan Freewave3, Jurnal Pendidikan Fisika unnes., Vol 10 no 1, ISSN 1693-1246, Azhar Arsyad, 1997, Media Pengajaran , RajaGrafindo Persada, Jakarta , 1997, edisi 3. Azwar, S. (2003).Tes prestasi: Fungsi dan pengembangan pengukuran prestasi belajar.Yogyakarta:Pustaka Pelajar. Baby, A., & Kannammal, A. (2020). Network Path Analysis for developing an enhanced TAM model: A user-centric e-learning perspective. Computers in Human Behavior, 107(July), 106081. https://doi.org/10.1016/j.chb.2019.07.024 167 Bagus, H.C. (2009). Capaian adaptif terkomputerisasi (CAT). Makalah Seminar Mutu Pendidikan Dasar dan Menengah Hasil Penelitian Puspendik. Jakarta : Badan Penelitian dan Pengembangan Departemen Pendidikan Nasional Baker, F.B. (1992). Item response theory: Parameter estimation techniques. New York: Marcel Dekker, Inc. Baxter, D; Dudley, D. (2007). Assessing For Deeper Understanding in Tertiary Examinations in Physical Education Using A SOLO Taxonomy. 1976, 1–9. Biggs, J., & Collis, K. (1989). Towards a Model of School-based Curriculum Development and Assessment Using the SOLO Taxonomy. Australian Journal of Education, 33(2), 151–163. https://doi.org/10.1177/168781408903300205 Biggs, J. (1999) Teaching for Quality Learning at University: What the Student Does, Buckingham: The Society for Research into Higher Education and Open University Press. Biggs, J. (1999) What the Student Does: teaching for enhanced learning. Higher Education Research dan Development,18 (1) 57—75 (available in UCD through Academic Search Premier database) Biggs, J. B. and Collis, K. (1982) Evaluating the Quality of Learning: the SOLO taxonomy. New York, Academic Press Biggs, J., & Tang, C. (2007). Teaching for quality learning at university. What the student does (3rd Ed.). Berkshire: Society for Research into Higher Education & Open University Press. Bloom, B. (ed.) (1956) Taxonomy of Educational Objectives, the classification of educational goals – Handbook I: Cognitive Domain New York: McKay Brabrand, C., & Dahl, B. (2009). Using the SOLO model to analyze competence progression of university science curricula. Higher Education, 58(4), 531-549. 168 Brent Bridgeman and Frederick Cline, 2004, Effects of Differentially Time- Consuming Tests on Computer-Adaptive Test Scores, Journal of Educational Measurment, Vol 41, no 2 Bock, R.D. dan Aitken, M. (1981). Marginal maximum likehood estimation of item parameters: Application of an EM algorithm. Psychometrika, 4, 443-459 Elena Silva, 2015, Measuring Skills for 21st-Century Learning, research article from Phi Delta Kappa Univ of Connectitut Çelikkanlı, N. Ö., & Kızılcık, H. Ş. (2022). A Review of Studies About Four-Tier Diagnostic Tests in Physics Education. Journal of Turkish Science Education, 19(4). https://doi.org/10.36681/tused.2022.175 Chan, C. C., Tsui, M. S., Chan, M. Y. C., & Hong, J. H. (2002). Applying the structure of the observed learning outcomes (SOLO) taxonomy on student’s learning outcomes: An empirical study. In Assessment and Evaluation in Higher Education (Vol. 27, Issue 6). https://doi.org/10.1080/0260293022000020282 Cheung, K. L., & Yang, D. C. (2018). Examining the differences of Hong Kong and Taiwan students’ performance on the number sense three-tier test. Eurasia Journal of Mathematics, Science and Technology Education, 14(7). https://doi.org/10.29333/ejmste/91682 Chiappetta, E. L., & Koballa, T. (2010). Chapter-7_Chiappetta-Koballa_2016.pdf (p. 118). Allynannd Bacon Inc. Christopher B. Reznich, PhD. (2011).Handbook of Learner Evaluation dan Test Item Construction.Michigan State University Board of Trustees and OMERAD Crespo, R. M., Najjar, J., Derntl, M., Leony, D., Neumann, S., Oberhuemer, P., ... Kloos, C. D. (2010). Aligning assessment with learning outcomes in outcome- 169 based education. IEEE EDUCON 2010 Conference, The future of Global Learning Engginering, 1239–1246. https://doi.org/doi:10.1109/educon.2010.5492385No Dagdag, J. D., & Cardona, R. S. (2018). Perspectives and Practices on Outcomes- Based Assessment (OBA) among College Mathematics Educators in Northeastern Luzon Philippines. Asia Pacific Journal of Multidisciplinary Research, 6(2). Dewi, R.A., Sudjito, D.N., dan Ayub, M.R.S.S.N. (2016).Desain Media Pembelajaran Menggunakan Permainan Fun Frame in Physics pada Pokok Bahasan Cermin Cekung Melalui Turnamen.Prosiding Seminar Nasional Quantum 2016, Program Studi Pendidikan Fisika, Fakultas Keguruan dan Ilmu Pendidikan, Universitas Ahmad DahlanDIY. Dewey, J. (1933). How we think: A restatement of the relation of reflective thinking to the educative process. Boston: D.C. Heath and Company. Didin Sonmez, F., Cuhadar, S., & Kahvecioglu, M. K. (2021). Successes, challenges, and next steps in implementing outcome-based assessment: The case of Istanbul Bilgi University Library. Journal of Academic Librarianship, 47(1). https://doi.org/10.1016/j.acalib.2020.102249 Dr. Preeti Oza, D. G. P. J. (2021). Curriculum and Evaluation in Outcome-Based Education. Psychology and Education Journal, 58(2). https://doi.org/10.17762/pae.v58i2.2982 Edi Istiyono, 2016, APPLICATION OF BLOOMIAN AND MARZANOIAN HIGHER ORDER THINKING SKILLS IN THE PHYSICS LEARNING ASSESSMENT: AN INEVITABILITY, Advances in Social Science, Education and Humanities Research, volume 164 170 Fariyani, Q., Rusilowati, A., & Sugianto, S. (2017). Four-Tier Diagnostic Test to Identify Misconceptions in Geometrical Optics. Unnes Science Education Journal, 6(3). Gago, J. M. dkk. (2004), Europe Needs More Scientists, European Community Conference Increasing Human Resources for Science, Publications of the European Communities, ISBN 92-894-8458-6, p 7-45 and Technology, European Commission, Brussels, Belgium. Gagne R.M., 1970, The condition of learning, Holt, Rinehart and Winston, Inc, United State America. Ghozali, Imam. 2006. Aplikasi Analisis Multivariate dengan Program SPSS (Edisi Ke 4). Semarang:Badan Penerbit Universitas Diponegoro. Gronlund (2009).Measurenment and Assesment In Teaching. Pearson Education. New Jersey Gutiérrez, A. F., Moreno, P. A. O., & Adarme, M. E. C. (2020). Evidence of the development of higher order thinking in university professors, from test formulated according to SOLO taxonomy. Revista Electronica Interuniversitaria de Formacion Del Profesorado, 23(3). https://doi.org/10.6018/REIFOP.434961 Hadjichambis, A. C., & Paraskeva-Hadjichambi, D. (2020). Environmental citizenship questionnaire (ECQ): The development and validation of an evaluation instrumen for secondary school students. Sustainability (Switzerland), 12(3). https://doi.org/10.3390/SU12030821 Halimah, H., Untu, Z., & Suriaty, S. (2020). Analisis Kemampuan Pemecahan Masalah Matematika Berdasarkan Taksonomi Structure of Observed Learning Outcomes (SOLO). Primatika : Jurnal Pendidikan Matematika, 9(1). 171 https://doi.org/10.30872/primatika.v9i1.245 Hansson, J. (2015). The 10 Biggest Unsolved Problems in Physics. International Journal of Modern Physics and Applications, 1(1), 12–16. http://www.publicscienceframework.org/journal/ijmpa Haryanto. (2020). Evaluasi pembelajaran; konsep dan manajemen. In UNY Press. Hidayat A. R., 2019, The Analysis of Higher Order Thingking Skill Implementation in English Reading Textbook, Journal of Research on Applied Linguistics Language and Language Teaching, Vol. 2, No. 1, p1 – 7 Hundleby, J. D., & Nunnally, J. (1968). Psychometric Theory. American Educational Research Journal, 5(3), 431. https://doi.org/10.2307/1161962 Hunt A., F.Walton, S. Martin, M. Haigh, E. Irving, 2015, Moving a school: Higher order thinking through SOLO and e-Learning, Teaching and Learning, Summary Reaserch Initiative. FOR THE FIFTH H. M. Abi,2016, Pengembangan Instrumen Penilaian Hasil Belajar Siswa Berbasis TIK Pada Pembelajaran Dasar Listrik Elektronika, VOLT -Jurnal Ilmiah Pendidikan Teknik Elektro vol 1 no 1 hal 37-46 Universitas Sultan Ageng Tirtayasa, Serang, Indonesia GRADERS OF MALAYSIAN PRIMARY SCHOOL Istiyono E, Dwandaru W.S.P., Lede Y.A., Rahayu F, Nadapdap A,. 2019. 1. Developing IRT-Based Physics Critical Thinking Skill Test: A CAT to Answer 21st Century Challenge, International Journal of Instruction, e-ISSN: 1308-1470 Istiyono E, Dwandaru W.S.P., Rahayu F, 2018, The Developing of Creative Thinking Skills Test Based on Modern Test Theory in Physics of Senior High Schools, Cakrawala pendidikan Jurnal ilmiah pendidikan, https://journal.uny.ac.id/index.php/cp/article/view/19233 Istiyono, E., Sunu Brams Dwandaru, W., Fenditasari, K., Ayub, M. R. S. S. N., & Saepuzaman, D. (2023). The Development of a Four-Tier Diagnostic Test Based 172 on Modern Test Theory in Physics Education. European Journal of Educational Research, 12(1). https://doi.org/10.12973/eu-jer.12.1.371 ITS. (2019). Guide Book – Outcomes Based Education Constructive Alignment. Jerrold E Barnett, Alisha L, 2011, Using higher order thinking questions to foster critical thinking: a classroom study, Education Psychology : An International Journal of Experiment Education Psychology Jewet John S., 2004, Physics for Scienties and Engineers, Thomson Brooks/Cole, 6 th edisin Jutarat Vibaulphol, 2016, Students’ Motivation and Learning and Teachers’ Motivational Strategies in English Classrooms in Thailand, English Taeasher Kartika Y., Sudjito, D.N., dan Ayub, M.R.S.S.N. (2016).Desain Media Pembelajaran Menggunakan Permainan Fun Frame in Physics pada Pokok Bahasan Cermin Datar Melalui Turnamen.Prosiding Seminar Nasional Quantum 2016, Program Studi Pendidikan Fisika, Fakultas Keguruan dan Ilmu Pendidikan, Universitas Ahmad DahlanDIY . Kaltakci-Gurel, D., Eryilmaz, A., & McDermott, L. C. (2017). Development and application of a four-tier test to assess pre-service physics teachers’ misconceptions about geometrical optics. Research in Science and Technological Education, 35(2). https://doi.org/10.1080/02635143.2017.1310094 Killen, R., & Hattingh, S. (2004). A theoretical framework for measuring the quality of student learning in outcomes-based education. South African Journal of Higher Education, 18(1). https://doi.org/10.4314/sajhe.v18i1.25429 Kirbulut, Z. D., & Geban, O. (2014). Using three-tier diagnostic test to assess students’ misconceptions of states of matter. Eurasia Journal of Mathematics, 173 Science and Technology Education, 10(5). https://doi.org/10.12973/eurasia.2014.1128a Krathwohl, D.R., Bloom, B.S., and Masia, B.B. (1964) Taxonomy of educational objectives: Handbook II: Affective domain. New York: David McKay Co. Knight Randall K, 2004, Five Easy Lesson Strategies For Succesful For Physics Theacing, Addison Wesley Koskinen, H. (2007). Evaluation of the level of difficulty of patient cases for veterinary problem-solving examination: A preliminary comparison of three taxonomies of learning. Journal of Veterinary Medical Education, 34(2), 106– 111. https://doi.org/10.3138/jvme.34.2.106 Leontiev D. A., 2008, Maslow Yesterday, Today and Tomorrow, Journal of Humanistic Psychology, SAGE Pubished, DOI: 10.1177/0022167808320536 Lewis, A. and Smith, D. (1993). Defining Higher Order Thinking. Theory into Practice, 32(3), pp. 131-137. Lekurwale, R. R., & Gilke, N. R. (2017). Outcome Based Education: A Case Base Approach. Journal of .... Logic and Mathematic. (1960). In Atti del XII Congresso Internazionale di Filosofia. https://doi.org/10.5840/wcp1219605307 Lucander, H., Bondemark, L., Brown, G., & Knutsson, K. (2010). The structure of observed learning outcome (SOLO) taxonomy: A model to promote dental students’ learning. European Journal of Dental Education, 14(3). https://doi.org/10.1111/j.1600-0579.2009.00607.x Luo, X., Wei, B., Shi, M., & Xiao, X. (2020). Exploring the impact of the reasoning flow scaffold (RFS) on students’ scientific argumentation: Based on the structure of observed learning outcomes (SOLO) taxonomy. Chemistry 174 Education Research and Practice, 21(4). https://doi.org/10.1039/c9rp00269c Mardapi D, 2015, Pengukuran Penilian dan Evaluasi Pendidikan, Penerbit Nuha Medika ed 1 Marzano, J. S., Pickering, D. J., & Marzano, R. J. (2003). Classroom Works. Marzano, R. J., Pickering, D., & McTighe, J. (1993). Assessing Student Outcomes: Performance Assessment Using the Dimensions of Learning Model. Miller, T. R., & Spray, J. A. (1993). Logistic Discriminant Function Analysis for DIF Identification of Polytomously Scored Items. Journal of Educational Measurement, 30(2), 107–122. https://doi.org/10.1111/j.1745- 3984.1993.tb01069.x Murniningsih, Muna, K., & Irawati, R. K. (2020). Analysis of misconceptions by four tier tests in electrochemistry, case study on students of the chemistry education study program UIN Antasari Banjarmasin. Journal of Physics: Conference Series, 1440(1). https://doi.org/10.1088/1742-6596/1440/1/012008 Myanda, A. A., Riezky, M. P., & Maridi, M. (2020). Development of Two-Tier Multiple-Choice Test to Assess Students’ Conceptual Understanding on Respiratory System Material of 11th Grade of Senior High School. International Journal of Science and Applied Science: Conference Series, 4(1), 44. https://doi.org/10.20961/ijsascs.v4i1.49457 Noviah Rosa Firdaus, Tjandra Kirana, & Endang Susantini. (2021). A Four-tier Test to Identify Students’ Conceptions in Inheritance Concepts. IJORER : International Journal of Recent Educational Research, 2(4). https://doi.org/10.46245/ijorer.v2i4.128 175 Oleg M, Antanas M, Leonids N, Saulius R , 2017,Development an Validation of Learning Procces Assesment Model, Procedia Computer Science 104 ( 2017 ) 258 – 265 Onrek F, Robbinson, W.R., Haugan M.R., 2008, What Make Physics Difficult?, International Journal of Environmental and Science Education · Vol 18 no 3 September 2007, pp 165-172 Özdemir, A. Ş., & Yildiz, S. G. (2015). The Examination of Elementary Mathematics Pre-service Teachers’ Spatial Abilities. Procedia - Social and Behavioral Sciences, 174, 594–601. https://doi.org/10.1016/j.sbspro.2015.01.588 Packiam. D. & Fathima, .M..P., ( 2017). Solo Taxonomy Leads To Higher Order Thinking Skill. Shanlax International Journal of Education. 5(1). 178-181 Rintayati, P., Lukitasari, H., & Syawaludin, A. (2020). Development of Two-Tier Multiple Choice Test to Assess Indonesian Elementary Students’ Higher-Order Thinking Skills. International Journal of Instruction, 14(1). https://doi.org/10.29333/IJI.2021.14133A Shanti, M. R. S., Istiyono, E., & Munadi, S. (2022). The effectiveness of learning to improve students’ higher-order thinking skills. Cypriot Journal of Educational Sciences, 17(5), 1576–1587. https://doi.org/10.18844/cjes.v17i5.7220 Shashikala, M. S. (2018). Thiagarajar College of Preceptors. Shanlax International Journal of Education, 6(1). Spady, W. G. (1994). Outcome -based Education:CriticalIisues`"and Answers (1 th). The American Association of School Administrators. Swarup, D. A. and S. W. (2023). Developing Outcomes-bases Education for Learning-centered Education (3 th). Routledge. https://doi.org/http://10.4324/9781003444178 176 Watson, J. M., Collis, K. F., Callingham, R. A., & Moritz, J. B. (1995). A Model for Assessing Higher Order Thinking in Statistics. In Educational Research and Evaluation (Vol. 1, Issue 3). https://doi.org/10.1080/1380361950010303 Weay, A. L, Masood., Abdullah, S.H., Systematic Review of Revised Bloom Taxonomy, SOLO Taxonomy and Webb’s Depth of Knowledge (DOK) in Assessing Students’ Historical. (2016). In Malaysian Journal Of Higher Order Thinking Skills In Education. https://doi.org/10.13140/RG.2.2.30423.47526 Understanding in Learning History White, R. T. (1983). Book Review: Evaluating the Quality of Learning: The SOLO Taxonomy (Structure of the Observed Learning Outcome). In Australian Journal of Education (Vol. 27, Issue 3). https://doi.org/10.1177/000494418302700311 Xiao, Y., Han, J., Koenig, K., Xiong, J., & Bao, L. (2018). Multilevel Rasch modeling of two-Tier multiple choice test: A case study using Lawson’s classroom test of scientific reasoning. Physical Review Physics Education Research, 14(2), 20104. https://doi.org/10.1103/PhysRevPhysEducRes.14.020104 Yang, D. C., & Lin, Y. C. (2015). Assessing 10- to 11-year-old children’s performance and misconceptions in number sense using a four-tier diagnostic test. Educational Research, 57(4). https://doi.org/10.1080/00131881.2015.1085235 Yuberti, Y., Suryani, Y., & Kurniawati, I. (2020). Four-Tier Diagnostic Test with Certainty of Response Index to Identify Misconception in Physics. Indonesian Journal of Science and Mathematics Education, 3(2). https://doi.org/10.24042/ijsme.v3i2.6061 Zenisky, A. L., Hambleton, R. K., & Robin, F. (2004). Dif detection and 177 interpretation in large-scale science assessments: Informing item writing practices. Educational Assessment, 9(1–2), 61–78. https://doi.org/10.1080/10627197.2004.9652959 Zhou, S. N., Liu, Q. Y., Koenig, K., Li, Q. Y., Xiao, Y., & Bao, L. (2021). Analysis of two-tier question scoring methods: A case study on the Lawson’s classroom test of scientific reasoning. Journal of Baltic Science Education, 20(1), 146–159. https://doi.org/10.33225/jbse/21.20.146 秦爾聰秦爾聰, & Erh-Tsung Chin, 蔡政樺. (2022). 質性評價高中資優生數學解題 思路之探討──以SOLO與修訂版Bloom分類法為工具. 特殊教育學報, 56(56). https://doi.org/10.53106/207455832022120056002 citation: Ayub, Made Rai Suci Shanti Nurani and Munadi, Sudji (2024) Pengembangan Tes Four Tier Untuk Mengukur Kemampuan Berpikir Tingkat Tinggi Mahasiswa Menurut Taksonomi Structure of the Observed Learning Outcome (SOLO). S3 thesis, Sekolah Program Pascasarjana. document_url: http://eprints.uny.ac.id/82755/1/disertasi_made%20rai%20suci%20shanti%20nurani%20ayub_17701261016.pdf