Publications — MindScale Lab

Under review

Adjusted residuals for local quasi-independence in item-response theory models for multistage adaptive testing van Rijn, P. W., Ali, U., Shin, H. J., & Joo, S.

The role of the linkage set in fitting rater response models to sparse matrices from disconnected rating designs Casabianca, J. M., Donoghue, J., Shin, H. J., Chao, S., & Choi, I.

2026

I’m not stuck – I’m learning: Operationalizing self-efficacy trajectories in large-scale AI learning environments Hong, B., Shim, E., Ko, H., & Shin, H. J. Artificial Intelligence in Education (AIED 2026), Lecture Notes in Computer Science, 185–199

DOIUndergraduate capstone project

Automated item generation: The promises and the challenges Graf, E. A., Shin, H. J., Yan, D., & von Davier, A. A. Reference Module in Social Sciences. Elsevier

문항반응이론 기반 컴퓨팅 사고력 평가의 타당성 및 동등화 가능성 검토 Examining validity and score comparability of computational thinking assessment Kim, E., & Shin, H. J. 컴퓨터교육학회논문지 (The Journal of Korean Association of Computer Education), 29(6), 90–99

2025

An extended two-parameter logistic item response model to handle continuous responses and sparse polytomous responses Li, S., & Shin, H. J. Psychometrika, 90(5), 1705–1731

STAIR-AIG: Optimizing the automated item generation process through human–AI collaboration for critical thinking assessment Kim, E., Li, S., Khalil, S., & Shin, H. J. Proceedings of the 20th Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2025)

Down the cascades of Omethi: Hierarchical automatic scoring in large-scale assessments Zehner, F., Shin, H. J., Kerzabi, E., Horbach, A., Gombert, S., Goldhammer, F., Zesch, T., & Andersen, N. Proceedings of the 20th Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2025)

Incorporating timing data into PISA population modeling Shin, H. J., von Davier, M., & Yamamoto, K. In L. Khorramdel, M. von Davier & K. Yamamoto (Eds.), Innovative Digital-Based International Large-Scale Assessments. Springer

Automatic scoring of constructed responses in PISA using the machine-supported coding system Shin, H. J., Yamamoto, K., He, Q., & von Davier, M. In L. Khorramdel, M. von Davier & K. Yamamoto (Eds.), Innovative Digital-Based International Large-Scale Assessments (pp. 299–320). Springer

Scoring and scaling items from innovative domains von Davier, M., Shin, H. J., & Khorramdel, L. In L. Khorramdel, M. von Davier & K. Yamamoto (Eds.), Innovative Digital-Based International Large-Scale Assessments. Springer

Improved test designs and multistage adaptive testing in large-scale assessments Yamamoto, K., Shin, H. J., Robin, F., Khorramdel, L., & Halderman, L. In L. Khorramdel, M. von Davier & K. Yamamoto (Eds.), Innovative Digital-Based International Large-Scale Assessments (pp. 113–141). Springer

맞춤형 교육을 위한 적응형 평가로의 전환: 정답률 개념 및 활용에 대한 한계와 대안 Transition to adaptive testing for adaptive learning: How to adjust the proportion correct Kim, Y., & Shin, H. J. 교육학연구 (Korean Journal of Educational Research), 63(2), 1–29

거대 언어 모델을 활용한 교육 콘텐츠 자동 번역 연구: 교육과정을 고려한 프롬프트 엔지니어링 방법의 효과성 탐색 Leveraging large language models for automatic translation of educational content: Exploring the effectiveness of curriculum-aware prompt engineering Kim, E., & Shin, H. J. 교육학연구 (Korean Journal of Educational Research), 63(2), 427–462

국내 중등 교과별 AI 융합 교육 프로그램의 효과성에 대한 메타분석 A meta-analysis of the effectiveness of AI convergence education programs in Korean secondary education Park, H. M., & Shin, H. J. 교육정보미디어연구 (Journal of Educational Information and Media), 31(2), 539–566

2024

교육 분야 빅데이터를 활용한 학습자 유형 탐구: 초등학교 5학년 수학 단원의 이해력을 중심으로 Using big data in education to explore types of learners: A case study of a 5th-grade mathematics unit Ahn, J. Y., & Shin, H. J. 교육공학연구 (Journal of Educational Technology), 40(4), 993–1028

2023

Systematic validation in science learning progression research Jin, H., Shin, H. J., & Cisterna, D. I. International Journal of Science and Mathematics Education

2022

Generating group-level scores under response accuracy–time conditional dependence Shin, H. J., Jewsbury, P. A., & van Rijn, P. W. Large-scale Assessments in Education, 10(4)

2021

프로세스 데이터를 활용한 응답속도와 정확도의 관계 분석: PISA 2015 미국과 한국의 사례를 중심으로 Analysis of the relationship between response time and accuracy using process data: PISA 2015 in the United States and Korea Shin, H. J. 교육평가연구 (Journal of Educational Evaluation), 34(3), 587–614

Increasing measurement precision of PISA through multistage adaptive testing Shin, H. J., Yamamoto, K., Khorramdel, L., & Robin, F. Springer

Evaluating item fit statistic thresholds in PISA: Analysis of cross-country comparability of cognitive items Joo, S. H., Khorramdel, L., Yamamoto, K., Shin, H. J., & Robin, F. Educational Measurement: Issues and Practice, 40(2), 37–48

2020

Comparability of response time scales in PISA Shin, H. J., Lubaway, E., Joo, S., Robin, F., & Yamamoto, K. Psychological Test and Assessment Modeling, 62(1), 107–135

2019

Introduction of multistage adaptive testing design in PISA 2018 Yamamoto, K., Shin, H. J., & Khorramdel, L. OECD Education Working Papers No. 209. OECD Publishing, Paris

Human rater monitoring with automated scoring engines Shin, H. J., Wolfe, E., & Wilson, M. Psychological Test and Assessment Modeling, 61(2), 127–148

Developments in psychometric population models for technology-based large-scale assessments: An overview of challenges and opportunities von Davier, M., Khorramdel, L., He, Q., Shin, H. J., & Chen, H. Journal of Educational and Behavioral Statistics, 44(6), 671–705

Investigating rater effects in international large-scale assessments Shin, H. J., von Davier, M., & Yamamoto, K. Springer, Cham

GDM software mdltm including parallel EM algorithm Khorramdel, L., Shin, H. J., & von Davier, M. Springer, Cham

Evaluating item response theory linking and model fit for data from PISA 2000–2012 von Davier, M., Yamamoto, K., Shin, H. J., Chen, H., Khorramdel, L., Weeks, J., Davis, S., Kong, N., & Kandathil, M. Assessment in Education: Principles, Policy & Practice, 26(4), 466–488

Trifactor models for multiple-ratings data Shin, H. J., Rabe-Hesketh, S., & Wilson, M. Multivariate Behavioral Research, 54(3), 360–381

Secondary students’ understanding of ecosystems: A learning progression approach Jin, H., Shin, H. J., Hokayem, H., Qureshi, F., & Jenkins, T. International Journal of Science and Mathematics Education, 17, 217–235

2018

Multistage adaptive testing designs in international large-scale assessments Yamamoto, K., Shin, H. J., & Khorramdel, L. Educational Measurement: Issues and Practice, 37(4), 16–27

Multistage adaptive testing design in PIAAC Yamamoto, K., Khorramdel, L., & Shin, H. J. Psychological Test and Assessment Modeling, 60(3), 347–368

Development and implementation of a machine-supported coding system for constructed-response items in PISA Yamamoto, K., He, Q., Shin, H. J., & von Davier, M. Psychological Test and Assessment Modeling, 60(2), 145–164

The effects of vignette scoring on reliability and validity von Davier, M., Shin, H. J., Khorramdel, L., & Stankov, L. Applied Psychological Measurement, 42(4), 291–306

Secondary students grapple differently with process-focused and practice-focused items about carbon-transforming processes Schramm, J. W., Jin, H., Keeling, E., Johnson, M., & Shin, H. J. Research in Science Education, 48, 887–911

2017

Structured constructs models based on change-point analysis Shin, H. J., Wilson, M., & Choi, I. Journal of Educational Measurement, 54(3), 306–332

Developing a machine-supported coding system for constructed-response items in PISA Yamamoto, K., He, Q., Shin, H. J., & von Davier, M. ETS Research Report No. RR-17-47. Educational Testing Service

Promoting student progressions in science classrooms: A video study Jin, H., Johnson, M. E., Shin, H. J., & Anderson, C. W. Journal of Research in Science Teaching, 54, 852–883

Heterogeneous effects of charter schools: Unpacking family selection and achievement growth in Los Angeles Shin, H. J., Fuller, B., & Daughter, L. Journal of School Choice, 11(1), 60–94

2015

Developing learning progression-based teacher knowledge measures Jin, H., Shin, H. J., Johnson, M., & Kim, J. Journal of Research in Science Teaching, 52, 1269–1295

2013

연구활동지식의 개념화와 계발을 위한 학부 ‘독립연구’ 교과목 사례 연구 Conceptualization of research activity knowledge and a case study of an undergraduate ‘Independent Research’ course Kim, J., & Shin, H. J. 교양교육연구 (Korean Journal of General Education), 7(6), 305–364

2009

대학생이 지각한 학습경험과 수업만족도의 관계에서 전공계열의 효과 Effects of students’ majors on the relationship between perceived learning experiences and course satisfaction Shin, H. J., & Min, H. R. 교육학연구 (Korean Journal of Educational Research), 47(3), 51–75

2008

Multilevel analysis of the effects of student and course characteristics on satisfaction in undergraduate liberal courses Baek, S., & Shin, H. J. Asia Pacific Education Review, 9, 475–486

2007

A theoretical inquiry on the construct for teaching competence in secondary school Baek, S., Ham, E. H., Lee, J. Y., Shin, H. J., & Yu, Y. L. Asian Journal of Education, 8(1), 47–69

MindScale is a research lab of the AI Behavioral Studies and the Graduate School of Education.