01
AI in Education
We develop and validate AI-assisted methods for generating and translating assessment items, with a focus on critical thinking and human expert review.
02
Big Data Analytics
We use large-scale assessment and process data to improve population modeling, imputation, and the interpretation of student performance.
03
Automated Scoring
We develop multilingual automated scoring and rater-monitoring methods that preserve measurement quality across groups and languages.
04
Adaptive Testing
We design and evaluate multistage adaptive tests that improve precision while addressing item fit, local dependence, and bias.
Emerging direction
AI Measurement Science
We combine AI and psychometrics to measure complex human skills, human–AI collaboration, and the capabilities of AI systems. Our goal is to build evidence-based measures from responses and process data.
Research collaborations
Current research projects
Collaboration with Macat on Critical Thinking Skills
MindScale collaborates with Macat on automatic item generation (AIG) and machine translation (MT) for critical thinking assessments and on Macat's project with the OECD.
LLM-based Multi-Agent System for Automatic Educational Content Generation
MindScale is developing an LLM-based multi-agent system to generate and evaluate educational content for critical thinking skills.
CELLA Global Project
MindScale represents Korea in the global CELLA research project.
EBS 진단-형성평가 문항 현황 분석 및 개선 방안 연구
MindScale collaborates with EBS to evaluate assessment items for elementary and middle school students and develop an item bank.
TIMSS 2023 Longitudinal Study
MindScale collaborates with KICE to examine growth among Korean students in Grades 4 and 8 using TIMSS 2023 longitudinal data.
Psychometric Properties of the Patient-Physician Interaction (PPI) Checklist
MindScale collaborates with Seoul National University College of Medicine to develop and validate the next version of the PPI checklist.
OECD PISA Technical Advisory Group
Hyo Jeong Shin contributes expertise in psychometrics, adaptive testing, and cross-language comparability as a member of the PISA Technical Advisory Group.
Funding
Grants
- 2022–2023 Automatic Scoring of Text Responses in Multilingual Assessment Data IEA Research and Development Tier II project · $99,060
- 2016–2020 Learning Progression-based and NGSS-aligned Formative Assessment for Using Mathematical Thinking in Science Institute of Education Sciences (IES) · $1,396,496
- 2020–2021 Innovations in Design, Modeling, and Process Data ETS Internal Research Allocation
- 2019–2020 Psychometric Advances in Large-scale Survey Assessments ETS Internal Research Allocation
- 2018–2019 Conditional Independence between Item Responses and Response Time ETS Internal Research Allocation
Technology transfer
Patents
Filed with the Korean Intellectual Property Office, together with lab members and collaborators. Titles are given in Korean as filed.
- 2025-03-20 자동문항 생성 기술의 최적화된 사용을 위한 전자 장치 및 이의 동작 방법 Electronic device and operating method for the optimized use of automatic item generation technology. Application 10-2025-0036007 · with Euigyum Kim (Sogang University)
- 2024-12-23 문항반응이론을 활용하여 맞춤형 평가 상황에서 수집한 데이터의 정답률 편향을 교정하는 방법 및 이를 위한 장치 Method and apparatus for correcting accuracy-rate bias in data collected under adaptive assessment, using item response theory. Application 10-2024-0194037 · with Yeonwho Kim (Hongik University Science High School)
- 2024-11-12 프롬프팅에 기반한 자동문항생성 방법과 장치 Prompt-based method and apparatus for automatic item generation. Application 10-2024-0160356 · with Seewoo Li (UCLA) and Jihoon Ryoo (Yonsei University; CLASS-ANALYTICS)
Recognition
Awards & honors
- 2023, 2024Excellence in Research AwardSogang University
- 2024Excellence in Teaching AwardSogang University
- 2017, 2019, 2021SPOT AwardEducational Testing Service
- 2020Operational Excellence Service AwardEducational Testing Service
- 2009–2014Doctoral ScholarshipKorea Foundation for Advanced Studies
