Graduate Students in Research on International Large Scale
Assessments – ºìÐÓÊÓƵ; PIRLS Lab

The work of the ºìÐÓÊÓƵ; PIRLS International Study Center staff is supported by graduate assistants who are students in the Measurement, Evaluation, Statistics, and Assessment (MESA) program at Boston College’s Lynch School of Education and Human Development. The current graduate researchers assist with operational aspects such as assessment development and assembly and work on research projects aimed at the ºìÐÓÊÓƵ and PIRLS projects.

Meng Lyu

Graduate Research Assistant, ºìÐÓÊÓƵ

Meng is a PhD student in the Measurement, Evaluation, Statistics, and Assessment program with a focus in psychometrics.

At ºìÐÓÊÓƵ; PIRLS, Meng works on systematically cataloging and structuring the prompts utilized across various AI-driven initiatives. She also explores the use of multi-model LLMs and machine learning models to generate fourth-grade mathematics items for the ºìÐÓÊÓƵ assessment.

Jeneve Swaby

Graduate Research Assistant, PIRLS

Jeneve is a second-year PhD student in Measurement, Evaluation, Statistics, and Assessment. She works on the development of reading assessment instruments for PIRLS: reviewing feedback from experts and countries, creating text maps for reading passages, and ensuring the passages are sensitive to cultural differences and suitable for fourth-grade students. Jeneve also contributes to an exploratory project for generating items using artificial intelligence, reviewing the output according to the four reading comprehension processes specified by the PIRLS framework.

After obtaining her PhD, Jeneve hopes to work as a psychometrician/ quantitative methodologist on large-scale assessments that influence policy decisions. She is interested in using process data to identify sources of variation in test-taker performance and to support the valid interpretation of test scores.

Staff in Graduate Programs at BC

Several current ºìÐÓÊÓƵ; PIRLS staff members are working on graduate degrees at Boston College:

  • Mark Mao—Research Associate, Measurement & Data Analysis; PhD student in MESA
  • Erin Wry—Senior Research Specialist, PIRLS Coordinator; PhD student in MESA

Former Graduate Student Researchers on Staff

These current ºìÐÓÊÓƵ; PIRLS staff members completed graduate degrees at Boston College:

Dr. Jenny (Ji Yoon) Jung

Senior Research Specialist, Automated Scoring

Jenny recently completed a PhD in Measurement, Evaluation, Statistics, and Assessment. Her dissertation concerns automated scoring of written response items in international large-scale assessments.

At ºìÐÓÊÓƵ; PIRLS, Jenny has performed Item Response Theory (IRT) analysis for the LaNA and Rosetta Stone Projects, which measure the literacy and numeracy proficiencies of students in low- to middle-income countries. She has also run automated scoring for written response items using ºìÐÓÊÓƵ 2023 field test data and eºìÐÓÊÓƵ 2019 data as part of the ºìÐÓÊÓƵ 2023 Automated Scoring Project.

Dr. Dihao Leng

Senior Research Specialist, Insights Analysis and QC

Dihao recently completed a PhD in Measurement, Evaluation, Statistics, and Assessment. Her dissertation, supervised by ºìÐÓÊÓƵ & PIRLS executive director Dr. Matthias von Davier, aims to advance the application of process data in the realm of large-scale assessments. She has also worked on the automated scoring of mathematics expressions and on utilizing LLMs for the automated generation of mathematics items.

Outside of work, Dihao has applied hierarchical linear models to investigate the individual- and school-level effects of private tutoring on mathematics achievement in South Korea, and has employed mixture models to explore students' attitudes towards mathematics.

  • Dr. Charlotte Aldrich—Assistant Research Director, ºìÐÓÊÓƵ Mathematics and Special Projects
  • Dr. Ella Anghel—Postdoctoral Research Fellow
  • Dr. Bethany Fishbein—Associate Research Director, Psychometrics and Data Analysis
  • Dr. Ann Kennedy—Senior Research Director, Project Management
  • Dr. Katherine Reynolds—Associate Research Director, Context Questionnaires and Reporting

Research By Graduate Students

Ella Anghel, J. Littenberg-Tobias, & Matthias von Davier
2024, Education and Information Technologies 29, 1–25

Ella Anghel, Lale Khorramdel, & Matthias von Davier
2024, Large-scale Assessment in Education 12, 13

Ji-Yoon Jung, Lillian Tyack, & Matthias von Davier
2024, Large-Scale Assessments in Education 12 (10)

Dihao Leng, Ummugul Bezirhan, Lale Khorramdel, Bethany Fishbein, & Matthias von Davier
2024, Educational Measurement Issues and Practice

Lillian Tyack, Lale Khorramdel, & Matthias von Davier
2024, Computers & Education: Artificial Intelligence 6, 100249

Matthias von Davier, Lillian Tyack, & Lale Khorramdel
2023, Educational and Psychological Measurement, Volume 83, (3), 556–585

Ji Yoon Jung, Lillian Tyack, & Matthias von Davier
2022, Psychological Test and Assessment Modeling, Volume 64, (4), 471–494