PROGRAM
Wednesday - 10/8
8:30
Workshop
Workshop
Computerized Multistage
Adaptive Testing
Duanli Yan, ETS
Alina von Davier, ETS
Kyung (Chris) T. Han, GMAC
Charles Lewis, ETS
10:00
10:15
11:45
1:00
1:15
1:45
2:15
Workshop
Workshop
Building and Delivering Online CAT Simulations: How and Why Introduction to Computerized
to Perform These?
CAT Using Open-Source
Adaptive Testing
Concerto Platform
Theo Eggen, Cito & University Nathan Thompson, Assessment
Systems Corporation
of Twente, The Netherlands
Michal Kosinski, University of
Angela Verschoor, Cito, The
Cambridge, UK
Netherlands
Room: Baltimore
Room: Columbus
Workshop
(continued)
Workshop
(continued)
Break
Room: Savannah
Room: Austin
Workshop
(continued)
Workshop
(continued)
Lunch
Welcoming Remarks: Ida Lawrence, Senior Vice-President, Research & Development, ETS
Room: Baltimore
Presidential Address: Lawrence M. Rudner, President, IACAT
CAT for Small Sample Classification Testing
Room: Baltimore
Keynote Speaker: Robert Mislevy, ETS
An Extended Taxonomy of Variants of Computerized Adaptive Testing
Room: Baltimore
Break
2
2:30
Invited Symposium
Cognitive Diagnostic CAT
Organizer: Duanli Yan, ETS
1. Multistage Testing Using
Diagnostic Models
Matthias von Davier, ETS
Ying Cheng, University of Notre
Dame
2. New Item Selection Methods
for CD-CAT
Jimmy de la Torre & Mehmet
Kaplan, Rutgers University
3. The Termination Rules in
Adaptive Diagnostic Testing
Yuehmei Chien & Chingwei
David Shin, Pearson
Ning Yan, independent
consultant
4. Leveraging CAT Response
Characteristics to Support
Diagnostic Reporting
William Lorié, Questar
Assessment
5. CD-CAT – From Smart
Testing to Smart Learning
Hua-Hua Chang, University of
Illinois at Urbana-Champaign
Room: Baltimore
4:30
4:45
Item Generation
Multidimensional
Effect of Automatic Item
Post-hoc Simulation of
Generation on Ability Estimates
Multidimensional Adaptive
in a Multistage Test
Testing on the Ekman 60 Faces
Test
Kimberly Colvin, University at
Luning Sun, University of
Albany, SUNY
Cambridge, UK
Exploring the Use of Automatic
Applications of Divergence
Item Generation in
Measures to Detect Drifted
Computerised Adaptive Testing
Marie de Beer & Nomfusi
Items in Multidimensional
Bekwa, University of South
Computerized Adaptive Tests
Africa, South Africa
Hyeon-Ah Kang, University of
Illinois at Urbana-Champaign
Comparison of Algorithms that
Allow Item Review in
Balancing Item Information,
Computerized Adaptive Testing Exposure Control, and Testing
Zhongmin Cui, ACT
Time on Variable-Length
Multidimensional Adaptive
Selecting Items Targeted at a
Tests
Higher Probability of a Correct Robert Cook, American Board
Response in a CAT
of Internal Medicine
Heru Widiatmo & Richard
Sullivan, ACT
Specification of Item Pool Size
and Test Length of CAT for
New Item Selection and
Multidimensional Measurement
Hypothesis Testing Methods for
of ICT Skills
the Adaptive Measurement of
S. Franziska C. Wenzel,
Individual Change
Friedrich Schiller University
Ji Eun Lee, University of
Jena, Germany
Minnesota
Best Design for
Multidimensional Computerized
Item Selection Methods for
Controlling Test Latency in CAT
Adaptive Testing
Based on Norm-Referenced
with Bifactor Model
Item Latency
Dong Gi Seo, Michigan
Sung-Hyuck Lee, ACT
Department of Education
Room: Columbus
Room: Savannah
Applications
Supporting Growth in Reading
Competency via Computer
Adaptive Testing in Low-Stakes
Practice Environments
Kathy Sheehan, ETS
Implementation of an English
Proficiency Computerized
Adaptive Testing for Academic
Purposes at ICMC-USP
Mariana Curi, Vanessa Rufino
da Silva, &
Thales Akira M. Ricarte,
University of São Paulo, Brazil
A New Computerized Adaptive
Test for the Assessment of
Entrepreneurial Personality in
Youth
Ignacio Pedrosa, University of
Oviedo, Spain
Development of a CAT Version
of the EORTC QLQ-C30 Quality
of Life Questionnaire
Morten Aa. Petersen,
Bispebjerg Hospital, Denmark
Measuring Language Ability of
Students with CAT: An
Application of Post-Hoc
Simulation to English
Proficiency Test
Burhanettin Ozdemir,
Hacettepe University, Turkey
Room: Austin
Break
Early Career Researcher Award Winner: Chun Wang, University of Minnesota
Hypothesis Testing and Item Selection for the Adaptive Measure of Multivariate Change
Room: Baltimore
5:30
Welcoming Reception
Hyatt Regency Princeton
6:30
3
Thursday - 10/9
8:30
9:00
9:15
Keynote Speaker: Fritz Drasgow, University of Illinois at Urbana-Champaign
Room: Baltimore
Invited Speaker: Robert
Gibbons, University of Chicago
Break
K-12
Security
Estimation
Accessibility and Adaptivity?
A New Verification Test for
A Changepoint-Detection
Promises and Challenges of
Cheating Detection in
Based Method for Warm-Up
Computer Adaptive Testing for Computerized Adaptive Tests
Effect Detection in
Students with Disabilities
Juan Ramón Barrada,
Computerized Adaptive Testing
Elizabeth Stone, ETS
University of Zaragoza, Spain Can Shao, University of Notre
Dame
Future Technology Solutions to
Room: Baltimore
Creating Alternate Format Test
Random vs. Adaptive
Content ‘On the fly’:
The Effect of Collusion on
Calibration of Field-Test Items
Implications for Adaptive
Theta Estimation in a Followin Computerized Adaptive
9:45 On-demand Adaptive Testing:
Testing
Designs
Up
Testing
Scenario
Tests
Pitfalls and Possible Ways to
Cara Laitusis, ETS
Darrin Grelle, CEB
Hong Jiao & Rosalyn Deloris
Avoid Them
Swiggett, University of
The Use of Asynchronously
Maryland, College Park
Frédéric Robin, ETS
Scored Items in Adaptive Test
Sessions
Nonparametric Estimation of
Marty McCall, Smarter
Item Characteristic Curves – A
Balanced Assessment
New Path to Follow
Consortium
Marie Wiberg, Umeå
University, Sweden
The Future of Mental Health
Measurement
10:15
10:30
Room: Baltimore
Room: Columbus
Invited Symposium
Validity
Room: Savannah
Room: Austin
Mixed Format
Content Constraints
Break
Implementing MST in Survey
Cognitive and Behavioural
Using Response Time to
Assessment
Engagement of Students with
Improve Ability Estimate in
Organizer: Alina von Davier,
Multistage Testing
Polytomous-Item-Based CAT
Goran Lazendic, The University
ETS
Xin Luo, Michigan State
of Sydney, Australia
University
1. Lessons Learned from
Multistage Adaptive Testing in
International Adult Populations Accelerated CAT Measurement Comparison of Item-Selection
Kentaro Yamamoto, ETS
Distortion Due to Non-Effortful
Procedures and Ability
Test Taking
Estimates under Different
2. Towards Adaptive Testing in
Steven L. Wise, Northwest
Mixed-Format CAT Designs
PISA 2015: Challenges and
Evaluation Association
Yi Du, ETS
Solutions
Matthias von Davier, ETS
CAT Polytomous Item Selection
Construct Validity and
Utilizing Response Times: A
3. Math Computer-Based
Efficiency of CAT with
Simulation Comparing Local
Study: An Empirical Study of
Educational Tests
Information with Global
Adaptive Approach to GroupJoe Orban, Questar
Information
Score Assessments
Assessment
Barth Riley, University of
Andreas Oranje, ETS
Illinois at Chicago
4. Data Collection and
Calibration Designs for
Implementing Multistage
Adaptive Testing in NAEP
Longjuan Liang, ETS
Room: Baltimore
11:45
Room: Columbus
Room: Savannah
Using a Goal-Based Blueprint
for an Adaptive Test
G. Gage Kingsbury,
Psychometric Consulting
The Effect of Covering the
Content in Adaptive Testing on
Estimated Ability
Ismael Albursan, King Saud
University, Saudi Arabia
An Empirical Study of Variable
Content-Balancing Designs for
Optimal CAT Pool Design
Jing-Ru Xu, Michigan State
University
Room: Austin
Lunch
4
1:00
1:30
1:45
Keynote Speaker: Gunter Maris, University of Amsterdam, The Netherlands
Network Psychometrics: A New Perspective on Learning
Room: Baltimore
Break
Invited Speaker: Liberty
Munson, Microsoft
DIF
Room: Baltimore
Room: Columbus
Response Time
Pool Assembly
An Enhanced Linear
Programming Approach for
Large-Scale CAT Pool Assembly
Changhui Zhang & Jin Zhang,
ACT
Investigating Differential Item
Exploiting Speed-Accuracy
Microsoft’s Innovative
Functioning Detection in
Scoring Rules in Adaptive
Solutions to Exam Delivery in a Computerized Adaptive Tests
Testing
Leaner, Meaner World
Amanda Dainis, SHL Talent
Peter van Rijn, ETS Global
Usama Ali, ETS
Measurement Solutions, CEB
Room: Baltimore
Pool Utilization
An Application of the Item Pool
A Full Bayes Approach to
Utilization Index to an
Establishing Response Time
Detect Differential Item
2:15 Young Researcher Award
Operational CAT
Functioning in Computerized Index to Help Detect Potential
Nominees
Emre Gonulates, Michigan
Compromised Items
Adaptive Testing
State University
Chunxin (Ann) Wang, ACT
Computerized Adaptive Testing Lihong Yang, Michigan State
University
for Classifying Examinees for
Pool Design, Pool Adequacy
Multidimensional Constructs
and Addressing Gaps
Incorporating Item Response
Maaike Van Groen, Cito, The
Marty McCall, Smarter
Time in Item Selection
Netherlands
Score Reporting
Balanced Assessment
Procedures
Developing a Normative
Consortium
Joshua Goodman, Pacific
Variable Starting Item
Benchmark Report in a
Metrics
Difficulty for Repeat Test
Computer Adaptive Test
The Impact of Varying Reading
Takers in CAT
John Denbleyker, National
Testlet Lengths to Test Quality
Hong Qian & Ada Woo,
Board of Osteopathic Medical
and Item Development
Detection of Item PreNational Council of State
Examiners
David Shin, Pearson
Knowledge Based on Effective
Boards of Nursing
Response Times
Mark Reckase, Michigan State
Optimizing Item Selection for
Bruce Williams, ACT
University
an Adaptive Test Battery with
Variable Length
Content Constraints
Development of a Computer
When Do Variable-Length CATs
Lingyun Gao, ACT
Adaptive Test Version of
Make Sense?
Patient-Reported Outcomes
Kirk Becker, Pearson
Optimizing Item Selection
Instrument for Patients with
Routines for Passages at CAT
Functional Dyspepsia and
Administration
Chronic Gastritis
Dave Chayer, Data Recognition
Zheng-kun Hou & Feng-bin Liu,
Corporation
Guangzhou University of
Chinese Medicine, China
3:30
3:45
Break
Room: Savannah
Room: Austin
Optional Excursion to the Grounds for Sculpture
6:30
Banquet
Chauncey Conference Center
9:00
5
Friday - 10/10
8:30
9:00
9:15
Keynote Speaker: Mary Pommerich, Defense Manpower Data Center
Letting the CAT-ASVAB Out of the Bag: History, Experiences, and What the Future May Hold
Room: Baltimore
Break
Invited Speaker: Carol
Chapelle, Iowa State
University
Computer Adaptive Testing
and Innovation in Language
Assessment
9:45
Room: Baltimore
Invited Speaker: Daniel
Wakeman, ETS
Symposium
Innovations
CD-CAT
Organizer: Chun Wang,
University of Minnesota
Scripted Testing in CAT
Sung-Hyuck Lee, ACT
Pretesting
Item Field-Testing and
Calibration for CAT: Impacts
of Position, Adaptivity,
Response Counts, and
1. A Comparative Study of
Calibration Sample
Online Calibration Methods in Score Comparability for WebCharacteristics
and iPad-Delivered Adaptive Wei He, Northwest Evaluation
Multidimensional
Tests
Computerized Adaptive
Association
James B. Olsen, Renaissance
Testing
Learning
Ping Chen, Beijing Normal
University
2. Termination Rules for
Challenges and Solutions to Variable-Length CD-CAT from
the Information Theory
Delivering Digital Assessments
Perspective
Chanjin Zheng, Lei Guo,
Yufang Bian, & Hua-hua
Chang, University of Illinois at
Urbana-Chaimpaign
Computerized Adaptive
Testing with Ipsative IRT
Models for Ranking Data
Shungwon Ro, IBM
Freed-up Slots for Pretest
Items in a Computer Adaptive
Classification Test
Richard Sullivan & Changhui
Zhang, ACT
Room: Savannah
Room: Austin
3. Calibration of Q-Matrix in
Cognitive Diagnostic
Computerized Adaptive
Testing
Gongjun Xu, School of
Statistics, University of
Minnesota
10:15
Room: Baltimore
Room: Columbus
Break
6
10:30
Implementation
Symposium
Applications and Advances in
Computer Adaptive Testing
Automatic Item Generation
Algorithm for Summative
Organizer: Hollis Lai,
Assessment
Dmitry Abbakumov, National University of Alberta, Canada
Research University Higher
1. Advancement in Item
School of Economics, Moscow,
Russia
Modeling: Distracter Modeling
Hollis Lai & Mark Gierl,
Recent Advances and
University of Alberta, Canada
Improvements in
André-Philippe Boulais &
Computerized Adaptive
André De Champlain, Medical
Testing with the R Package
Council of Canada
catR
Juan Ramón Barrada,
2. Advancement in Item
Universidad de Zaragoza,
Generation: Linked and
Spain
Layered Elements for
Language Adaptations
Evaluation of Computer
Mark Gierl, Karen Fung, &
Adaptive Testing Schemes to
Hollis Lai, University of
Assess General Intelligence
Alberta, Canada
Yin Wah Fiona Chan,
André De Champlain & AndréUniversity of Cambridge, UK
Philippe Boulais, Medical
Council of Canada
Development of an Adaptive
Placement Test for Use by
3. Advancement in Post Item
Malaysian Universities
Generation: Reviewing
Norsyahida Abd Kadir, MIMOS,
Generated Item Quality
National R&D Center in ICT, André De Champlain & AndréMalaysia
Philippe Boulais, Medical
Council of Canada
Hollis Lai & Mark Gierl,
University of Alberta, Canada
Room: Baltimore
12:00
Psychometric
MST
The Stochastically Curtailed
Sequential Probability Ratio
Test in Practice
Alan Huebner, University of
Notre Dame
Matthew D. Finkelman, Tufts
University School of Dental
Medicine
Comparing Reviewable
Computerized Adaptive
Testing Adopting Modified
Block Review Designs with
Multistage Adaptive Testing
Haiyan Lin, ACT
Bayesian CAT via Power
Priors: An Empirical Study
Mariagiulia Matteucci,
University of Bologna, Italy
Bernard Veldkamp, University
of Twente, The Netherlands
Does the Administration of a
Second Stage Test Increase
Classification Precision?
Kristin Morrison & Susan E.
Embretson, Georgia Institute
of Technology
An Exercise in Best Practice:
Use and Interpretation of
Optimality in Computerized Multistage Computer Adaptive
Adaptive Tests
Testing
Matthieu Brinkhuis, University Marc Julian, Data Recognition
of Amsterdam & Cito, The
Corporation
Netherlands
An Investigation of Improving
The Fixed-Effects Likelihood
Proficiency Estimation in
Ratio Test: A Differential Item
Multistage Testing
Functioning Procedure for
Chunyan Liu, ACT
Computerized Adaptive
Testing
Differential Item Functioning
Joseph Rios, ETS
in a Multistage Adaptive
Testing Environment
Kelvin Gregory, Australian
Curriculum, Assessment, and
Reporting Authority, Australia
Room: Columbus
Room: Savannah
Room: Austin
Lunch
7
1:00
Invited Symposium
Symposium
Symposium
Symposium
Advances in Personality CAT
Organizer: Stephen Stark,
USF
Technical Aspects of ca-MST
Automated Scoring and
How Do We Know that a
Computerized Adaptive Test Is
Operation – Methods and
Adaptive Test Designs:
Implications
Overview, State of the Art and Aligned with the Content of
Prospects
Interest?
Organizer: Oliver Zhang,
Organizer: Isaac Bejar, ETS Organizer: G. Gage Kingsbury,
1. Thurstonian Model for
College Board
Psychometric Consultant
Multidimensional Forced
1. An Overview of Automated
Choice Responses
1. Item Calibration in
1. Content Alignment
Scoring
Anna Brown, University of
Computerized Multistage
Processes for Adaptive
Isaac Bejar, ETS
Kent, UK
Testing (MST)
Certification and Licensure
Chanjin Zheng, University of
Examinations
2. On-The-Fly Automated
Illinois
Anthony R. Zara, Pearson
Scoring of Short-Answer
2. MCMC Calibration and
Oliver Zhang, College Board
Open-Ended Questions
Scoring of Multidimensional
Aster Tessema, AICPA
Forced Choice (MFC) Pairs and
Yigal Attali
Rank Responses
2. Content Alignment
2. Impacts of Item Parameter
Jacob Seybert, ETS
Processes for Adaptive
Drift on Ability Estimation in 3. Automatic Generation and
Educational Examinations
Scoring of Mathematics Items
MST
G. Gage Kingsbury,
James Fife, ETS
Xiaoxin Wei, University of
3. CAT and Aberrance
Psychometric Consultant
Virginia
Detection with
4. Combining Automated
Jaehoon Seol, American
Multidimensional Pairwise
Scoring of Long Constructed
Nurses Credentialing Center
Preference Measures
3. Metrics for Measuring
Ryoungsun Park, University of Responses and Computerized
Stephen Stark, USF
Content Alignment for
Adaptive Testing: A Hybrid
Texas, Austin
Adaptive Tests
Test Design
Steven L. Wise, Northwest
Britt He, ETS
3. Comparison of Commonly
4. Multidimensional Adaptive
Evaluation Association
Used DIF Techniques in
Testing in Patient-Reported
Multistage Adaptive Testing
Outcomes Measurement
Jonathan D. Rubright, AICPA
Seung W. Choi, McGraw-Hill
Likun Hou, ETS
Education CTB
Oliver Zhang, College Board
4. Modeling Item Responses
and Response Times from
Testlet-Based Tests
Michael S. Finger & Anne
Thissen-Roe, Comira Testing
2:30
2:45
Room: Baltimore
Room: Columbus
Break
Room: Savannah
Room: Austin
2014 IACAT Summit Wrap-Up
Room: Baltimore
3:30
8