Integrating Timing Considerations to Improve Testing Practices synthesizes a wealth of theory and research on time issues in assessment into actionable advice for test development, administration, and scoring. One of the major advantages of computer-based testing is the capability to passively record test-taking metadata—including how examinees use time and how time affects testing outcomes. This has opened many questions for testing administrators. Is there a trade-off between speed and accuracy in test taking? What considerations should influence equitable decisions about extended-time accommodations? How can test administrators use timing data to balance the costs and resulting validity of tests administered at commercial testing centers?
In this comprehensive volume, experts in the field discuss the impact of timing considerations, constraints, and policies on valid score interpretations; administrative accommodations, test construction, and examinees’ experiences and behaviors; and how to implement the findings into practice. These 12 chapters provide invaluable resources for testing professionals to better understand the inextricable links between effective time allocation and the purposes of high-stakes testing.
Table of Contents
1. A History of Test Speededness: Tracing the Evolution of Theory and Practice
Daniel P. Jurich
2. The Impact of Time Limits and Timing Information on Validity
3. Timing Considerations in Test Development and Administration
Stephen G. Sireci and Sandra M. Botha
4. Extended Time Testing Accommodations for Students with Disabilities: Impact on Score Meaning and Construct Representation
Benjamin J. Lovett
5. Relationship between testing time and testing outcomes
6. How Examinees Use Time: Examples from a Medical Licensing Examination
Polina Harik, Richard Feinberg, and Brian Clauser
7. Timing Considerations for Performance Assessments
Melissa J. Margolis, Matthias von Davier, and Brian E. Clauser
8. Impact of Technology, Digital Devices, and Test Timing on Score Comparability
Wayne J. Camara and Deborah J. Harris
9. Using Response Time for Measuring Cognitive Ability Illustrated with Medical Diagnostic Reasoning Tasks
Patrick Kyllonen and Rick Thomas
10. Response Times in Cognitive Tests: Interpretation and Importance
Paul De Boeck and Frank Rijmen
11. A Cessation of Measurement: Identifying Test Taker Disengagement Using Response Time
Steven L. Wise and Megan R. Kuhfeld
12. Concurrent Use of Response Time and Response Accuracy for Detecting Examinees with Item Preknowledge
Seo Young Lee and James A. Wollack
Melissa J. Margolis is Senior Measurement Scientist at the National Board of Medical Examiners, USA.
Richard A. Feinberg is Senior Psychometrician at the National Board of Medical Examiners, USA.