1st Edition

The Psychometrics of Standard Setting Connecting Policy and Test Scores

By Mark D. Reckase Copyright 2023
274 Pages 31 B/W Illustrations
by Chapman & Hall

274 Pages 31 B/W Illustrations
by Chapman & Hall

This book provides a unifying structure for the activities that fall under the process typically called "standard setting" on tests of proficiency. Standard setting refers to the methodology used to identify performance standards on tests of proficiency. The results from standard setting studies are critical for supporting the use of many types of tests. The process is frequently applied to... Read more

1. Conceptual Overview for a Theory of Standard Setting  2. A Theory of Standard Setting  3. Agency, Policy Definitions, Content Specific Definitions and Minimum Qualifications  4. The Construct and the Test Designed to Measure the Construct  5. The Kernel of the Standard Setting Process  6. Panelist Selection and Training  7. Feedback and Auxiliary Information  8. Estimating the Standard  9. Evaluating the Standard Setting Process  10. Trends in Standard Setting Design and Development

Biography

Mark D. Reckase has decades of experience developing and reviewing standard setting processes as well as doing advanced work in psychometric theory. He is currently a University Distinguished Professor Emeritus at Michigan State University. He has been the editor of Applied Psychological Measurement and the Journal of Educational Measurement. He has also served as the president of the National Council on Measurement in Education and the International Association for Computerized Adaptive Testing, and as the vice president of Division D of the American Educational Research Association.

"Overall, “The Psychometrics of Standard Setting: Connecting Policy and Test Scores” is an invaluable resource for professionals involved in developing and evaluating proficiency tests. It is particularly well-suited for policymakers, psychometricians, and test developers seeking to ensure their standard setting processes are scientifically sound and aligned with policy objectives. The book’s comprehensive approach, combining theory, practical guidance, and examples, makes it a must-read for anyone looking to deepen their understanding of this critical area in psychometrics."
-Myanca Rodrigues in ISCB News, May 2024

"Reckase takes us on a deep dive into the theoretical underpinnings of standard setting and achieves his goal of providing a more
formal and unified structure to the many facets of standard setting. No light read, this volume is most appropriate for those already quite familiar with the topic or for a graduate course in standard setting. That is, the book will illuminate and provide a different and deeper understanding of the topic for those having already digested the current literature. [...] Reckase’s efforts pay off in a substantial contribution to the measurement literature that strongly complements the existing work. [...] We also strongly endorse this text for a graduate course or seminar on standard setting, as it will provide a strong foundation from which to better understand the various standard setting methods and the commonalities present in the larger standard setting process."
-Daniel Lewis and Sandip Sinharay in the Journal of Educational Measurement, 2024