1st Edition
Frontiers of Test Validity Theory Measurement, Causation, and Meaning
This book examines test validity in the behavioral, social, and educational sciences by exploring three fundamental problems: measurement, causation and meaning. Psychometric and philosophical perspectives receive attention along with unresolved issues. The authors explore how measurement is conceived from both the classical and modern perspectives. The importance of understanding the underlying concepts as well as the practical challenges of test construction and use receive emphasis throughout. The book summarizes the current state of the test validity theory field. Necessary background on test theory and statistics is presented as a conceptual overview where needed.
Each chapter begins with an overview of key material reviewed in previous chapters, concludes with a list of suggested readings, and features boxes with examples that connect theory to practice. These examples reflect actual situations that occurred in psychology, education, and other disciplines in the US and around the globe, bringing theory to life. Critical thinking questions related to the boxed material engage and challenge readers. A few examples include:
What is the difference between intelligence and IQ?
Can people disagree on issues of value but agree on issues of test validity?
Is it possible to ask the same question in two different languages?
The first part of the book contrasts theories of measurement as applied to the validity of behavioral science measures.The next part considers causal theories of measurement in relation to alternatives such as behavior domain sampling, and then unpacks the causal approach in terms of alternative theories of causation.The final section explores the meaning and interpretation of test scores as it applies to test validity. Each set of chapters opens with a review of the key theories and literature and concludes with a review of related open questions in test validity theory.
Researchers, practitioners and policy makers interested in test validity or developing tests appreciate the book's cutting edge review of test validity. The book also serves as a supplement in graduate or advanced undergraduate courses on test validity, psychometrics, testing or measurement taught in psychology, education, sociology, social work, political science, business, criminal justice and other fields. The book does not assume a background in measurement.
Biography
Keith A. Markus is a Professor in the Department of Psychology at John Jay College of Criminal Justice of The City University of New York (CUNY).
Denny Borsboom is a Professor in the Department of Psychology at the University of Amsterdam.
"Psychologists Markus and Borsboom have done an excellent job of arguing that validity theory is in serious need of more research. For those in the behavioral sciences who are already well versed in the assessment, this book will provide an invaluable source for understanding why they might want to revisit many of the fundamental assumptions of their field. For less experienced readers, the book may be a steep climb but well worth the effort when taken one step at a time. Summing Up: Highly Recommended. Graduate students, faculty, researchers, professionals." – J.F. Heberle, Albright College, CHOICE Magazine
“It is a formidable achievement to write a book on validity, covering measurement, causation, and meaning, with a discussion from psychometric, philosophical, and practical perspectives. It is why one would want to read this book. It leads to a deep understanding and makes one think beyond common ways of thinking." – Paul De Boeck, Ohio State University, USA & KU Leuven, Belgium
"This book would serve as a seminal resource on validity. It challenges practitioners and the field ... to reflect [on] and identify the salient evidence of one of the most important characteristics that we require of all tests." – Terry Ackerman, University of North Carolina at Greensboro, USA
"The book will make a very valuable contribution to the field by bringing much of its (often ignored) theoretical underpinnings to light in a…straightforward manner.…[It] will be of great interest to measurement and psychometric researchers, as well as to philosophers of statistics.…It gives important insight into a variety of issues." – Brian Habing, University of South Carolina, USA
"The authors are raising thought-provoking questions about the nature of measurement, causality, and validity.…Markus and Borsboom are raising the bar for what it means to be called a validity theorist." - Derek Briggs, University of Colorado, Boulder, USA
“This book provides a unique contribution to the topic of test validity. It is an interesting interdisciplinary approach combining elements of philosophy, social sciences, and math. I found as I was reading that I was forced to think differently about several concepts. I am not aware of any book like this.” – Jean Powell Kirnan, The College of New Jersey, USA
