Test Development: Fundamentals for Certification and Evaluation
- 3h 17m
- Melissa Fein
- Association for Talent Development
- 2012
Test Development: Fundamentals for Certification and Evaluation provides practical guidelines for the classical approach to test development specifically for certification and credentialing. Most of the existing high-quality books on the topic of criterion-referenced test (CRT) development are written for professional statisticians and psychometricians. And the books written for the general reader tend to lack accurate, user-friendly coverage of some of the most critical topics. This book serves as an accessible resource on test development that does not require any technical background or expertise. Part I, Conceptual Principles, covers the process of CRT development in narrative form. Some of the topics covered include:
- defining content domain as related to job analysis and assessment objectives
- item writing and scoring
- understanding validity and reliability
- conducting item analysis
- defining and differentiating the major standard setting methods
- preparing for and understanding issues with test administration.
Part II, the Technical Appendix, contains the computational instructions and supplementary background material. This do-it-yourself manual is a valuable resource for training program developers, credential program developers, as well as other relevant human resources personnel and upper management who need to be on board for change management related to testing programs.
About the Author
Melissa Fein is a consultant specializing in program evaluation, criterion-referenced test development, and credentialing, and she is also a professional development coach. This book is based on the seminars and consulting advice that she has provided to her clients over the years. Past clients have included the U.S. Food and Drug Administration (FDA), the Internal Revenue Service (IRS), The World Bank, U.S. Department of Education teacher training grantees, and the Maryland State Department of Education. For a number of years Dr. Fein was affiliated with the Maryland Assessment Research Center for Education Success (MARCES), at the University of Maryland, College Park, where she has taught a variety of courses in measurement, statistics, and evaluation. She earned her doctoral degree in applied statistics and has one master’s degree in industrial/organizational psychology and another in economics.
In this Book
-
Test Development—Fundamentals for Certification and Evaluation
-
Preface
-
Introduction
-
Credentialing
-
Evaluation & CRT Development
-
Approaches to Test Development
-
Defining Content Domain (Part I)—Job Analysis
-
Defining Content Domain (Part II)—Assessment Objectives and the Table of Specifications
-
Item Writing and Scoring
-
Validity
-
Reliability
-
Item Analysis
-
Standard Setting
-
Test Administration Issues
-
A Conclusion of Caveats
-
Levels of Measurement
-
Mathematical Tools and Microsoft Excel
-
Classical Item Analysis
-
Reliability
-
Standard Error of Measurement (SEM)
-
Validity
-
Scaled Scores
-
Standard Setting
-
Job Analysis
-
Overview of the Criterion-Referenced Test (CRT) Development Process
