Testing for the People

I.C.E. Exchange Program Description : Credentialing’s ultimate (and arguably most important) stakeholder is the public: consumers, employers, and other uses of the services delivered by credential holders. This session is about optimizing assessment design for public protection. A representative of I.C.E.'s Public Member Committee ( Rebecca (Becky) LeBuhn) will moderate as four experts in psychometrics and testing policy debate the comparative strengths and limitations of various assessment formats in achieving measurement goals - fidelity, reliability and validity - while satisfying the public's preference for a system that predicts successful and safe performance in the field. That means a system that assesses not just knowledge, but also application of knowledge and judgment, communication, and other competencies that impact job performance.

Advancements in areas such as AI and simulation technology are expanding test developers' options for assessing entry-level candidates' ability to competently do their jobs and subsequently assessing credential holders' ongoing, career-long skills and performance.

Among the assessment concepts and applications that are open to debate:

• Closed book vs. access to resources
• Core knowledge vs. specialized knowledge
• Constructed response (open ended) versus selected response (multiple-choice)
• Conventional vs. competency- and skills-based assessment,
• Recall of information vs. application of knowledge (including workplace assessment)
• Assessment of individuals vs. the team

After debating these alternatives, panelists will respond to comments and questions from the audience.