Automating the Testing and Assessment Process for Airport Screeners: Methods and Results 2003-2004 and Beyond
Testing an assessment programs for pre-employment selection and employee development can no longer be done in isolation from other critical practices and applications. Leading-edge programs in corporate, governmental, educational, and certification assessment are now requiring the ability to integrate assessment events and data seamlessly with other functional systems. This emphasis on process validity reflects the practical values of parsimony, access, speed, and cost.
This presentation will focus on the design and
implementation challenges and successes of automating tests and
assessments for the high-stakes pre-employment screening needs of the
Transportation Security Administration, a major division of the U.S.
Department of Homeland Security. Participants
will get an overview of the system and an update on what's been
happening over the past year.
Speaker
Elizabeth Kolmstetter, Ph.D.
Deputy Assistant Administrator, Workforce Performance Solutions, Office of Workforce Performance and Training
U.S. Transportation Security Administration
Dr. Kolmstetter is an Industrial and Organizational Psychologist who is the Deputy Assistant Administrator for the Workforce Performance Solutions Branch of the Office of Workforce Performance and Training at TSA. She is currently responsible for developing, validating, and implementing standards and managing programs for testing, assessment, training, certification, quality assurance, and organizational development. She was the expert who developed and validated the screener selection process during the initial federalization effort in the aftermath of 9-11. She also works in the broad area of strategic human capital development to ensure the TSA workforce is skilled, evaluated, and continuously improving.
She joined TSA from the National Skill Standards Board (NSSB/DOL) where she was the Senior Director for Standards, Assessment, and Certification. She was responsible for the technical work and policy development for a national, industry-led system of skill standards, assessment, and certification for front-line workers across all industry sectors in the United States. Prior to joining the NSSB, she was the first Chief of Personnel Assessment and Research at the Federal Bureau of Investigation (FBI). As the first Industrial and Organizational Psychologist ever to be hired by the FBI, she was responsible for developing, validating, and implementing selection and promotion systems for Special Agent and Support positions, performing research studies on various HR programs, and providing technical guidance to numerous projects related to the performance management system
She has also worked for private industry and in consulting. Dr. Kolmstetter received her Ph.D. and M.S. in Industrial and Organizational Psychology from Virginia Polytechnic Institute and State University.
Speaker
Lisa Kobe Cross, Ph.D.
Cooperative Personnel Services
Speaker
Ryan Ross
Hogan Assessment Systems
Mr. Ross is a Senior Consultant with Hogan Assessment Systems, and provides a unique perspective to consulting services through his combined experience in clinical psychology and Industrial/Organizational psychology. Mr. Ross is currently completing a Ph.D. from the University of Tulsa. Mr. Ross has managed and directed numerous pre-employment assessment projects both for general industry and also those engaged in protective services and security. Additional expertise includes individual development and counseling, personality based assessment; selecting, coaching, and developing high performing teams, and the design of succession management programs. In addition Mr. Ross is an expert in job analysis activities and selection system design, validation, and implementation.
Currently Mr. Ross directs projects that have annual applicant flows of over 65,000 individuals. Mr. Ross also serves as Director of Assessment Technologies and is responsible for coordinating all computer-related assessment services. Mr. Ross recently completed the implementation of a web based assessment screening system that focuses on the participant experience and minimizes the influences that technology may play in the screening process. This project also includes using assessment data to further prepare raters and evaluators for the assessment center exercises.
Mr. Ross is also working in conjunction with other assessment vendors to ensure that test taker rights and assessment practices are compliant with applicable ethic codes. He has contributed numerous papers and presentations to the annual conference of the Society for Industrial and Organizational Psychology, Inc.
Prior to joining Hogan Assessment Systems, Mr. Ross worked in selection groups at Belmont Construction, Brown and Root, and the Texas Department of Prisons.

