Army Enlisted Personnel Competency Assessment Program Phase I.


Book Description

In the early 1990s, the Department of the Army abandoned its Skill Qualification Test (SQT) program due primarily to maintenance, development, and administration costs. Cancellation of the SQT program left a void in the Army's capabilities for assessing job performance qualification. To meet this need, the U.S. Army Research Institute for the Behavioral and Social Sciences (ARI) instituted a 3-year program of feasibility research related to development of a Soldier assessment system that is both effective and affordable. The PerformM21 program has two mutually supporting tracks. The first is a needs analysis that will result in design recommendations and identification of issues related to implementation of a competency assessment program. The second track is a demonstration of concept - starting with a prototype core assessment targeted to all Soldiers eligible for promotion to Sergeant, followed by job-specific prototype assessments for several Military Occupational Specialties. Experience with the prototype assessments will influence elaboration of the operational program design recommendations. The present report describes the needs analysis work and subsequent Army competency assessment program design recommendations as they stand at the end of the first year of the PerformM21 effort. A variety of areas are discussed, including program goals and policies as well as test content, design, development, and administration considerations.




Army Enlisted Personnel Competency Assessment Program: Phase III Pilot Tests


Book Description

"In the early 1990s, the Department of the Army abandoned its Skill Qualification Test (SOT) program due primarily to maintenance, development, and administration costs. This left a void in the Army's capabilities for assessing job performance qualification. To meet this need, the U.S. Army Research Institute for the Behavioral and Social Sciences (ARI) instituted a 3-year program of feasibility research related to the development of a Soldier assessment system that is both effective and affordable. The PerformM21 program has two mutually supporting tracks. The first focuses on the design of a testing program and identification of issues related to its implementation. The second track is a demonstration of concept - starting with a prototype core assessment targeted to all Soldiers eligible for promotion to Sergeant, followed by job-specific prototype assessments for several Military Occupational Specialties (MOS). The prototype assessments were developed during the first 2 years of the research program. The present report describes work conducted in the final year of the PerformM21 program, in which five prototype MOS-specific assessments (along with the common core examination) were pilot tested on a sample of specialists/corporals."--Stinet.




Technical Report


Book Description




Development of a Prototype Self-assessment Program in Support of Soldier Competency Assessment


Book Description

"Soldiers in the 21st century must possess the knowledge, skills, and other attributes to perform effectively in complex technical, information-rich environments. This study, Development of a Prototype Self-Assessment Program in Support of Soldier Competency Assessment, was conducted as a counterpart to the U.S. Army Research Institute for the Behavioral and Social Sciences' (ARI) Performance Measures for 21st Century Soldier Assessment (PerformM21). PerformM21 is a 3-year feasibility effort to identify viable approaches for an operational performance assessment system for Army enlisted personnel. In this study, the researchers identified the design and content of a self-assessment system (SAS) that would (a) help Soldiers feel confident about testing, (b) inform Soldiers about the junior noncommissioned officer (NCO) promotion system, and (c) familiarize Soldiers with the duties and responsibilities of NCOs. Information about best practices in the field of self-assessment/test preparation including what is done in the other Armed Services, academia, and the test industry was used to develop a prototype SAS that would explore the realm of test preparation functions, actions, and items that a typical Soldier would encounter during this phase. The prototype SAS reflects PerformM21 test parameters; it is web-based, targeted to E4 Soldiers, and focuses on the Army-wide core assessment."--P. i.







Validating Future Force Performance Measures (Army Class)


Book Description

To meet the challenges facing the Army, the Army needs predictor measures that will enhance entry-level Soldier selection and classification. One of the purposes of the Army Research Institute for Behavioral and Social Sciences (ARI's) Army Class project is to provide the Army with recommendations on which predictor measures, in particular measures of non-cognitive attributes (e.g., interests, values, and temperament), demonstrate the greatest potential to inform entry-level Soldier selection and classification decisions. The present report documents the development of criterion measures to assist in these analyses. A second purpose of the Army Class project is to develop and pilot job knowledge tests (JKTs) that can be used to aid reclassification decisions. If Soldiers are shown to possess critical knowledge, skills, and attributes (KSAs) for their new jobs, this could reduce training requirements and increase force readiness. This report documents the development of reclassification JKT test items.




Performance Measurement


Book Description

Over the course of the past few years, teaching, research, and practice has underscored the importance of performance measurement and criterion development as topics of great interest, considerable debate, and some misunderstanding. It has also become clear that the field needs to address a compendium of research, applications, and issues. Performance Measurement: Current Perspectives and Future Challenges brings together internationally recognized leaders in the field and each examines the subject matter in a way that has never been done--focusing on the dynamic nature of work and the tremendous demands being placed on assessment and measurement as core organizational activities. It also uniquely uses their expertise to provide critical pointers to not only the practical implications of work in the field, but also to the new and continuing issues to be addressed and research to be conducted. The book will be useful to both scientists and practitioners.




Validating Future Force Performance Measures (Army Class)


Book Description

The Army needs the best personnel to meet the emerging demands of the 21st century. Accordingly, the Army is seeking recommendations on new experimental predictor measures that could enhance entry-level Soldier selection and classification decisions, in particular, measures of non-cognitive attributes (e.g., interests, values, temperament). The U.S. Army Research Institute for the Behavioral and Social Sciences (ARI) is conducting a longitudinal criterion-related validation research effort to collect data to inform these recommendations. Data on experimental predictors were collected from about 11,000 Soldiers. Training criterion data were collected for differing subsets of the predictor sample in the first of three planned criterion measurement points. Soldiers were drawn from two samples: (a) job-specific samples targeting six entry-level Military Occupational Specialties (MOS) and (b) an Army-wide sample with no MOS-specific requirements. In the analyses reported here, the value of the experimental predictor measures to enhance new Soldier selection was examined. Overall, many of the experimental predictors significantly incremented the Armed Forces Qualification Test (AFQT) in predicting Soldier performance and retention during training. In addition, the experimental predictors generally exhibited smaller subgroup mean differences (by gender, race, and ethnicity) than the AFQT.




Prototype Procedures to Describe Army Jobs


Book Description

"Descriptions of Army jobs or Military Occupational Specialties (MOS) provide the foundation for Army personnel management, from entry-level selection and classification to training and performance management. However, existing job analysis approaches used in the Army have a number of limitations. This project represents the first step in a long-term research roadmap intended to address this issue (Campbell et al., 2007). The purpose of this project was to develop and field test a new prototype job analysis approach, customized to the Army, for describing entry-level enlisted jobs. Questionnaires measuring work and worker-oriented domains were developed and administered online to incumbents and supervisors in six MOS (N = 1,390): (a) Infantryman (11B), (b) Armor Crewman (19K), (c) Signal Support Specialist (25U), (d) Light-Wheel Vehicle Mechanic (63B), (e) Military Police (31B), and (f) Motor Transport Operator (88M). The results of the field test demonstrated that the questionnaires evidenced sufficient reliability and validity for describing enlisted jobs and feature a method that could be easily expanded Army-wide and at a reasonable cost. The report concludes with a summary of lessons learned from the field test and discussion of ways in which future research can enhance and extend the prototype approach."--P. i.