Date of Award

12-2005

Degree Name

Doctor of Philosophy

Department

Educational Studies

First Advisor

Dr. Brooks Applegate

Second Advisor

Dr. Warren Lacefield

Third Advisor

Dr. Charles Coleman

Abstract

This dissertation focused on the creation and validation of a criterion referenced credentialing assessment of automotive service technicians' intersectional skills (ASTIS) proficiency. These intersectional skills are prerequisite and common to multiple job level tasks that an automotive service technician (AST) performs on the job. An assessment of the ASTIS was created to aid automotive technician employers in the evaluation of hiring prospective technician employees and is not duplicated by current certifications (e.g. ASE) as they do not uniquely assess these skills.

This dissertation focused on the ASTIS skills and the information an employer can obtain pertaining to a prospective employee's knowledge of them. There are four aims to this study. The first aim was to discover the domain of the ASTIS knowledge, concepts, and skills and to represent them in such a manner that a credentialing assessment can be created. The second aim was to construct and field test an ASTIS proficiency assessment (ASTISP Assessment). The third aim was to establish validity evidence of the ASTISP Assessment through contrasted groups and criterion related analyses. The fourth aim was to derive and set an initial cut score standard that would parallel existing AST credentialing assessments.

Results of the analyses indicated that the ASTISP Assessment had a good internal reliability estimate, α = .828. The concurrent validity relationship between the predictor assessment scores and the criterion scores are moderately low, rs = .355. The relationship's weakness was attributed to the criterion measurement's general rating scales as it was designed for the evaluating supervisors' technical skill level. External relationships between the ASTISP Assessment scores and developmental indicators exhibited moderate relationships, further indicating validity.

Contrasted groups analyses revealed 98.7% Discriminant Function Classification between AST experts and non-AST experts, indicating strong validity. Objective based contrasted group techniques were employed to derive two cut score standards. Discriminant Function Classifications were 100% correct for all three of the derived cut score groups. However, results of this reliable and valid assessment indicate that AST industry experts are in need of professional development for the ASTIS as the average score for the industry group was 58%.

Access Setting

Dissertation-Open Access

Download

Share

COinS