Development and validation of an instrument measuring undergraduate students' perceived holistic competencies

Abstract

There is a need to develop an instrument for undergraduate students to evaluate their holistic competencies. Such an instrument can not only be used as a tool for benchmarking but can also be used to enhance students’ awareness of their strengths and weaknesses, and to inform teaching by improving teachers’ understanding of their students. This study aims to develop and validate a questionnaire measuring undergraduate students’ perceived holistic competencies. A total of 2192 undergraduates from six out of the eight universities in Hong Kong participated in the study. Exploratory factor analysis was conducted on a random, stratified sample, followed by confirmatory factor analysis on the remaining sample. Six scales were obtained from exploratory factor analysis, namely (1) cultural sensitivity and global citizenship, (2) interpersonal and leadership competencies, (3) problem-solving and critical thinking skills, (4) self-understanding and resilience, (5) information literacy and (6) moral values. These six scales were supported by findings from confirmatory factor analysis, and Cronbach’s alpha values indicated the scales were reliable. Overall, psychometric properties of the instrument indicated that the instrument is sufficiently reliable and valid for use in educational practice and research.