This study develops an instrument for evaluating the effectiveness of educational administrative performance in Korea. The purposes of this study are to determine the attitudes of 272 respondent Korean school administrators (elementary, middle, and high school principals and vice principals) toward the purposes of administrative evaluation, the elements of an administrative evaluation system, and the competencies that are needed for successful administrative performance. The survey instrument used is a two-part questionnaire that addresses the purposes and elements of administrative evaluation and administrative competencies. Four research questions are answered both by comparing the responses of position and school groups (utilizing a two-way analysis of variance) and rank ordering each item within each category by position and school groups.