Back to search

Πανεπιστήμιο Μακεδονίας

Ανάπτυξη μεθοδολογικού πλαισίου για την αξιολόγηση της διδακτικής αποτελεσματικότητας στην τριτοβάθμια εκπαίδευση: συνδυασμός παραμετρικών / μη παραμετρικών τεχνικών και διαγραμμάτων ελέγχου σε φοιτητικές αξιολογήσεις

Abstract

dc:description

In the academic context, ensuring high-quality education requires, among other things, the development and utilization of coherent assessment frameworks. Statistical Quality Control (SQC) tools, such as control charts (CCs), are particularly important in this regard, as they enable the monitoring and evaluation of the quality of the educational process, the identification of areas for improvement, and evidence-based decision-making aimed at the continuous enhancement of the performance of all participants involved in the educational process. This doctoral dissertation addresses the development of an innovative framework based on SQC techniques, with the ultimate goal of systematically improving the educational experience of students in higher education institutions. The research approach focuses on the use of control charts as a central tool for real-time monitoring of the teaching performance and effectiveness of academic and research staff, allowing for the longitudinal capture and analysis of data derived from student evaluations. To achieve the research objectives, simulations of the student evaluation process were conducted, many of which were based on actual evaluation data. Particular emphasis was placed on a representative, yet significant, survey question concerning the overall performance of an instructor. Through the simulation of mean and median control charts (simple, exponentially weighted, cumulative, and moving average), computational models were developed, and the corresponding values of specific statistical performance criteria of the control charts, such as the average run length, the median, and the standard deviation of the run length distribution, were determined. Subsequently, the study focused on the comparative analysis of the performance of the aforementioned control charts. This approach allowed for conclusions regarding their behavior and effectiveness under different simulated evaluation scenarios. Specifically, two illustrative scenarios were examined: In the first scenario, the simulation was performed using evaluation data exhibiting negative skewness, with the majority of scores concentrated at higher values and lower scores appearing infrequently. Such distributions reflect common real-world cases in which students evaluate academic staff positively. In the second scenario, the simulation was based on a symmetric distribution of evaluations. The choice of this distribution was dictated by the need to examine the effect of skewness on the results and to avoid potential bias due to the different sensitivities of the two types of control charts—i.e., mean-based and median-based charts—to the characteristics of the distribution. To demonstrate the practical application of the proposed model and methodology, a real case study was presented in an actual educational environment, including the corresponding values and parameters for the evaluation of the control charts’ performance. This application highlighted the practical significance of the study’s theoretical findings, demonstrating the usefulness of control charts in assessing teaching effectiveness in higher education institutions. The dissertation concludes with the application of non-parametric statistical methods to the evaluation of academic staff performance, with particular emphasis on the Kruskal–Wallis test and Dunn’s post-hoc test. The primary objective of this research approach was to demonstrate the utility of these methods both for detecting statistically significant differences between evaluations—and, by extension, the performance—of academic staff members, and for conducting multiple pairwise comparisons to identify those individuals who differed in specific dimensions of teaching effectiveness, such as teaching quality, clarity of presentation, academic guidance, communication with students, and overall satisfaction of students’ educational needs. The application of these methods to real evaluation data from eight academic staff members at a Greek higher education institution illustrated their practical utility, highlighting their contribution to the process of assessing teaching effectiveness.

Degree

thesis:*
Grantor dc:publisher
Πανεπιστήμιο Μακεδονίας
Year dc:date
2026

Author and committee

dc:creator, dc:contributor.*
Authors dc:creator
  • Sivena, Sofia
  • Σιβένα, Σοφία

Subjects

dc:subject × 34

Rights

Language dc:language
gre

Identifiers

dc:identifier.*
Identifier
10.12681/eadd/60684

Chain of custody

source
Harvested from
Greek National Archive of PhD Theses
Base URL
phdtheses.ekt.gr/eadd_oai/request
Last updated
2026-11-18
Source record
OAI-PMH GetRecord
citation

Sivena, Sofia; Σιβένα, Σοφία. Ανάπτυξη μεθοδολογικού πλαισίου για την αξιολόγηση της διδακτικής αποτελεσματικότητας στην τριτοβάθμια εκπαίδευση: συνδυασμός παραμετρικών / μη παραμετρικών τεχνικών και διαγραμμάτων ελέγχου σε φοιτητικές αξιολογήσεις. Πανεπιστήμιο Μακεδονίας, 2026. http://hdl.handle.net/10442/hedi/60684