Evaluation is a process of investigating a project's implementation and results methodically and objectively. The evaluation problems in industry are extremely complicated and call for the examination of numerous qualitative and quantitative variables. Evaluators from different disciplines examine these variables. In order for the evaluators to collaborate during a broad evaluation process, there is a requirement for a collaborative evaluation methodology. In this research, a methodology for evaluation of any general application was implemented which is initially developed as part of a research effort supported by the Office of Naval Research. This technique is based on identifying the indicators to be applied in the evaluation of complex projects. In order to decrease complexity, these indicators are organized hierarchically which is modeled after the Analytic Hierarchy Process method. While at the top layer of this hierarchy is the subject we want to evaluate, towards the lower layers it is divided into more and more simple indicators. Therefore, the evaluators are responsible for assessing the project in terms of only the most simplified indicators. As a result, a precise evaluation which is not subject to human bias is accomplished. We have created a web-based application called Evaluator which allows the users to execute this methodology step by step. It simplifies the process by providing a user-friendly and easily accessible cloud-based platform in accordance with today's user experience principles. Although we have used this method and the software to evaluate projects, it is a tool that provides general usage for the assessment of a broad range of systems from various contexts. / Master of Science / Evaluation of a project is a process of systematic and objective assessment using a certain methodology. The evaluation problems we encounter in industry are quite complicated. This is due to the fact that a project must be evaluated in light of the numerous indicators it contains. Therefore, the project being assessed must be divided into these indicators as the first stage in the evaluation process. This layered form of the problem creates a hierarchical structure. Because the people who take part in evaluation are only capable of handling problems up to a certain level of complexity due to human nature. Therefore, it is essential to simplify problems to the point that those evaluating them can come to informed determinations. The strategy employed in this study makes it feasible to assess the primary subject of the evaluation effectively by limiting the evaluators to assessing only the most simplified indicators at the bottom of this hierarchy. This is the only task that the people in the evaluation process are responsible for. As a result, an accurate assessment not subject to human bias of error is achieved. We have created a web-based application called Evaluator which allows users to carry out this method's procedures. The user-friendly user interface of Evaluator makes it straightforward for people to take part in this complex process. Though we have used this approach and the software to assess projects, it is a flexible software which can be applied broadly for the assessment of a wide variety of systems from different contexts.
| Identifer | oai:union.ndltd.org:VTETD/oai:vtechworks.lib.vt.edu:10919/113577 |
| Date | 30 January 2023 |
| Creators | Onen, Gokce |
| Contributors | Computer Science and Applications, Balci, Osman, Tilevich, Eli, Barkhi, Reza |
| Publisher | Virginia Tech |
| Source Sets | Virginia Tech Theses and Dissertation |
| Language | English |
| Detected Language | English |
| Type | Thesis |
| Format | ETD, application/pdf |
| Rights | In Copyright, http://rightsstatements.org/vocab/InC/1.0/ |
Page generated in 0.0018 seconds