Rochester Institute of Technology
An Evidence-Based Ethical Risk Classification Framework (ERCF) for AI Policies
Abstract
dc:description.abstractThis thesis develops and evaluates an evidence-based Ethical Risk Classification Framework (ERCF) for analyzing substantive ethical engagement in AI policy documents. The study addresses the gap between high-level AI ethics principles and reproducible computational methods for comparative governance analysis. A secondary dataset of AI ethics policy recordswas used as the starting point. After retrieval, text extraction, and validation, a corpus of 44 policy documents was constructed from an initial 112 records (110 link-bearing entries). Supervised classification was implemented for four core dimensions: Accountability, Bias & Fairness, Privacy, and Transparency. A TF-IDF + Logistic Regression baseline was evaluated using stratified 5-fold cross-validation and compared with SVM, BERT, and BiLSTM models. Unsupervised topic modeling (LDA) was applied to provide complementary thematic structure beyond predefined labels. Findings show that classification is feasible across all four dimensions, with strongest baseline performance on Transparency and comparatively lower performance on Privacy. Across this dataset, interpretable baseline modeling remained competitive and stable relative to more complex architectures. ERCF probability outputs enabled document-level and grouped comparative indicators, showing variation in ethical emphasis across sectors and country groupings. LDA outputs identified recurring governance, privacy, technical, and social-impact discourse patterns. The thesis contributes a transparent end-to-end pipeline, empirical evidence on ethicstopic variation in policy texts, and a practical scoring layer (ERCF) for governance-oriented interpretation. Results are bounded by sample size, archival temporal coverage, and the absence of external ground-truth labeled validation data; therefore, conclusions are interpreted within these scope constraints.
Degree
thesis:*- Name thesis:degree_name
- Professional Studies (MS)
- Level thesis:degree_level
- Thesis
- Discipline thesis:degree_discipline
- Graduate Programs & Research
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Almarri, Ahmad
- Contributors dc:contributor
-
- Ioannis Karamitsos
Subjects
dc:subject × 9Identifiers
dc:identifier.*- Repository record dc:identifier
- https://repository.rit.edu/theses/12600