University of North Florida. Department of Mathematics and Statistics
A comparative evaluation of data imbalance handling techniques in Machine Learning models for one-year mortality prediction in liver cirrhosis
Abstract
dc:description.abstractLiver cirrhosis is associated with substantial morbidity and mortality, making one-year mortality prediction a clinically relevant problem. Using a liver cirrhosis dataset as the motivating application, this thesis evaluates five machine learning classifiers—Logistic Regression, Random Forest, XGBoost, LightGBM, and CatBoost—under five class-imbalance handling strategies: Baseline learning, Random Oversampling, SMOTE-NC, ADASYN, and Cost-Sensitive Learning. Hyperparameter tuning was conducted using randomized search, and predictive performance was assessed over 200 iterations of Monte Carlo Cross-Validation using Accuracy, Precision, Recall, Fl-score, and ROC-AUC. The results suggest that imbalance-handling strategies can materially affect predictive performance, particularly recall. Because the outcome of interest is death within one year, recall is especially important, as low recall implies failure to identify true high-risk patients. Across the models, baseline learning often achieved high accuracy and, in many cases, high precision, but it generally yielded the weakest recall. In contrast, ADASYN, SMOTE-NC, and Cost-Sensitive Learning generally improved recall, while SMOTE-NC and Cost-Sensitive Learning often produced stronger Fl-scores, indicating a better balance between precision and recall. Overall, the findings suggest that no single imbalance-handling strategy is uniformly optimal across classifiers, but several such strategies can provide a more favorable balance among clinically relevant performance measures in this setting.
Degree
thesis:*- Name thesis:degree_name
- Master of Science in Mathematical Sciences (MS)
- Discipline thesis:degree_discipline
- Mathematics & Statistics
- Grantor
- University of North Florida. Department of Mathematics and Statistics
- Date dc:date.issued
- Spring
Author and committee
dc:creator, dc:contributor.*- Authors dc:creator
-
- Trisha, Sumiya Hasan
- Trisha, Sumiya Hasan, 1994-
- Advisors dc:contributor.advisor
-
- Heng, Fei
- Buziaianu, Elena
- Sa, Ping
- Contributors dc:contributor
-
- Dr. Fei Heng
- Dr. Elena Buziaianu
- Dr. Ping Sa
Subjects
dc:subject × 15- Thesis
- University of North Florida
- UNF
- Dissertations, Academic -- UNF -- Master of Science in Mathematical Science
- Dissertations, Academic -- UNF -- Mathematics
- Machine Learning
- Liver Cirrhosis
- One-Year Mortality Prediction
- Class Imbalance
- SMOTE-NC
- Cost-Sensitive Learning
- Biostatistics
- Statistical Methodology
- Statistical Models
- Liver -- Cirrhosis -- Mortality -- Forecasting -- Technological innovations; Liver -- Cirrhosis -- Mortality -- Mathematical models; Machine learning -- Evaluation -- Data processing; Liver -- Cirrhosis -- Mortality -- Prognosis -- Statistical methods
Rights
dc:rightsIdentifiers
dc:identifier.*- Repository record dc:identifier
- https://digitalcommons.unf.edu/etd/1415