Back to search

University of Victoria (Canada)

Towards a big data analytics platform with Hadoop/MapReduce framework using simulated patient data of a hospital system

Abstract

dc:description.abstract

Background: Big data analytics (BDA) is important to reduce healthcare costs. However, there are many challenges. The study objective was high performance establishment of interactive BDA platform of hospital system. Methods: A Hadoop/MapReduce framework formed the BDA platform with HBase (NoSQL database) using hospital-specific metadata and file ingestion. Query performance tested with Apache tools in Hadoop’s ecosystem. Results: At optimized iteration, Hadoop distributed file system (HDFS) ingestion required three seconds but HBase required four to twelve hours to complete the Reducer of MapReduce. HBase bulkloads took a week for one billion (10TB) and over two months for three billion (30TB). Simple and complex query results showed about two seconds for one and three billion, respectively. Interpretations: BDA platform of HBase distributed by Hadoop successfully under high performance at large volumes representing the Province’s entire data. Inconsistencies of MapReduce limited operational efficiencies. Importance of the Hadoop/MapReduce on representation of health informatics is further discussed.

Degree

thesis:*
Level thesis:degree_level
Master of Science M.Sc.
Department thesis:degree_department
School of Health Information Science
Year dc:date.issued
2016

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Chrimes, Dillon
Advisor dc:contributor.supervisor
  • Kuo, Alex (Mu - Hsing)

Subjects

dc:subject × 10

Rights

dc:rights
Statement dc:rights
  • Available to the World Wide Web
Language dc:language.iso
en, English

Identifiers

dc:identifier.*
Dc Identifier Citation
Chrimes, D., Kuo, M-H., Moa, B., & Hu, W. (2016)a. Towards a Real-time Big Data Analytics Platform for Health Applications. International Journal of Big Data Intelligence. In Press.
Chrimes, D., Moa, B., Zamani, H., & Kuo, M-H. (2016)b. Interactive Healthcare Big Data Analytics Platform under Simulated Performance. 2016 IEEE 14th Intl Conf on Dependable, Autonomic and Secure Computing, 14th Intl Conf on Pervasive Intelligence and Computing, 2nd Intl Conf on Big Data Intelligence and Computing and Cyber Science and Technology Congress, 811-818.
Kuo, M.-H., Chrimes, D., Moa, B., & Hu, X. (2015). Design and Construction of a Big Data Analytics Framework for Health Applications. IEEE Proceedings International Conference on Smart City/SocialCom/SustainCom together with DataCom 2015 and SC2 2015, Chengdu, China. 631-636.

Chain of custody

source
Harvested from
University of Victoria (Canada)
Base URL
dspace.library.uvic.ca/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Chrimes, Dillon. Towards a big data analytics platform with Hadoop/MapReduce framework using simulated patient data of a hospital system. Master of Science M.Sc. thesis, 2016. http://hdl.handle.net/1828/7645