{"id":{"repo_id":"denver","oai_identifier":"oai:digitalcommons.du.edu:etd-3447"},"canonical_url":"https://search.ndltd.org/etd/denver/oai:digitalcommons.du.edu:etd-3447","repository":{"repo_id":"denver","name":"University of Denver","base_url":"https://digitalcommons.du.edu/do/oai/"},"display":{"title":"Real Time PII Scanning","abstract":"The increased amount of web applications and internet software solutions utilizing cloud frameworks has contributed to large data sets of system log messages being generated constantly. These messages may contain sensitive data, creating an additional security risk for the systems and contributing to the need for analysis of such large volumes of data in real time. Large commercial data monitoring systems can solve for these analysis requirements, but they can be costly. We present a solution to analyzing web application log data which ingests it, processes it and visualizes sensitive data found within in real time. Our solution utilizes an open source method for bulk data analysis and extraction of sensitive information, a digital forensics utility called Bulk Extractor. We focus specifically on Personally Identifiable Information (PII) artifacts present within log data as the targets for extraction. We call our solution the PII Scanner, and present prototype implementations of the scanner on the Amazon Web Services cloud platform, as well as results from tests performed on them to demonstrate their effectiveness and explore implementation options.","abstract_html":"The increased amount of web applications and internet software solutions utilizing cloud frameworks has contributed to large data sets of system log messages being generated constantly. These messages may contain sensitive data, creating an additional security risk for the systems and contributing to the need for analysis of such large volumes of data in real time. Large commercial data monitoring systems can solve for these analysis requirements, but they can be costly. We present a solution to analyzing web application log data which ingests it, processes it and visualizes sensitive data found within in real time. Our solution utilizes an open source method for bulk data analysis and extraction of sensitive information, a digital forensics utility called Bulk Extractor. We focus specifically on Personally Identifiable Information (PII) artifacts present within log data as the targets for extraction. We call our solution the PII Scanner, and present prototype implementations of the scanner on the Amazon Web Services cloud platform, as well as results from tests performed on them to demonstrate their effectiveness and explore implementation options.","abstract_has_math":false,"creators":["David, John"],"institution":null,"degree_name":"M.S. in Computer Science","degree_level":"Masters Thesis","degree_discipline":null,"degree_department":null,"school":null,"contributors":["Rinku Dewri","Tianjie Deng","Matt Rutherford"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":null,"date_issued":"","date_published":null,"updated_at":"2026-11-19T07:55:07Z","subjects":["Web application","Log data","Personally identifiable information (PII)","Extraction","Real-time data analysis","Bull Extractor","Amazon Web Services (AWS)","Cloud platform","Computer Engineering","Computer Sciences","Cybersecurity","Databases and Information Systems","Data Storage Systems","Information Security","Software Engineering"],"languages":["English (eng)"],"rights":["<p>Copyright is held by the author. User is responsible for all copyright compliance.</p>","John David"],"rights_urls":[],"identifier_entries":[],"person_identifier_entries":[]},"links":{"outbound_url":"https://digitalcommons.du.edu/etd/2472","outbound_label":"Repository record","outbound_source":"dc:identifier","record_url":"https://digitalcommons.du.edu/etd/2472","record_label":"Repository record","record_kind":"record","record_source":"dc:identifier","download_url":null,"download_label":null,"download_source":null,"access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://digitalcommons.du.edu/do/oai/?verb=GetRecord&metadataPrefix=oai_etdms&identifier=oai%3Adigitalcommons.du.edu%3Aetd-3447","prefix":"oai_etdms"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Rinku Dewri","Tianjie Deng","Matt Rutherford"]},{"key":"dc:creator","label":"Author","values":["David, John"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.copyright","label":"Dc Date Copyright","values":["2024-08-01T07:00:00Z"]},{"key":"dc:date.created","label":"Dc Date Created","values":["2024-08-24T07:00:00Z"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Masters Thesis"]},{"key":"thesis:degree_name","label":"Degree Name","values":["M.S. in Computer Science"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Web application","Log data","Personally identifiable information (PII)","Extraction","Real-time data analysis","Bull Extractor","Amazon Web Services (AWS)","Cloud platform","Computer Engineering","Computer Sciences","Cybersecurity","Databases and Information Systems","Data Storage Systems","Information Security","Software Engineering"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["English (eng)"]},{"key":"dc:rights","label":"Dc Rights","values":["<p>Copyright is held by the author. User is responsible for all copyright compliance.</p>"]},{"key":"dc:rights.holder","label":"Dc Rights Holder","values":["John David"]},{"key":"dc:rights.license","label":"Dc Rights License","values":["all_rights_reserved"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://digitalcommons.du.edu/etd/2472"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["The increased amount of web applications and internet software solutions utilizing cloud frameworks has contributed to large data sets of system log messages being generated constantly. These messages may contain sensitive data, creating an additional security risk for the systems and contributing to the need for analysis of such large volumes of data in real time. Large commercial data monitoring systems can solve for these analysis requirements, but they can be costly. We present a solution to analyzing web application log data which ingests it, processes it and visualizes sensitive data found within in real time. Our solution utilizes an open source method for bulk data analysis and extraction of sensitive information, a digital forensics utility called Bulk Extractor. We focus specifically on Personally Identifiable Information (PII) artifacts present within log data as the targets for extraction. We call our solution the PII Scanner, and present prototype implementations of the scanner on the Amazon Web Services cloud platform, as well as results from tests performed on them to demonstrate their effectiveness and explore implementation options."]},{"key":"dc:description.provenance","label":"Dc Description Provenance","values":["Received from Author"]},{"key":"dc:format","label":"Dc Format","values":["application/pdf"]},{"key":"dc:format.extent","label":"Dc Format Extent","values":["128 pgs","1.9 MB"]},{"key":"dc:title","label":"Title","values":["Real Time PII Scanning"]}]}],"canonical_facts":{"dc:contributor":["Rinku Dewri","Tianjie Deng","Matt Rutherford"],"dc:creator":["David, John"],"dc:date.copyright":["2024-08-01T07:00:00Z"],"dc:date.created":["2024-08-24T07:00:00Z"],"dc:description.abstract":["The increased amount of web applications and internet software solutions utilizing cloud frameworks has contributed to large data sets of system log messages being generated constantly. These messages may contain sensitive data, creating an additional security risk for the systems and contributing to the need for analysis of such large volumes of data in real time. Large commercial data monitoring systems can solve for these analysis requirements, but they can be costly. We present a solution to analyzing web application log data which ingests it, processes it and visualizes sensitive data found within in real time. Our solution utilizes an open source method for bulk data analysis and extraction of sensitive information, a digital forensics utility called Bulk Extractor. We focus specifically on Personally Identifiable Information (PII) artifacts present within log data as the targets for extraction. We call our solution the PII Scanner, and present prototype implementations of the scanner on the Amazon Web Services cloud platform, as well as results from tests performed on them to demonstrate their effectiveness and explore implementation options."],"dc:description.provenance":["Received from Author"],"dc:format":["application/pdf"],"dc:format.extent":["128 pgs","1.9 MB"],"dc:identifier":["https://digitalcommons.du.edu/etd/2472"],"dc:language":["English (eng)"],"dc:rights":["<p>Copyright is held by the author. User is responsible for all copyright compliance.</p>"],"dc:rights.holder":["John David"],"dc:rights.license":["all_rights_reserved"],"dc:subject":["Web application","Log data","Personally identifiable information (PII)","Extraction","Real-time data analysis","Bull Extractor","Amazon Web Services (AWS)","Cloud platform","Computer Engineering","Computer Sciences","Cybersecurity","Databases and Information Systems","Data Storage Systems","Information Security","Software Engineering"],"dc:title":["Real Time PII Scanning"],"thesis:degree_level":["Masters Thesis"],"thesis:degree_name":["M.S. in Computer Science"]},"updated_at":"2026-11-19T07:55:07Z"}