{"id":{"repo_id":"clemson","oai_identifier":"oai:open.clemson.edu:all_theses-5461"},"canonical_url":"https://search.ndltd.org/etd/clemson/oai:open.clemson.edu:all_theses-5461","repository":{"repo_id":"clemson","name":"Clemson University","base_url":"https://open.clemson.edu/do/oai/"},"display":{"title":"Optimizing Compression Efficiency with Adaptive Quantization Bit Depths","abstract":"Large-scale scientific instruments and applications generate massive amounts of data, lead- ing to significant challenges in data transfer and storage for analysis. This constitutes a major bottleneck to workflow efficiency and scientific throughput. Lossy compression offers a solution to these storage challenges in increasingly complex systems and services. Error-bounded lossy compression allows users to limit the error introduced during the compression process according to a user-defined metric and achieves significantly higher compression ratios than lossless compression for floating-point data. However, certain data types and compression configurations hinder the attainment of large compression ratios. To address the need for improved compression ratios in hard-to-compress data, this work introduces adaptive error quantization—a novel approach to lossy compression. Adaptive error quantization further refines the quantization of the error between the true value and the reconstructed value. When the original quantized error is excessively large or can be significantly improved, this method dynamically refines the quantized error by adding additional layers of quantization. This process enhances the accuracy of the reconstructed value while incurring minimal overhead. Adaptive error quantization provides a powerful tool for scientists to fine-tune the error introduced in lossy-compressed scientific datasets while simultaneously improving the compression ratio.","abstract_html":"Large-scale scientific instruments and applications generate massive amounts of data, lead- ing to significant challenges in data transfer and storage for analysis. This constitutes a major bottleneck to workflow efficiency and scientific throughput. Lossy compression offers a solution to these storage challenges in increasingly complex systems and services. Error-bounded lossy compression allows users to limit the error introduced during the compression process according to a user-defined metric and achieves significantly higher compression ratios than lossless compression for floating-point data. However, certain data types and compression configurations hinder the attainment of large compression ratios. To address the need for improved compression ratios in hard-to-compress data, this work introduces adaptive error quantization—a novel approach to lossy compression. Adaptive error quantization further refines the quantization of the error between the true value and the reconstructed value. When the original quantized error is excessively large or can be significantly improved, this method dynamically refines the quantized error by adding additional layers of quantization. This process enhances the accuracy of the reconstructed value while incurring minimal overhead. Adaptive error quantization provides a powerful tool for scientists to fine-tune the error introduced in lossy-compressed scientific datasets while simultaneously improving the compression ratio.","abstract_has_math":false,"creators":["Sisk, Carson"],"institution":null,"degree_name":"Master of Science (MS)","degree_level":"Thesis","degree_discipline":"Electrical and Computer Engineering (Holcomb Dept. of)","degree_department":null,"school":null,"contributors":["Jon C. Calhoun","Kuang-Ching Wang","Christophe Darnault"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":null,"date_issued":"","date_published":null,"updated_at":"2026-11-19T07:33:12Z","subjects":["Computing","Compression","Adaptive","Quantization","Clemson","Data Storage Systems"],"languages":[],"rights":[],"rights_urls":[],"identifier_entries":[],"person_identifier_entries":[]},"links":{"outbound_url":"https://open.clemson.edu/all_theses/4406","outbound_label":"Repository record","outbound_source":"dc:identifier","record_url":"https://open.clemson.edu/all_theses/4406","record_label":"Repository record","record_kind":"record","record_source":"dc:identifier","download_url":null,"download_label":null,"download_source":null,"access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://open.clemson.edu/do/oai/?verb=GetRecord&metadataPrefix=oai_etdms&identifier=oai%3Aopen.clemson.edu%3Aall_theses-5461","prefix":"oai_etdms"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Jon C. Calhoun","Kuang-Ching Wang","Christophe Darnault"]},{"key":"dc:creator","label":"Author","values":["Sisk, Carson"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.available","label":"Dc Date Available","values":["2024-11-28T08:00:00Z"]},{"key":"dc:date.created","label":"Dc Date Created","values":["2024-12-01T08:00:00Z"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Electrical and Computer Engineering (Holcomb Dept. of)"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Thesis"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Master of Science (MS)"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Computing","Compression","Adaptive","Quantization","Clemson","Data Storage Systems"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://open.clemson.edu/all_theses/4406"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["Large-scale scientific instruments and applications generate massive amounts of data, lead- ing to significant challenges in data transfer and storage for analysis. This constitutes a major bottleneck to workflow efficiency and scientific throughput. Lossy compression offers a solution to these storage challenges in increasingly complex systems and services. Error-bounded lossy compression allows users to limit the error introduced during the compression process according to a user-defined metric and achieves significantly higher compression ratios than lossless compression for floating-point data. However, certain data types and compression configurations hinder the attainment of large compression ratios. To address the need for improved compression ratios in hard-to-compress data, this work introduces adaptive error quantization—a novel approach to lossy compression. Adaptive error quantization further refines the quantization of the error between the true value and the reconstructed value. When the original quantized error is excessively large or can be significantly improved, this method dynamically refines the quantized error by adding additional layers of quantization. This process enhances the accuracy of the reconstructed value while incurring minimal overhead. Adaptive error quantization provides a powerful tool for scientists to fine-tune the error introduced in lossy-compressed scientific datasets while simultaneously improving the compression ratio."]},{"key":"dc:title","label":"Title","values":["Optimizing Compression Efficiency with Adaptive Quantization Bit Depths"]}]}],"canonical_facts":{"dc:contributor":["Jon C. Calhoun","Kuang-Ching Wang","Christophe Darnault"],"dc:creator":["Sisk, Carson"],"dc:date.available":["2024-11-28T08:00:00Z"],"dc:date.created":["2024-12-01T08:00:00Z"],"dc:description.abstract":["Large-scale scientific instruments and applications generate massive amounts of data, lead- ing to significant challenges in data transfer and storage for analysis. This constitutes a major bottleneck to workflow efficiency and scientific throughput. Lossy compression offers a solution to these storage challenges in increasingly complex systems and services. Error-bounded lossy compression allows users to limit the error introduced during the compression process according to a user-defined metric and achieves significantly higher compression ratios than lossless compression for floating-point data. However, certain data types and compression configurations hinder the attainment of large compression ratios. To address the need for improved compression ratios in hard-to-compress data, this work introduces adaptive error quantization—a novel approach to lossy compression. Adaptive error quantization further refines the quantization of the error between the true value and the reconstructed value. When the original quantized error is excessively large or can be significantly improved, this method dynamically refines the quantized error by adding additional layers of quantization. This process enhances the accuracy of the reconstructed value while incurring minimal overhead. Adaptive error quantization provides a powerful tool for scientists to fine-tune the error introduced in lossy-compressed scientific datasets while simultaneously improving the compression ratio."],"dc:identifier":["https://open.clemson.edu/all_theses/4406"],"dc:subject":["Computing","Compression","Adaptive","Quantization","Clemson","Data Storage Systems"],"dc:title":["Optimizing Compression Efficiency with Adaptive Quantization Bit Depths"],"thesis:degree_discipline":["Electrical and Computer Engineering (Holcomb Dept. of)"],"thesis:degree_level":["Thesis"],"thesis:degree_name":["Master of Science (MS)"]},"updated_at":"2026-11-19T07:33:12Z"}