{"id":{"repo_id":"sdstate","oai_identifier":"oai:openprairie.sdstate.edu:etd2-1026"},"canonical_url":"https://search.ndltd.org/etd/sdstate/oai:openprairie.sdstate.edu:etd2-1026","repository":{"repo_id":"sdstate","name":"South Dakota State University","base_url":"https://openprairie.sdstate.edu/do/oai/"},"display":{"title":"Methods for Detecting Data Corruption in AVHRR Imagery","abstract":"During the 1980’s researchers began to explore the use of relatively low resolution data sets to monitor large geographical areas. The primary interest was to improve mapping, resource analysis, and land management activities. One of the sources of this data is from the Advanced Very High Resolution Radiometer, AVHRR, carried aboard satellite platforms operated by the National Oceanic and Atmospheric Administration, NOAA. These sensors are capable of providing a maximum of 1.1 km resolution at the orbital subpoint. The corresponding size of the generated data set is about 100 million bytes for a five band multi-spectral observation covering 10 million square kilometers of Earth geography. One of the more challenging problems associated with the computer processing of these large data sets is how to detect data corruption that may occur due to electrical noise and hardware malfunctions in the complex electronics and communication systems used to transfer the data from satellite platforms to the ultimate end users. This paper examines several of the more common disruption situations and presents a technique to efficiently search for corrupted data. A single pass, two stage, data search procedure is presented which utilizes statistical methods to filter out the corrupted data. One stage of the process, based on global line statistics, is designed to detect large scale problems. If global testing is inconclusive, a more localized inspection is performed to isolate regions of statistically outlying data. Simple analysis methods are then used to determine if there is a spatial pattern present indicating a corrupted region. Promising results from the prototype code included with this paper have prompted the EROS Data Center to begin formal testing and implementation of the ideas presented here within the framework of their AVHRR Data Acquisition and Processing System, ADAPS.","abstract_html":"During the 1980’s researchers began to explore the use of relatively low resolution data sets to monitor large geographical areas. The primary interest was to improve mapping, resource analysis, and land management activities. One of the sources of this data is from the Advanced Very High Resolution Radiometer, AVHRR, carried aboard satellite platforms operated by the National Oceanic and Atmospheric Administration, NOAA. These sensors are capable of providing a maximum of 1.1 km resolution at the orbital subpoint. The corresponding size of the generated data set is about 100 million bytes for a five band multi-spectral observation covering 10 million square kilometers of Earth geography. One of the more challenging problems associated with the computer processing of these large data sets is how to detect data corruption that may occur due to electrical noise and hardware malfunctions in the complex electronics and communication systems used to transfer the data from satellite platforms to the ultimate end users. This paper examines several of the more common disruption situations and presents a technique to efficiently search for corrupted data. A single pass, two stage, data search procedure is presented which utilizes statistical methods to filter out the corrupted data. One stage of the process, based on global line statistics, is designed to detect large scale problems. If global testing is inconclusive, a more localized inspection is performed to isolate regions of statistically outlying data. Simple analysis methods are then used to determine if there is a spatial pattern present indicating a corrupted region. Promising results from the prototype code included with this paper have prompted the EROS Data Center to begin formal testing and implementation of the ideas presented here within the framework of their AVHRR Data Acquisition and Processing System, ADAPS.","abstract_has_math":false,"creators":["Dewald, James D."],"institution":null,"degree_name":"Master of Science (MS)","degree_level":"Thesis - University Access Only","degree_discipline":"Electrical Engineering","degree_department":null,"school":null,"contributors":["Dennis Helder"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":null,"date_issued":"","date_published":null,"updated_at":"2026-11-19T09:03:11Z","subjects":["Electrical and Computer Engineering","Engineering"],"languages":["English"],"rights":[],"rights_urls":["http://rightsstatements.org/vocab/InC/1.0/"],"identifier_entries":[],"person_identifier_entries":[]},"links":{"outbound_url":"https://openprairie.sdstate.edu/etd2/85","outbound_label":"Repository record","outbound_source":"dc:identifier","record_url":"https://openprairie.sdstate.edu/etd2/85","record_label":"Repository record","record_kind":"record","record_source":"dc:identifier","download_url":null,"download_label":null,"download_source":null,"access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://openprairie.sdstate.edu/do/oai/?verb=GetRecord&metadataPrefix=oai_etdms&identifier=oai%3Aopenprairie.sdstate.edu%3Aetd2-1026","prefix":"oai_etdms"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Dennis Helder"]},{"key":"dc:creator","label":"Author","values":["Dewald, James D."]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.available","label":"Dc Date Available","values":["2021-10-28T07:00:00Z"]},{"key":"dc:date.created","label":"Dc Date Created","values":["1994-01-01T08:00:00Z"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Electrical Engineering"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Thesis - University Access Only"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Master of Science (MS)"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Electrical and Computer Engineering","Engineering"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language","label":"Dc Language","values":["English"]},{"key":"dc:rights","label":"Dc Rights","values":["http://rightsstatements.org/vocab/InC/1.0/"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://openprairie.sdstate.edu/etd2/85"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["During the 1980’s researchers began to explore the use of relatively low resolution data sets to monitor large geographical areas. The primary interest was to improve mapping, resource analysis, and land management activities. One of the sources of this data is from the Advanced Very High Resolution Radiometer, AVHRR, carried aboard satellite platforms operated by the National Oceanic and Atmospheric Administration, NOAA. These sensors are capable of providing a maximum of 1.1 km resolution at the orbital subpoint. The corresponding size of the generated data set is about 100 million bytes for a five band multi-spectral observation covering 10 million square kilometers of Earth geography. One of the more challenging problems associated with the computer processing of these large data sets is how to detect data corruption that may occur due to electrical noise and hardware malfunctions in the complex electronics and communication systems used to transfer the data from satellite platforms to the ultimate end users. This paper examines several of the more common disruption situations and presents a technique to efficiently search for corrupted data. A single pass, two stage, data search procedure is presented which utilizes statistical methods to filter out the corrupted data. One stage of the process, based on global line statistics, is designed to detect large scale problems. If global testing is inconclusive, a more localized inspection is performed to isolate regions of statistically outlying data. Simple analysis methods are then used to determine if there is a spatial pattern present indicating a corrupted region. Promising results from the prototype code included with this paper have prompted the EROS Data Center to begin formal testing and implementation of the ideas presented here within the framework of their AVHRR Data Acquisition and Processing System, ADAPS."]},{"key":"dc:title","label":"Title","values":["Methods for Detecting Data Corruption in AVHRR Imagery"]}]}],"canonical_facts":{"dc:contributor":["Dennis Helder"],"dc:creator":["Dewald, James D."],"dc:date.available":["2021-10-28T07:00:00Z"],"dc:date.created":["1994-01-01T08:00:00Z"],"dc:description.abstract":["During the 1980’s researchers began to explore the use of relatively low resolution data sets to monitor large geographical areas. The primary interest was to improve mapping, resource analysis, and land management activities. One of the sources of this data is from the Advanced Very High Resolution Radiometer, AVHRR, carried aboard satellite platforms operated by the National Oceanic and Atmospheric Administration, NOAA. These sensors are capable of providing a maximum of 1.1 km resolution at the orbital subpoint. The corresponding size of the generated data set is about 100 million bytes for a five band multi-spectral observation covering 10 million square kilometers of Earth geography. One of the more challenging problems associated with the computer processing of these large data sets is how to detect data corruption that may occur due to electrical noise and hardware malfunctions in the complex electronics and communication systems used to transfer the data from satellite platforms to the ultimate end users. This paper examines several of the more common disruption situations and presents a technique to efficiently search for corrupted data. A single pass, two stage, data search procedure is presented which utilizes statistical methods to filter out the corrupted data. One stage of the process, based on global line statistics, is designed to detect large scale problems. If global testing is inconclusive, a more localized inspection is performed to isolate regions of statistically outlying data. Simple analysis methods are then used to determine if there is a spatial pattern present indicating a corrupted region. Promising results from the prototype code included with this paper have prompted the EROS Data Center to begin formal testing and implementation of the ideas presented here within the framework of their AVHRR Data Acquisition and Processing System, ADAPS."],"dc:identifier":["https://openprairie.sdstate.edu/etd2/85"],"dc:language":["English"],"dc:rights":["http://rightsstatements.org/vocab/InC/1.0/"],"dc:subject":["Electrical and Computer Engineering","Engineering"],"dc:title":["Methods for Detecting Data Corruption in AVHRR Imagery"],"thesis:degree_discipline":["Electrical Engineering"],"thesis:degree_level":["Thesis - University Access Only"],"thesis:degree_name":["Master of Science (MS)"]},"updated_at":"2026-11-19T09:03:11Z"}