Scientific datasets from global-scale scientific models and remote sensing instruments are becoming available at greater spatial and temporal resolutions with shorter lag times. These data are frequently gridded measurements spanning two or three spatial dimensions, the time dimension, and often several data dimensions which vary by the specific dataset. These data are useful in many modeling and analysis applications across the geosciences. Unlike vector spatial datasets, raster spatial datasets lack widely adopted conventions in file formats, data organization, and dissemination mechanisms. Raster datasets are often saved using the Network Common Data Format (NetCDF), Gridded Binary (GRIB), Hierarchical Data Format (HDF), or Geographic Tagged Image File Format (GeoTIFF) file formats. Several of these are entirely or partially incompatible with common GIS software which introduces additional complexity in extracting values from these datasets. We present a method and companion Python package as a general-purpose tool for extracting time series subsets from these files using various spatial geometries. This method and tool enable efficient access to multidimensional data regardless of the format of the data. This research builds on existing file formats and software rather than suggesting new alternatives. We also present an analysis of optimizations and performance.

Η εξόρυξη χώρο-χρονικών δεδομένων αποτελεί πλέον μία από τις σημαντικότερες κατευθύνσεις του κλάδου της εξόρυξης γνώσης. Κάποια από τα βασικά προβλήματα που καλείται να αντιμετωπίσει είναι η ανακάλυψη περιοχών που εμφανίζουν ομοιότητες στην χρονική τους εξέλιξη, η αναγνώριση προτύπων που εμφανίζονται τόσο στην χωρική όσο και στη χρονική πληροφορία, η πρόβλεψη μελλοντικών τιμών και η αποθήκευση σε εξειδικευμένες βάσεις δεδομένων με σκοπό την αποδοτική απάντηση χωροχρονικών ερωτημάτων. Οι μέθοδοι που προσεγγίζουν τα παραπάνω προβλήματα καθώς και οι βασικές εργασίες της εξόρυξης γνώσης, όπως η κατηγοριοποίηση και η ομαδοποίηση, εμφανίζονται στον πυρήνα της πλειονότητας των εργαλείων ανάλυσης και επεξεργασίας χώρο-χρονικών δεδομένων. Βασικός στόχος της παρούσας εργασίας είναι η εφαρμογή μεθόδων εξόρυξης χώρο-χρονικών δεδομένων στο Ηλεκτροεγκεφαλογράφημα (ΗΕΓ), το οποίο αποτελεί μία από τις πιο διαδεδομένες τεχνικές ανάλυσης της εγκεφαλικής λειτουργίας. Τα δεδομένα που προκύπτουν από το ΗΕΓ περιέχουν τόσο χωρική όσο και χρονική πληροφορία καθώς αποτελούνται από ηλεκτρικά σήματα που προέρχονται από ηλεκτρόδια τοποθετημένα σε συγκεκριμένες θέσεις στο κρανίο. Τα βασικά προβλήματα που μελετήθηκαν στην επεξεργασία του ΗΕΓ είναι η μοντελοποίηση και η συσταδοποίηση χώρο-χρονικών δεδομένων, τα οποία οδήγησαν στην ανάπτυξη των αντίστοιχων μεθόδων. Στα πλαίσια της παρούσας εργασίας μελετήθηκε επίσης το πρόβλημα της διαχείρισης των δεδομένων ΗΕΓ και τη ανάλυσης ροών δεδομένων σε πραγματικό χρόνο. Η ενασχόληση με τα συγκεκριμένα προβλήματα οδήγησε α) στη δημιουργία καινοτόμων μεθόδων μοντελοποίησης και συσταδοποίησης χωρο-χρονικών δεδομένων, β) στον σχεδιασμό μιας βάσης δεδομένων, γ) στην μελέτη της βιβλιογραφίας στο θέμα της εξόρυξης και της διαχείρισης ροών δεδομένων και δ) στην δημιουργία μιας εφαρμογής για την ανάλυση δεδομένων σε πραγματικό χρόνο πάνω σε ένα σύστημα διαχείρισης ροών δεδομένων. Η παρούσα εργασία περιλαμβάνει ένα ένα σύνολο μεθόδων και εργαλείων ανάλυσης και διαχείρισης δεδομένων που εξετάστηκαν και χρησιμοποιήθηκαν προκειμένου να μελετηθεί η καταλληλότητά της εφαρμογής τους στις καταγραφές ΗΕΓ. Με τον τρόπο αυτό επιτυγχάνεται ο πρωταρχικός στόχος της εργασίας: η προώθηση υπαρχόντων και η δημιουργία καινοτόμων μεθόδων ανάλυσης από τον κλάδο της εξόρυξης γνώσης στα δεδομένα του ηλεκτροεγκεφαλογραφήματος. / Mining spatiotemporal data is one of the most significant topics in the field of data mining and knowledge discovery. Detecting locations that exhibit similarities in their temporal evolution, recognizing patterns that appear in both spatial and temporal information and storing spatiotemporal data in specialized databases are some of the fundamental problems tackled by researchers in this specific area. Methods and algorithms that address such problems along with the common data mining tasks (e.g. classification and clustering) are critical in the development of applications for analyzing spatiotemporal data, fact that highlights the necessity of continuous advancements of these algorithms in terms of usability, accuracy and performance. The most significant objective of the work performed during this thesis is the application of spatiotemporal data mining methods on the analysis of EEG, in order to exploit the both the spatial and the temporal nature of these data (i.e. electrodes placed on specific locations on the scalp that continuously record the electrical activity of the brain). Towards this direction the problems of modeling and clustering spatiotemporal data were extensively studied and the major outcome was the development of two corresponding methods. Furthermore, during this work the problem of managing EEG data was investigated both in the offline and the online scenario and within the latter, the state of the art in mining data streams was studied. The outcomes of this thesis related to the aforementioned problems include a) the development of a graph-based method for modeling spatiotemporal data, b) a method for clustering spatiotemporal data based on this model, c) the design of a database schema for storing eeg recording data and meta-data and d) the development of an application for online spindle detection over a data stream management system. Finally, this work aims towards the development of new and the adaptation of existing data mining methods in the context of spatiotemporal EEG analysis.

京都大学 / 0048 / 新制・課程博士 / 博士(情報学) / 甲第20508号 / 情博第636号 / 新制||情||110(附属図書館) / 京都大学大学院情報学研究科社会情報学専攻 / (主査)教授 吉川 正俊, 教授 田中 克己, 教授 岡部 寿男 / 学位規則第4条第1項該当 / Doctor of Informatics / Kyoto University / DFAM

This study analyzes snow maintenance data of Borlänge municipality of Sweden based on the data of 2017 to 2018. The goal of this study is to reduce operational overhead of snow maintenance, for example, fuel and time consumption of the snow maintenance vehicles, work hour of dedicated personnel, etc. Borlänge Energy equipped the snow maintenance vehicles with GPS devices which stored the record of the snow maintenance activities. The initial part of this study obtained insights out of the GPS data by using spatiotemporal data analysis. Derivation of the different snow maintenance treatments (plowing, sanding and salting) as well as the efficiency of the sub-contractors (companies which are responsible for snow maintenance) and inspectors (personnel who are liable to call the subcontractors if they think it is time for snow maintenance) are performed in the beginning of this study. The efficiency of the subcontractors and inspectors are measured to compare their performance with each other. The latter part of this study discusses a simulated annealing-based heuristics technique to find out optimal location for dispatching snow maintenance vehicles. In the existing system of snow maintenance, drivers of the maintenance vehicles decide to start location of maintenance work based on their experience and intuition, which might vary from one driver to another driver. The vehicle dispatch locations are calculated based on the availability of the vehicles. For example, if a subcontractor has three vehicles to perform snow maintenance on a specific road map, the proposed solution would suggest three locations to dispatch those vehicles. The purpose of finding the optimal dispatch location is to reduce the total travel distance of the maintenance vehicles, which yield less fuel and time consumption. The study result shows the average travel distance for 1, 3, and 5 vehicles on 15 road networks. The proposed solution would yield 18% less travel than the existing system of snow maintenance.

A model that emphasizes possible alternative sequences of events that occur over time is presented in paper 1 (chapter 2) of this dissertation. Representing alternative or branching events captures additional semantics unrealized by linear or non-branching approaches. Two basic elements of branching, divergence and convergence are discussed. From these elements, many complex branching models can be built capturing a perspective of events that take place in the future or have occurred in the past. This produces likely sequences of events that a user may compare and analyze using spatial or temporal criteria. The branching events model is especially useful for spatiotemporal decision support systems, as decision-makers are able to identify alternative locations and times of events and, depending on the context, also identify regions of multiple possible events. Based on the formal model, a conceptual framework for a branching events model for flood disasters is presented. The framework has five parts, an event handler, a query engine, data assimilator, web interface, and event database. A branching events viewer application is presented illustrating a case study based on a flood response scenario. A spatiotemporal framework for building evacuation events is developed to forecast building content evacuation events and building vulnerabilities and is presented in paper 2 (chapter 3) of this dissertation. This work investigates the spatiotemporal properties required to trigger building evacuation events in the floodplain during a flood disaster. The spatial properties for building risks are based on topography, flood inundation, building location, building elevation, and road access to determine five categories of vulnerability, vulnerable basement, flooded basement, vulnerable first-floor, flooded first-floor, and road access. The amount of time needed to evacuate each building is determined by the number of vulnerable floors, the number of movers, the mover rate, and the weight of the contents to be moved. Based upon these properties, six possible evacuation profiles are created. Using this framework, a model designed to track the spatiotemporal patterns of building evacuation events is presented. The model is based upon flood forecast predictions that are linked with building properties to create a model that captures the spatiotemporal ordering of building vulnerabilities and building content evacuation events. Applicable to different communities at risk from flooding, the evacuation model is applied a historical flood for a university campus, demonstrating how the defined elements are used to derive a pattern of vulnerability and evacuation for a campus threatened by severe flooding. Paper 3 (Chapter 4) of this dissertation presents a modeling approach for representing event-based response risk. Surveys were sent to emergency managers in six states to determine the priorities of decision makers during the response phase of flood disasters. Based on these surveys, nine response events were determined to be the most important during a flood response, flooded roads, bridges closed, residential evacuations, residential flooding, commercial flooding, agricultural damage, power outage, sheltering, sandbagging. Survey participants were asked to complete pairwise comparisons of these nine events. An analytic hierarchy process analysis was completed to weight the response events for each decision-maker. A k-means clustering analysis was then completed to form 4 distinct profiles, mixed rural and urban, rural, urban, and high population - low population density. The average weights from each profile were calculated. The weights for each profile were then assigned to geospatial layers that identify the locations of these events. These layers are combined to form a map representing the event-based response risk for an area. The maps are then compared against the response events that actually occurred during a flood disaster in June 2008 in two communities.

Modeling spatiotemporal data, in particular fuzzy and complex spatial objects representing geographic entities and relations, is a topic of great importance in geographic information systems, computer vision, environmental data management systems, etc. Because of complex requirements, it is challenging to design a database for spatiotemporal data and its features and to effectively query them. This thesis presents a new approach for modeling, indexing and querying the spatiotemporal data of fuzzy spatial and complex objects and/or spatial relations. As a case study, we model and implement a meteorological application in an intelligent database architecture, which combines an object-oriented database with a knowledge base.

The electric grid has been expanding both in size and the technologies used. As of the 2020s, the United States power grid consists of more than 9,200 electric generating units with more than 1 million megawatts of generating capacity connected to more than 300,000 miles of transmission lines. The United States electricity grid has rapidly expanded in recent decades, and the majority (over 70\%) of its infrastructure has exceeded 25 years of age. Due to its size and age, several challenges have emerged. Widespread power outages have been increasing across the United States. Between 2018 and 2020, more than 231,000 power outages occurred in the United States that lasted more than one hour, out of which 17,484 lasted at least eight hours. In the same period, the power outages resulted in an annual loss of 520 million customer hours across 2,447 U.S. counties. Moreover, and with the rapidly changing climate, between 2000 and 2021, approximately 83\% of significant power outages impacting a minimum of 50,000 customers in the United States were attributed to severe weather conditions. Lastly, the increasing use of renewables and other non-traditional generation methods forces the power system towards a more decentralized model, with many integrated systems constantly added to the grid. This decentralization adds additional burdens on controlling systems and grid operators. The rapid growth of technology and data storage allowed the deployment of sensing devices across the electric grid. Such technologies present a golden opportunity to tackle many of the electric grid's challenges. Despite that, such technologies presented many challenges simultaneously. With the large amounts of data, it became humanly impossible to comprehend, analyze, and use all collected data manually. While machine learning can be used to analyze smart grid data, this can be challenged by the nature of its data. Smart grid produces high-dimensional spatiotemporal data, and many applications require multi-modal data. Moreover, power systems' data quality challenges add complexities to model development. The data is noisy, contains missing segments, and usually has incomplete and inaccurate labels. In addition, interpreting machine learning models in the context of smart grids poses unique challenges. To address these challenges, different models for multiple smart-grid applications were introduced in this research, where each model focused on producing practical solutions for the challenges facing current-day smart grids. Using spatiotemporal data, a solar generation prediction model was proposed. The solution combined spatial and temporal data, then utilized machine learning embeddings to build datasets to train downstream models. This resulted in accurate prediction of solar generation across several settings. In addition to solar generation prediction, several models were introduced to detect, predict and explain power grid faults. A neural model is introduced to detect power faults from Phasor Measurement Unit (PMU) data. A novel method is introduced to preprocesses, de-noise, and combine high dimensional data, then this data is used to train novel neural methods that detect faults in multiple settings. This model addressed issues of high dimensionality and data quality. After that, several models studying power fault prediction and precursor discovery were introduced. A model that jointly predicts outages 6 hours ahead and produces explainable event precursors from multi-modal data is introduced. Where such precursors can assist power grid operators to take action to mitigate widespread power outages. Finally, a novel methodology is introduced that expands to previous work by predicting and extracting event precursors spatiotemporally 12 hours in advance. Where event precursors can be predicted on multiple spatial locations simultaneously, extracted spatiotemporal event precursors can help grid operators narrow down mitigation plans and help reduce the risk of widespread power outages. / Computer and Information Science

This thesis explores the use of spatiotemporal data mining in the air quality domain to understand causes of PM2.5 air pollution. PM2.5 refers to fine particulate matter less than 2.5 microns in diameter and is a major threat to human and environmental health. A review of air quality modeling methods is provided, emphasizing data-driven modeling techniques. While data mining methods have been applied to air quality data, including temporal sequence mining algorithms, spatiotemporal sequence mining methods have not been broadly applied to study air pollution. However, air pollution is highly spatial in nature, so such methods can offer new insights into air quality. This thesis applies one such method, the Spatiotemporal Sequence Miner (STS Miner) algorithm, to air quality data from a low-cost sensor network to explore causes and trends related to PM2.5. To facilitate the use of this method, an open-source library called OpenSTSMiner is developed to implement this algorithm. Various domain results are found; for instance, low temperature and low relative humidity are strongly associated with worsening levels of air quality. Lastly, to highlight the utility of the STS Miner algorithm, a comparison is presented between STS Miner and spatial Markov chains, another spatiotemporal modeling method used in the air quality domain.

This work is aimed for proposing acceptable indexing of moving objects. With the enlargement of mobile computing it is needed to manage large sets of spatiotemporal data. We introduce the problem of spatiotemporal data and basic general approaches of indexing these data. Further, we show support of spatial data in Oracle. The movement is typically represented as trajectory in two dimensional space with temporal component in third dimension. The thesis contains experiments performed in database Oracle on artificially generate data.

This thesis deals with the data mining in data stream which represents fast developing area of information technology. The text describes common principles of data mining, explains what data stream is and shows methods for its preprocessing and algorithms for following data mining. The special attention is given to the VFDT and the CVDT algorithm. The next mentioned are the spatiotemporal data and related data mining. The second part describes the design and implementation of the application for classification over spatiotemporal data stream represented by road traffic data and following prediction of spatiotemporal events (traffic-jams). The classification is performed by the VFDT and CVFDT algorithm. The application has been tested on the data set obtained by the simulation tool SUMO.