No description available.

This dissertation describes two distinctive methods for human-vehicle interaction recognition: one for ground level videos and the other for aerial videos. For ground level videos, this dissertation presents a novel methodology which is able to estimate a detailed status of a scene involving multiple humans and vehicles. The system tracks their configuration even when they are performing complex interactions with severe occlusion such as when four persons are exiting a car together. The motivation is to identify the 3-D states of vehicles (e.g. status of doors), their relations with persons, which is necessary to analyze complex human-vehicle interactions (e.g. breaking into or stealing a vehicle), and the motion of humans and car doors to detect atomic human-vehicle interactions. A probabilistic algorithm has been designed to track humans and analyze their dynamic relationships with vehicles using a dynamic context. We have focused on two ideas. One is that many simple events can be detected based on a low-level analysis, and these detected events must contextually meet with human/vehicle status tracking results. The other is that the motion clue interferes with states in the current and future frames, and analyzing the motion is critical to detect such simple events. Our approach updates the probability of a person (or a vehicle) having a particular state based on these basic observed events. The probabilistic inference is made for the tracking process to match event-based evidence and motion-based evidence. For aerial videos, the object resolution is low, the visual cues are vague, and the detection and tracking of objects is less reliable as a consequence. Any method that requires accurate tracking of objects or the exact matching of event definition are better avoided. To address these issues, we present a temporal logic based approach which does not require training from event examples. At the low-level, we employ dynamic programming to perform fast model fitting between the tracked vehicle and the rendered 3-D vehicle models. At the semantic-level, given the localized event region of interest (ROI), we verify the time series of human-vehicle relationships with the pre-specified event definitions in a piecewise fashion. With special interest in recognizing a person getting into and out of a vehicle, we have tested our method on a subset of the VIRAT Aerial Video dataset and achieved superior results. / text

Our society is increasingly demanding situation-aware smarter software (SASS) systems, whose goals change over time and depend on context situations. A system with such properties must sense their dynamic environment and respond to changes quickly, accurately, and reliably, that is, to be context-aware and self-adaptive. The problem addressed in this dissertation is the dynamic management of context information, with the goal of improving the relevance of SASS systems' context-aware capabilities with respect to changes in their requirements and execution environment. Therefore, this dissertation focuses on the investigation of dynamic context management and self-adaptivity to: (i) improve context-awareness and exploit context information to enhance quality of user experience in SASS systems, and (ii) improve the dynamic capabilities of self-adaptivity in SASS systems. Context-awareness and self-adaptivity pose signi cant challenges for the engineering of SASS systems. Regarding context-awareness, the rst challenge addressed in this dissertation is the impossibility of fully specifying environmental entities and the corresponding monitoring requirements at design-time. The second challenge arises from the continuous evolution of monitoring requirements due to changes in the system caused by self-adaptation. As a result, context monitoring strategies must be modeled and managed in such a way that they support the addition and deletion of context types and monitoring conditions at runtime. For this, the user must be integrated into the dynamic context management process. Concerning self-adaptivity, the third challenge is to control the dynamicity of adaptation goals, adaptation mechanisms, and monitoring infrastructures, and the way they a ect each other in the adaptation process. This is to preserve the eff ectiveness of context monitoring requirements and thus self-adaptation. The fourth challenge, related also to self-adaptivity,concerns the assessment of adaptation mechanisms at runtime to prevent undesirable system states as a result of self-adaptation. Given these challenges, to improve context-awareness we made three contributions. First, we proposed the personal context sphere concept to empower users to control the life cycle of personal context information in user-centric SASS systems. Second, we proposed the SmarterContext ontology to model context information and its monitoring requirements supporting changes in these models at runtime. Third, we proposed an effi cient context processing engine to discover implicit contextual facts from context information speci fied in changing context models. To improve self-adaptivity we made three contributions. First, we proposed a framework for the identi cation of adaptation properties and goals, which is useful to evaluate self-adaptivity and to derive monitoring requirements mapped to adaptation goals. Second, we proposed a reference model for designing highly dynamic self-adaptive systems, for which the continuous pertinence between monitoring mechanisms and both changing system goals and context situations is a major concern. Third, we proposed a model with explicit validation and veri cation (V&V) tasks for self-adaptive software, where dynamic context monitoring plays a major role. The seventh contribution of this dissertation, the implementation of Smarter-Context infrastructure, addresses both context-awareness and self-adaptivity. To evaluate our contributions, qualitatively and quantitatively, we conducted several comprehensive literature reviews, a case study on user-centric situation-aware online shopping, and a case study on dynamic governance of service-oriented applications. / Graduate