A cyber-security problem is a conflict-resolution scenario that typically consists of a security system and at least two decision makers (e.g. attacker and defender) that can each have competing objectives. In this thesis, we are interested in cyber-security problems where one decision maker has superior or better information. Game theory is a well-established mathematical tool that can be used to analyze such problems and will be our tool of choice. In particular, we will formulate cyber-security problems as stochastic games with asymmetric information, where game-theoretic methods can then be applied to the problems to derive optimal policies for each decision maker. A severe limitation of considering optimal policies is that these policies are computationally prohibitive. We address the complexity issues by introducing methods, based on the ideas of model predictive control, to compute suboptimal polices. Specifically, we first prove that the methods generate suboptimal policies that have tight performance bounds. We then show that the suboptimal polices can be computed by solving a linear program online, and the complexity of the linear program remains constant with respect to the game length. Finally, we demonstrate how the suboptimal policy methods can be applied to cyber-security problems to reduce the computational complexity of forecasting cyber-attacks.

This thesis consists of four independent papers concerningthe control of mobile robots in the context of obstacleavoidance and formation keeping. The first paper describes a new theoreticallyv erifiableapproach to obstacle avoidance. It merges the ideas of twoprevious methods, with complementaryprop erties, byusing acombined control Lyapunov function (CLF) and model predictivecontrol (MPC) framework. The second paper investigates the problem of moving a fixedformation of vehicles through a partiallykno wn environmentwith obstacles. Using an input to state (ISS) formulation theconcept of configuration space obstacles is generalized toleader follower formations. This generalization then makes itpossible to convert the problem into a standard single vehicleobstacle avoidance problem, such as the one considered in thefirst paper. The properties of goal convergence and safetyth uscarries over to the formation obstacle avoidance case. In the third paper, coordination along trajectories of anonhomogenuos set of vehicles is considered. Byusing a controlLyapunov function approach, properties such as boundedformation error and finite completion time is shown. Finally, the fourth paper applies a generalized version ofthe control in the third paper to translate,rotate and expanda formation. It is furthermore shown how a partial decouplingof formation keeping and formation mission can be achieved. Theapproach is then applied to a scenario of underwater vehiclesclimbing gradients in search for specific thermal/biologicalregions of interest. The sensor data fusion problem fordifferent formation configurations is investigated and anoptimal formation geometryis proposed. Keywords:Mobile Robots, Robot Control, ObstacleAvoidance, Multirobot System, Formation Control, NavigationFunction, Lyapunov Function, Model Predictive Control, RecedingHorizon Control, Gradient Climbing, Gradient Estimation. / QC 20111121

This research work provides the development of an Adaptive Flight Control System (AFCS) for autonomous hover of a Rotary-wing Unmanned Aerial Vehicle (RUAV). Due to the complex, nonlinear and time-varying dynamics of the RUAV, indirect adaptive control using the Model Predictive Control (MPC) is utilised. The performance of the MPC mainly depends on the model of the RUAV used for predicting the future behaviour. Due to the complexities associated with the RUAV dynamics, a neural network based black box identification technique is used for modelling the behaviour of the RUAV. Auto-regressive neural network architecture is developed for offline and online modelling purposes. A hybrid modelling technique that exploits the advantages of both the offline and the online models is proposed. In the hybrid modelling technique, the predictions from the offline trained model are corrected by using the error predictions from the online model at every sample time. To reduce the computational time for training the neural networks, a principal component analysis based algorithm that reduces the dimension of the input training data is also proposed. This approach is shown to reduce the computational time significantly. These identification techniques are validated in numerical simulations before flight testing in the Eagle and RMAX helicopter platforms. Using the successfully validated models of the RUAVs, Neural Network based Model Predictive Controller (NN-MPC) is developed taking into account the non-linearity of the RUAVs and constraints into consideration. The parameters of the MPC are chosen to satisfy the performance requirements imposed on the flight controller. The optimisation problem is solved numerically using nonlinear optimisation techniques. The performance of the controller is extensively validated using numerical simulation models before flight testing. The effects of actuator and sensor delays and noises along with the wind gusts are taken into account during these numerical simulations. In addition, the robustness of the controller is validated numerically for possible parameter variations. The numerical simulation results are compared with a base-line PID controller. Finally, the NN-MPCs are flight tested for height control and autonomous hover. For these, SISO as well as multiple SISO controllers are used. The flight tests are conducted in varying weather conditions to validate the utility of the control technique. The NN-MPC in conjunction with the proposed hybrid modelling technique is shown to handle additional disturbances successfully. Extensive flight test results provide justification for the use of the NN-MPC technique as a reliable technique for control of non-linear complex dynamic systems such as RUAVs.

This thesis addresses the problems of design and control of small cooperative unmanned autonomous quadrotor aerial vehicles. A new approach is proposed, for the modeling of the system’s dynamics using linearized Piecewise AffineModels. The Piecewise Affine dynamic–models cover a large part of the quadrotor’s flight envelope while also taking into account the additive effects of environmental disturbances. The effects of aerodynamic forces and moments were also examined. A small quadrotor is designed and developed that emphasizes in the areas of increased on–board computational capabilities, state estimation and modular connectivity. Based on the translational and rotational system’s dynamics: a) a switching model predictive controller, b) an explicitly solved constrained finite time optimal control strategy, and c) a cascade control scheme comprised of classical Proportional Integral Derivative control scheme augmented with angular acceleration feedback, were designed and experimentally tested in order to achieve trajectory tracking under the presence of wind–gusts. The efficiency of the proposed control methods was verified through extended experimental studies. The final quadrotor design utilizes a powerful control unit, a sensor system that provides state estimation based on inertial sensors, ultrasound sonars, GPS and vision chips, and an efficient actuating system. The research effort extended in the field of unmanned aerial vehicles cooperation. Cooperation strategies were proposed in order to address the problems of: a) Forest Fire Monitoring and b) Unknown Area Exploration and Target Acquisition. The Forest FireMonitoring algorithm is formulated based on consensus systems theory formulated as a spatiotemporal rendezvous problem in between the quadrotors. The Area Exploration and Target Acquisition algorithm is formulated based on market–based approaches. / Η συγκεκριμένη διατριβή καταπιάνεται με τα προβλήματα της σχεδίασης και ελέγχου μικρού μεγέθους συνεργαζόμενων μη επανδρωμένων αεροσκαφών με έμφαση στα συστήματα Κάθετης Απογείωσης και Προσγείωσης και ιδιαίτερα στη συστήματα τύπου Quadrotor. Μια νέα προσέγγιση για την μοντελοποίηση της δυναμικής του συστήματος η οποία βασίζεται στη θεωρία των Piecewise Affine συστημάτων προτείνεται. Η μοντελοποίηση με βάση τη θεωρία των Piecewise Affine συστημάτων καλύπτει ένα μεγάλο μέρος του φακέλου πτήσης του αεροσκάφους καθότι συνυπολογίζει μέρος της μη-γραμμικότητας του συστήματος ενώ παράλληλα δίνει τη δυνατότητα να χρησιμοποιηθούν τα ιδιαίτερα ανεπτυγμένα εργαλεία του γραμμικού ελέγχου. Αναπτύσσεται νέα πειραματική πλατφόρμα αεροσκάφους τύπου quadrotor η οποία χαρακτηρίζεται από ιδιαίτερες ικανότητες υπολογιστικής ισχύος, αυτόνομη εκτίμηση κατάστασης, πολλαπλή συνδεσιμότητα και αποδοτικό σύστημα πρόωσης. Η τελική πλατφόρμα quadrotor ελικοπτέρου UPATcopter ενσωματώνει μικρουπολογιστικό σύστημα υψηλών δυνατοτήτων, ειδικά συστήματα εκτίμησης κατάστασης τόσο σε εσωτερικούς όσο και σε εξωτερικούς χώρους μέρος των οποίων αναπτύχθηκε στα πλαίσια της διατριβής και αποδοτικό υποσύστημα πρόωσης. Τρεις διαφορετικοί νόμοι ελέγχου αναπτύχθηκαν και δοκιμάστηκαν πειραματικά. Αρχικά δοκιμάσθηκε ένας Constrained Finite Time Optimal Controller, ο οποίος υπολογίζεται πολύ-παραμετρικά και συνυπολογίζει την επίδραση των περιορισμών εισόδου και κατάστασης. Ο συγκεκριμένος ελεγκτής υπολογίσθηκε με βάση μια οικογένεια Piecewise Affine αναπαραστάσεων του υποσυστήματος προσανατολισμού και δοκιμάσθηκε επιτυγχάνοντας αποδοτικό έλεγχο του προσανατολισμού του σκάφους. Ακολούθως δοκιμάσθηκε ένας Switching Model Predictive Control βασισμένος στην Piecewise Affine μοντελοποίηση του συστήματος ο οποίος επίσης συνυπολογίζει την επίδραση των περιορισμών του συστήματος και του ρόλου των διαταραχών. Με τη χρήση αυτού του ελεγκτή επιτεύχθηκε έλεγχος προσανατολισμού και θέσης του αεροσκάφους τόσο σε άπνοια όσο και υπό την επίδραση ισχυρών διαταραχών ανέμου. Επιπρόσθετα, δοκιμάσθηκε ελεγκτής βασισμένος στη θεωρία PID ελέγχου επαυξημένος με ανάδραση γωνιακής επιτάχυνσης του συστήματος. Τέλος, η έρευνα επεκτάθηκε και στις στρατηγικές συνεργασίας μη επανδρωμένων αεροσκαφών προτείνοντας δύο αλγόριθμους. Συγκεκριμένα προτάθηκε αλγόριθμος για την αντιμετώπιση των προβλημάτων επιθεώρησης δασικής πυρκαγιάς και αλγόριθμος εξερεύνησης μιας άγνωστης περιοχής από ομάδα ετερογενών αεροσκαφών.

Thesis (MEng)--Stellenbosch University, 2014. / ENGLISH ABSTRACT: The development of fast and efficient processors, programmable devices and high power semiconductors has led to the increased use of semiconductors directly in the power supply path in order to achieve strict power quality standards. New and advanced algorithms are used in the process and calculated on-line to bring about the required fast response to voltage variations. Losses in high voltage semiconductors increase with increased operating frequencies. A balance between semiconductor power losses and power quality is achieved through control of power semiconductor switching frequencies. A predictive control algorithm to achieve high power quality and limit the power losses in the high power semiconductor switches through switching frequency control is discussed for a tap switched voltage regulator. The quality of power, voltage regulator topology and the control algorithm are discussed. Simulation results of output voltage and current are shown when the control algorithm is used to control the regulator. These results are verified by practical measurements on a synchronous buck converter. / AFRIKAANSE OPSOMMING: Die ontwikkeling van vinnige en doeltreffende verwerkers, programmeerbare toestelle en hoëdrywings halfgeleiers het gelei tot 'n groter gebruik van halfgeleiers direk in die kragtoevoer pad om streng elektriese toevoer kwaliteit standaarde te bereik. Nuwe en gevorderde algoritmes word gebruik in die proses en word aan-lyn bereken om die nodige vinnige reaksie tot spanningswisselinge te gee. Verliese in hoë-spannings halfgeleiers verhoog met hoër skakel frekwensies. 'n Balans tussen die halfgeleier drywingsverliese en spanningskwalteit is behaal deur die skakel frekwensie in ag te neem in die beheer. 'n Voorspellinde-beheer algoritme om ‘n hoë toevoerkwaliteit te bereik en die drywingsverliese in die hoëdrywingshalfgeleier te beperk, deur skakel frekwensie te beheer, is bespreek vir 'n tap-geskakelde spanning reguleerder. Die toevoerkwaliteit, spanningsreguleerder topologie en die beheer algoritme word bespreek. Simulasie resultate van die uittree-spanning en stroom word getoon wanneer die beheer algoritme gebruik word om die omsetter te beheer. Hierdie resultate is deur praktiese metings op 'n sinkrone afkapper.

Nous observons ces dernières années un besoin grandissant dans l’industrie pour des robots capables d’interagir et de coopérer dans des environnements confinés. Cependant, aujourd’hui encore, la définition de trajectoires sûres pour les robots industriels doit être faite manuellement par l’utilisateur et le logiciel ne dispose que de peu d’autonomie pour réagir aux modifications de l’environnement. Cette thèse vise à produire une structure logicielle innovante pour gérer l’évitement d’obstacles en temps réel pour des robots manipulateurs évoluant dans des environnements dynamiques. Nous avons développé pour cela un algorithme temps réel de génération de trajectoires qui supprime de façon automatique l’étape fastidieuse de définition d’une trajectoire sûre pour le robot.La valeur ajoutée de cette thèse réside dans le fait que nous intégrons le problème de contrôle optimal dans le concept de hiérarchie de tâches pour résoudre un problème d’optimisation non-linéaire efficacement et en temps réel sur un système embarqué aux ressources limitées. Notre approche utilise une commande prédictive (MPC) qui non seulement améliore la réactivité de notre système mais présente aussi l’avantage de pouvoir produire une bonne approximation linéaire des contraintes d’évitement de collision. La stratégie de contrôle présentée dans cette thèse a été validée à l’aide de plusieurs expérimentations en simulations et sur systèmes réels. Les résultats démontrent l’efficacité, la réactivité et la robustesse de cette nouvelle structure de contrôle lorsqu’elle est utilisée dans des environnements dynamiques. / In the field of industrial robots, there is a growing need for having cooperative robots that interact with each other and share work spaces. Currently, industrial robotic systems still rely on hard coded motions with limited ability to react autonomously to dynamic changes in the environment. This thesis focuses on providing a novel framework to deal with real-time collision avoidance for robots performing tasks in a dynamic environment. We develop a reactive trajectory generation algorithm that reacts in real time, removes the fastidious optimization process which is traditionally executed by hand by handling it automatically, and provides a practical way of generating locally time optimal solutions.The novelty in this thesis is in the way we integrate the proposed time optimality problem in a task priority framework to solve a nonlinear optimization problem efficiently in real time using an embedded system with limited resources. Our approach is applied in a Model Predictive Control (MPC) setting, which not only improves reactivity of the system but presents a possibility to obtain accurate local linear approximations of the collision avoidance constraint. The control strategies presented in this thesis have been validated through various simulations and real-world robot experiments. The results demonstrate the effectiveness of the new control structure and its reactivity and robustness when working in dynamic environments.

L'énergie est une ressource clé dans les réseaux de capteurs sans fil (WSNs), en particulier lorsque les nœuds capteurs sont alimentés par des batteries. Cette thèse s'inscrit dans le contexte de la réduction de la consommation de l'énergie d'un réseau de capteurs au niveau application construite au-dessus de ce réseau, grâce à des stratégies de contrôle, en temps réel et de façon dynamique. La première stratégie de gestion de l'énergie considérée s'appuie sur le contrôle prédictif (MPC). Le choix de MPC est motivé par les objectifs globaux qui sont de réduire la consommation d'énergie de l'ensemble des nœuds capteurs tout en assurant un service donné, nommé mission, pour le réseau de capteurs. En outre, un ensemble de contraintes sur les variables de contrôle binaires et sur les nœuds capteur doit être rempli. La deuxième stratégie de gestion de l'énergie au niveau de l'application utilise une approche de contrôle hybride (HDS). Ce choix est motivé par la nature inhérente du système WSN qui est par essence hybride, en particulier lorsque l'on s'intéresse à la gestion de l'énergie. La nature hybride vient essentiellement de la combinaison de processus physiques continus tels la charge et décharge des batteries des nœuds; tandis que la partie discrète est liée à la modification des modes de fonctionnement et l'état Inaccessible des nœuds. Les stratégies proposées sont évaluées et comparées en simulation sur des différents scenarios réalistes. Elles ont aussi \'et\'e mises en œuvre sur un banc d'essai réel et les résultats obtenus ont été discutés. / Energy is a key resource in Wireless Sensor Networks (WSNs), especially when sensor nodes are powered by batteries. This thesis is investigates how to save energy of the whole WSN, at the application level, thanks to control strategies, in real time and in a dynamic way. The first energy management strategy investigated is based on Model Predictive Control (MPC). The choice of MPC is motivated by the global objectives that are to reduce the energy consumption of the set of sensor nodes while ensuring a given service, named mission, for the sensor network. Moreover, a set of constraints on the binary control variables and on the sensor modes must be fulfilled. The second energy management strategy at the application level is based on a Hybrid Dynamical System (HDS) approach. This choice is motivated by the hybrid inherent nature of the WSN system when energy management is considered. The hybrid nature basically comes from the combination of continuous physical processes, namely, the charge / discharge of the node batteries; while the discrete part is related to the change in the functioning modes and the Unreachable condition of the nodes. The proposed strategies are evaluated and compared in simulation on a realistic test-case. Lastly, they have been implemented on a real test-bench and the results obtained have been discussed.

Constraint handling is difficult in model predictive control (MPC) of linear differential inclusions (LDIs) and linear parameter varying (LPV) systems. The designer is faced with a choice of using conservative bounds that may give poor performance, or accurate ones that require heavy online computation. This thesis presents a framework to achieve a more flexible trade-off between these two extremes by using a state tube, a sequence of parametrised polyhedra that is guaranteed to contain the future state. To define controllers using a tube, one must ensure that the polyhedra are a sub-set of the region defined by constraints. Necessary and sufficient conditions for these subset relations follow from duality theory, and it is possible to apply these conditions to constrain predicted system states and inputs with only a little conservatism. This leads to a general method of MPC design for uncertain-parameter systems. The resulting controllers have strong theoretical properties, can be implemented using standard algorithms and outperform existing techniques. Crucially, the online optimisation used in the controller is a convex problem with a number of constraints and variables that increases only linearly with the length of the prediction horizon. This holds true for both LDI and LPV systems. For the latter it is possible to optimise over a class of gain-scheduled control policies to improve performance, with a similar linear increase in problem size. The framework extends to stochastic LDIs with chance constraints, for which there are efficient suboptimal methods using online sampling. Sample approximations of chance constraint-admissible sets are generally not positively invariant, which motivates the novel concept of ‘sample-admissible' sets with this property to ensure recursive feasibility when using sampling methods. The thesis concludes by introducing a simple, convex alternative to chance-constrained MPC that applies a robust bound to the time average of constraint violations in closed-loop.

Esta dissertação de mestrado apresenta um novo esquema de controle de taxa hierárquico – HRC – para o padrão MVC – extensão para vídeos de múltiplas vistas do padrão H.264 – com objetivo de melhorar o aproveitamento da largura de banda oferecida por um canal entregando o vídeo comprimido com a melhor qualidade possível. Este esquema de controle de taxa hierárquico foi concebido para controlar de forma conjunta os níveis de quadro e de unidades básicas (BU). O esquema proposto explora a correlação existente entre as distribuições das taxas de bits em quadros vizinhos para predizer de forma eficiente o comportamento dos futuras bitrates através da aplicação de um controle preditivo baseado em modelos – MPC – que define uma ação de controle apropriada sobre as ações de adaptação do parâmetro de quantização (QP). Para prover um ajuste em granularidade fina, o QP é adicionalmente adaptado internamente para cada quadro por um processo de decisão de Markov (MDP) implementado em nível de BU capaz de considerar mapas com Regiões de Interesse (RoI). Um retorno acoplado aos dois níveis supracitados é realizado para garantir a consistência do sistema. Aprendizagem por Reforço é utilizada para atualizar os parâmetros do Controle Preditivo baseado em Modelos e do processo de decisão de Markov. Resultados experimentais mostram a superioridade da utilização do esquema de controle proposto, comparado às soluções estado-da-arte, tanto em termos de precisão na alocação de bits quanto na otimização da razão taxa-distorção, entregando um vídeo de maior qualidade visual nos níveis de quadros e de BUs. / This master thesis presents a novel Hierarchical Rate Control – HRC – for the Multiview Video Coding standard targeting an increased bandwidth usage and high video quality. The HRC is designed to jointly address the rate control at both framelevel and Basic Unit (BU)-level. This scheme is able to exploit the bitrate distribution correlation with neighboring frames to efficiently predict the future bitrate behavior by employing a Model Predictive Control that defines a proper control action through QP (Quantization Parameter) adaptation. To provide a fine-grained tuning, the QP is further adapted within each frame by a Markov Decision Process implemented at BU-level able to take into consideration a map of the Regions of Interest. A coupled frame/BU-level feedback is performed in order to guarantee the system consistency. A Reinforcement Learning method is responsible for updating the Model Predictive Control and the Markov Decision Process parameters. Experimental results show the superiority of the Hierarchical Rate Control compared to state-of-the-art solutions, in terms of bitrate allocation accuracy and rate-distortion, while delivering smooth video quality at both frame and Basic Unit levels.

abstract: Cigarette smoking remains a major global public health issue. This is partially due to the chronic and relapsing nature of tobacco use, which contributes to the approximately 90% quit attempt failure rate. The recent rise in mobile technologies has led to an increased ability to frequently measure smoking behaviors and related constructs over time, i.e., obtain intensive longitudinal data (ILD). Dynamical systems modeling and system identification methods from engineering offer a means to leverage ILD in order to better model dynamic smoking behaviors. In this dissertation, two sets of dynamical systems models are estimated using ILD from a smoking cessation clinical trial: one set describes cessation as a craving-mediated process; a second set was reverse-engineered and describes a psychological self-regulation process in which smoking activity regulates craving levels. The estimated expressions suggest that self-regulation more accurately describes cessation behavior change, and that the psychological self-regulator resembles a proportional-with-filter controller. In contrast to current clinical practice, adaptive smoking cessation interventions seek to personalize cessation treatment over time. An intervention of this nature generally reflects a control system with feedback and feedforward components, suggesting its design could benefit from a control systems engineering perspective. An adaptive intervention is designed in this dissertation in the form of a Hybrid Model Predictive Control (HMPC) decision algorithm. This algorithm assigns counseling, bupropion, and nicotine lozenges each day to promote tracking of target smoking and craving levels. Demonstrated through a diverse series of simulations, this HMPC-based intervention can aid a successful cessation attempt. Objective function weights and three-degree-of-freedom tuning parameters can be sensibly selected to achieve intervention performance goals despite strict clinical and operational constraints. Such tuning largely affects the rate at which peak bupropion and lozenge dosages are assigned; total post-quit smoking levels, craving offset, and other performance metrics are consequently affected. Overall, the interconnected nature of the smoking and craving controlled variables facilitate the controller's robust decision-making capabilities, even despite the presence of noise or plant-model mismatch. Altogether, this dissertation lays the conceptual and computational groundwork for future efforts to utilize engineering concepts to further study smoking behaviors and to optimize smoking cessation interventions. / Dissertation/Thesis / Doctoral Dissertation Bioengineering 2014