Real-Time Optimization (RTO) is a family of techniques that pursue to improve the performance of chemical processes. As general scheme, the method reevaluates the process conditions in a frequent basis and tries to adjust some selected variables, taking into account the plant state, actual operational constraints and optimization objectives. Several RTO approaches have born from the academy research and industrial practices, at the same time that more applications have been implemented in real facilities. Between the main motivations to apply RTO are the dynamic of markets, the seek for quality in the process results and environmental sustainability. That is why the interest on deeply understand the phases and steps involved in an RTO application has increased in recent years. Nevertheless, the fact that most of the existing RTO systems have been developed by commercial organizations makes it difficult to meet that understanding. This work studies the nature of RTO systems from a software point of view. Software requirements for a generic system are identied. Based on that, a software architecture is proposed that could be adapted for specfic cases. Benefits of the designed architecture are listed. At the same time, the work proposes a new approach to implement that architecture as a Multi-Agent System (MAS). Two RTO system prototypes were developed then, one for a well-know academic case study and the other oriented to be used in a real unit. The benefits of the MAS approach and the architecture, for researching on the RTO field and implementation on real plants, are analyzed in the text. A sub-product of the development, a software framework covering main concepts from the RTO ontology, is proposed as well. As the framework was designed to be generic, it can be used in new applications development and extended to very specific scenarios. / Otimização em Tempo Real (OTR) é uma família de técnicas que buscam melhorar o desempenho dos processos químicos. Como esquema geral, o método reavalia frequentemente as condições do processo e tenta ajustar algumas variáveis selecionadas, levando em considera ção o estado da planta, restrições operacionais e os objetivos da otimização. Várias abordagens para OTR t^em surgido da pesquisa acadêmica e das práticas industriais, ao mesmo tempo em que mais aplicações têm sido implementadas em plantas reais. As principais motivações para aplicar OTR são: a dinâmica dos mercados, a busca de qualidade nos resultados dos processos e a sustentabilidade ambiental. É por isso que o interesse em entender as fases e etapas envolvidas em uma aplicação OTR cresceu nos últimos anos. No entanto, o fato de que a maioria dos sistemas OTR em operação foram desenvolvidos por organizações comerciais dificulta o caminho para chegar nesse entendimento. Este trabalho analisa a natureza dos sistemas OTR desde o ponto de vista do software. Os requerimentos para um sistema genérico são levantados. Baseado nisso, é proposta uma arquitetura de software que pode ser adaptada para casos específicos. Os benefícios da arquitetura projetada foram listados. Ao mesmo tempo, o trabalho propõe uma nova abordagem para implementar essa arquitetura: Sistema Multi-Agentes (SMA). Dois protótipos de sistema OTR foram desenvolvidos. O primeiro aplicado num estudo de caso bem conhecido na literatura acadêmica. O segundo voltado para ser usado em uma unidade industrial. Os benefícios da abordagem SMA e da arquitetura, tanto na pesquisa relacionada com OTR, quanto na implementação em plantas reais, são analisados no texto. Um arcabouço de software que abrange os principais conceitos da ontologia OTR é proposto como resultado derivado do desenvolvimento. O arcabouço foi projetado para ser genérico, possibilitando seu uso no desenvolvimento de novas aplicações OTR e sua extensão a cenários muito específicos.

Uma importante parte de um sistema multiagente é o seu mecanismo de coordenação que permite que os agentes possam agir de maneira coesa em direção aos seus objetivos, sejam eles individuais ou coletivos. Um agente pode optar por cooperar para atingir um determinado objetivo que seria inalcançável através de ações individuais, para realizar uma tarefa de maneira mais eficiente ou simplesmente porque ele foi projetado para tal. Em todos os casos, a formação de coalizões (grupos de agentes que concordam em coordenar suas ações em torno de um objetivo comum) é uma questão fundamental. O problema de geração de estruturas de coalizão entre agentes (conjunto de todas as combinações de coalizões) é um tópico de pesquisa que recebeu muita atenção principalmente na resolução do problema quando considerado como um jogo de função característica, onde o valor das coalizões independe dos agentes que não estão presentes nela. Essa abordagem, apesar de ser indicada para muitos tipos de problema, não cobre toda a área de pesquisa do assunto, visto que em muitos casos a criação de uma coalizão irá afetar os demais agentes do sistema. Quando o sistema possui agentes com objetivos sobrepostos ou contrários, uma coalizão cujos recursos são destinados a completar tais objetivos irá influenciar as demais coalizões desse sistema. Essa influência se chama externalidade e, nesses casos, o problema de formação de estruturas de coalizão deve ser tratado como um jogo de partição. Apesar das pesquisas na área de jogos de partição serem recentes, elas trazem resultados promissores e há alguns poucos algoritmos já desenvolvidos para buscar soluções a esse problema. A busca pela melhor estrutura de coalizão geralmente demanda que seja calculado o valor de todas possíveis coalizões, a fim de se encontrar aquele conjunto cuja soma dos valores das coalizões forneça o melhor resultado. Esse processo requer um alto número de computações e de memória, devido à natureza exponencial do problema. Assim, ao invés de apenas um agente central realizar todas as operações, é mais eficiente do ponto de vista do uso de recursos computacionais distribuir essas operações entres os diversos agentes presentes no sistema. Além dos benefícios computacionais, distribuir o processo de busca pela melhor estrutura de coalizão permitiria trabalhar com questões como privacidade e tolerância a falhas, tendo em vista que as informações não estão concentradas em um único agente. Apesar disso, não há na literatura qualquer algoritmo capaz de solucionar o problema de geração de estrutura de coalizão em ambientes distribuídos e que sejam modelados como jogos de partição. A proposta desse trabalho é utilizar a fundamentação teórica existente acerca do problema de formação de estruturas de coalizão (modelados tanto como jogos de função característica quanto como jogos de partição) para criar um algoritmo distribuído capaz de encontrar a estrutura de coalizão ótima em ambientes que possuam externalidade. Esse algoritmo utiliza como base a ordenação das coalizões e dos agentes para permitir a distribuição do cálculo dos limites superiores e inferiores de cada coalizão. Após, esses valores são utilizados para se encontrar o subespaço mais provável de conter a estrutura de coalizão ótima. Com base nos experimentos, percebe-se que o algoritmo encontrou a estrutura de coalizão ótima buscando em apenas uma pequena parte do espaço de busca. Para os experimentos com 16 agentes, o algoritmo foi capaz de encontrar a solução ótima procurando em apenas 0,01% do espaço de busca. Também, é demonstrado que em cenários com externalidade negativa os agentes necessitaram investigar um espaço de busca menor para encontrar a estrutura de coalizão ótima que em cenários com externalidade positiva. Experimentos também demonstram que o algoritmo não consegue encontrar a estrutura de coalizão ótima quando há falhas na comunicação entre os agentes. / An important part of a multi-agent system is its coordination mechanism that allows the agents to act cohesively towards their goals, whether individual or collective. An agent can choose to cooperate to achieve a certain goal that would be unattainable through individual actions, to perform a task more efficiently or simply because it was designed to do so. In all cases, the formation of coalitions (group of agents that agree to coordinate their actions around a common goal) is a key issue. The problem of generating coalition structures between agents (set of all combinations of coalitions) is a research topic that has received much attention mostly on solving the problem when considered as a characteristic function game, where the value of coalitions is independent of agents that are not part of it. This approach, although suitable for many types of problem, does not cover the whole area of research on the subject, since in many cases the creation of a coalition will affect the other agents of the system. When the system has agents with overlapping goals or opposing goals, a coalition whose resources are devoted to completing these objectives will influence the other coalitions of that system. This influence is called externality, and in these cases, the problem of formation of coalition structures should be treated as a partition function game. Although research in the area of partition games is recent, it brings promising results and there are few algorithms already developed to find solutions to this problem. The search for the best coalition structure generally requires computation of the value of all possible coalitions in order to find the set that the sum of the values of the coalitions provides the best result. This process requires a large number of computations and memory due to the exponential nature of the problem. Hence, instead of just one central agent performing all operations, it is more efficient to distribute those operations among several agents. Besides the computational benefits, distributing the search process for the best coalition structure would address issues such as privacy and fault tolerance, given that the information is not concentrated in a single agent. Nevertheless, in the literature there is not algorithm capable of solving the problem of coalition structure generation in decentralized environments and modeled as partition function game. The purpose of this work is to use the existing theoretical foundations for solving the coalition structure generation problem (modeled both as a characteristic function game and as a partition function game) to create a distributed algorithm capable of finding the optimal coalition structure in environments that have externality. This algorithm uses as a base the ordering of coalitions and agents to distribute the calculation of the upper and lower limits for each coalition. Afterwards, these values are used to find the subspace more likely to contain the optimal coalition structure. Based on experiments, the algorithm found the optimal coalition structure searching only a small part of the search space. For the experiments with 16 agents, the algorithm was able to find the solution looking at just 0.0001%of the search space. Also, it is shown that in scenarios with negative externality agents need to investigate a smaller search space to find the optimal coalition structure than in scenarios with positive externality. Experiments also show that the algorithm can not find the optimal coalition structure when there are failures in the communication among the agents.

Un certain nombre de travaux basés sur les réseaux de capteurs sans fil s'intéressent à la gestion de l'énergie de ces capteurs. Cette énergie est, de fait, un facteur critique dans le fonctionnement de ces réseaux. Une construction adéquate des clusters de capteurs est un très bon moyen pour minimiser la consommation de cette énergie. La problématique liée à ces réseaux réside ainsi souvent dans leur durée de vie mais aussi dans le nécessaire maintien de la connectivité entre tous les capteurs. Ces deux aspects sont étroitement liés. Dans cette thèse, nous nous sommes focalisés sur ces deux volets, dans le contexte de réseaux de capteurs statiques mais aussi celui de capteurs mobiles.Nous proposons, dans un premier temps, un algorithme hybride pour la mise en place des clusters et la gestions de ces clusters. L'originalité de cette solution réside dans la mise en place de zones géographiques de désignation des cluster heads mais aussi dans la transmission, dans les messages échangés, de la quantité d'énergie restante sur les capteurs. Ainsi, les données sur les capteurs permettront de désigner les cluster heads et leurs successeurs qui détermineront les seuils pour les autres capteurs et pour leur fonctionnement. L'algorithme est testé à travers de nombreuses simulations. La seconde partie du travail consiste à adapter notre premier algorithme pour les réseaux de capteurs mobiles. Nous in_uons sur la trajectoire des capteurs pour maintenir la connectivité et limiter la consommation d'énergie. Pour cela, nous nous inspirons de l'écho-localisation pratiquée par les chauvessouris. Nous nous sommes donc intéressés à la topologie changeante et dynamique dans les réseaux de capteurs. Nous avons analysé la perte d'énergie en fonction de la distance et de la puissance de transmission entre les n÷uds et le cluster head. Nous évaluons également notre algorithme sur des capteurs qui ont un déplacement aléatoire. Nous appliquons ces algorithmes à une simulation de _otte de drones de surveillance. / A number of works based on wireless sensor networks are interested in the energy management of these sensors. This energy is in fact a critical factor in the operation of these networks. Proper construction of sensor clusters is a great way to minimize the consumption of this energy. The problems related to these networks and often lies in their lifetime but also in the need to maintain connectivity between all transducers. These two aspects are closely linked. In this thesis, we focused on these two aspects in the context of static sensor networks but also of mobile sensors.We propose, as a _rst step, a hybrid algorithm for setting up clusters and the management of theseclusters. The uniqueness of this solution lies in the establishment of geographic areas for designation fcluster heads but also in transmission, in the exchanged messages, the amount of remaining energy on the sensors. Thus, the sensor data will designate the cluster heads and their successors will determine the thresholds for other sensors and for their operation. The algorithm is tested through many simulations. The second part of the work is to adapt our _rst algorithm for mobile sensor networks. We a_ect the trajectory of sensors to maintain connectivity and reduce energy consumption. For this, we are guided echo-location practiced by bats. We're interested in changing and dynamic topology in sensor networks. We analyzed the loss of energy as a function of the distance and the power transmission between the nodes and the head cluster. We also evaluate our algorithm on sensors that have a random move. We apply these algorithms to a _eet of surveillance drones simulation.

La complexité des systèmes de transport rend difficile la maîtrise de leur conception dans la mesure où ils intègrent des composantes technologiques, mais aussi sociologiques et politiques. Il est alors opportun de proposer un système destiné à aider à la définition d’une politique de transport urbain. L’objectif principal de notre recherche est de proposer l’architecture logicielle d’un outil de simulation visant à aider un décideur, chargé de la régulation d’un système de transport urbain, pour son travail d’analyse et d’évaluation des impacts des stratégies de régulation. Notre système est basé sur un simulateur à base d’agents intégrant des informations géographiques et temporelles pour évaluer des scénarii de régulation. En termes d’architecture du système, nous avons adopté une approche «système de systèmes», principalement structurée par couches, afin de modéliser les principaux éléments du système. La validation de notre outil de simulation a pu être effectuée à partir d’une étude de cas de taille et de complexité significative puisque nous disposons des enquêtes de déplacement, de recensement, et des mesures de trafic. Nous avons réalisé un prototype pour les déplacements des usagers dans la ville de La Rochelle à partir des données statistiques de l’INSEE et de la BD TOPO 2 de l’IGN en utilisant la plate-forme de simulation GAMA. / Transport systems are becoming more complex and must incorporate not only technological components, but also sociological and political ones. In particular, they should be easy to adapt in order to incorporate the goals set by decision makers, such as the integration of sustainable development settings. The main objective of our research is to propose software architecture of a simulation tool to help a decision maker, responsible for the regulation of an urban transportation system to analyze and evaluate the impacts of regulatory strategies. We propose a system to assist in the definition of an urban transportation policy. Our system is based on an agent-based simulation integrating spatial and temporal information to evaluate regulatory scenarios. In terms of system architecture, we adopted a “system of systems” approach, mainly structured in layers, in order to model the main elements of the system. The validation of our simulation tool could be done from a case study of significant size and complexity because we have travel surveys, census, and traffic measurements. We made a prototype for the movement of people in the city of La Rochelle from statistical data of INSEE and the BD TOPO 2 of IGN using the GAMA platform.

La croissance du trafic aérien a rendu critique l’opération de la gestion des plateformes aéroportuaires. Celle-ci fait appel à de nombreux acteurs (autorités aéroportuaires, compagnies aériennes, contrôle du trafic aérien, prestataires de services, …). Le concept d’Airport Collaborative Decision Making (A-CDM) développé depuis une dizaine d’années est basé sur un partage d’informations opérationnelles en temps réel entre les différents acteurs de la plate-forme, permettant de prendre des décisions en commun pour rechercher une utilisation optimale, en toutes conditions, des capacités de l’aéroport. L’objectif principal de cette thèse est de contribuer à l’organisation de la gestion des opérations d’escale dans une plateforme aéroportuaire. Il s’agit de proposer une structure d’organisation de cette opération qui soit compatible avec l’approche A-CDM. La structure proposée introduit un coordinateur des opérations d’escale (GHC) qui joue le rôle d’interface de communication entre les partenaires de l’A-CDM et les différents gestionnaires des opérations d’escale (GHM). Cette structure hiérarchique permet d’une part de partager des informations avec les partenaires de l’A-CDM et d’autre part d’interagir avec les gestionnaires des opérations d’escale (GHM). Les processus de prise de décision basés sur des heuristiques ont été développés à chaque niveau de l’organisation proposée et sont évalués aussi bien dans le cas de conditions nominales que dans le cas de la présence de perturbations majeures. / The increase of the world air traffic growth of the last decades has generated a permanent challenge for civil aviation authorities, airlines and airports to supply sufficient capacity to provide a safe transportation service with acceptable quality standards. New traffic management practices, such as A-CDM, based on multi-agent and collaborative decision making concepts have been introduced at airports. However, within the turnaround process of aircraft at airports, ground handling management of aircraft has not been developed specifically in the A-CDM approach, even if it has an important role in the fluidity of aircraft operations at airports. The main objective of this thesis dissertation is to contribute to the organisation of the ground handling management at airports. It consists to provide a structure organize the ground handling management compatible with the A -CDM concept. The proposed structure introduces a ground handling coordinator (GHC) which is considered as an interface for communication between the partners of the A -CDM and the different ground handling managers (GHM). This hierarchical structure allows sharing information with partners in the A -CDM on the one side and on the other side, interacting with ground handling managers (GHM). Decision making processes based on heuristics have been developed at each level of the proposed organization and have been also evaluated in the case of nominal conditions and in the case of the presence of major disruptions.

abstract: In order to deploy autonomous multi-robot teams for humanitarian demining in Colombia, two key problems need to be addressed. First, a robotic controller with limited power that can completely cover a dynamic search area is needed. Second, the Colombian National Army (COLAR) needs to increase its science, technology and innovation (STI) capacity to help develop, build and maintain such robots. Using Thangavelautham's (2012, 2017) Artificial Neural Tissue (ANT) control algorithm, a robotic controller for an autonomous multi-robot team was developed. Trained by a simple genetic algorithm, ANT is an artificial neural network (ANN) controller with a sparse, coarse coding network architecture and adaptive activation functions. Starting from the exterior of open, basic geometric grid areas, computer simulations of an ANT multi-robot team with limited time steps, no central controller and limited a priori information, covered some areas completely in linear time, and other areas near completely in quasi-linear time, comparable to the theoretical cover time bounds of grid-based, ant pheromone, area coverage algorithms. To mitigate catastrophic forgetting, a new learning method for ANT, Lifelong Adaptive Neuronal Learning (LANL) was developed, where neural network weight parameters for a specific coverage task were frozen, and only the activation function and output behavior parameters were re-trained for a new coverage task. The performance of the LANL controllers were comparable to training all parameters ab initio, for a new ANT controller for the new coverage task. To increase COLAR's STI capacity, a proposal for a new STI officer corps, Project ÉLITE (Equipo de Líderes en Investigación y Tecnología del Ejército) was developed, where officers enroll in a research intensive, master of science program in applied mathematics or physics in Colombia, and conduct research in the US during their final year. ÉLITE is inspired by the Israel Defense Forces Talpiot program. / Dissertation/Thesis / Doctoral Dissertation Applied Mathematics for the Life and Social Sciences 2019

Multi-agent robotic system have been proved to be more superior in undertaking functionalities, arduous or even impossible when performed by single agents. The increased efficiency in multi agent systems is achieved by the execution of the task in cooperative manner. But to achieve cooperation in multi agent systems, a good localization system is an important prerequisite. Currently, most of the multi-agent system rely on the use of the GPS to provide global positioning information which suffers great deterioration in performance in indoor applications, and also all to all communication between the agents will be required which is not efficient especially when the number of agents is large. In this regard, a real-time localization scheme is introduced which makes use of the robot’s on-board sensors and computational capabilities to determine the states of other agents in the multi agent system. This algorithm also takes the advantage of the swarming behaviour of the robots in the estimation of the states. This localization algorithm was found to produce more accurate agent state estimates as compared to a similar localization algorithm that does not take into account the swarming behaviour of the agents in simulations and real experiment involving two Unmanned Aerial Vehicles.

Le formalisme CSP (Problème de Satisfaction de Contraintes) permet de représenter de nombreux problèmes de manière simple et efficace. Cependant, une partie de ces problèmes ne peut être résolue de manière classique et centralisée. Les causes peuvent être diverses : temps de rapatriement des données prohibitif, sécurité des données non garantie, etc. Les CSP Distribués(DisCSP), domaine intersectant celui des SMA et des CSP, permettent de modéliser et de résoudre ces problèmes naturellement distribués. Les raisonnements intra-agent et inter-agents sont alors basés sur un ensemble de relations entre différentes variables. Les agents interagissent afin de construire une solution globale à partir des solutions locales. Nous proposons, dans ce travail, un algorithme de résolution de DisCSP nommé Distributed Backtracking with Sessions (DBS) permettant de résoudre des DisCSP où chaque agent dispose d’un problème local complexe. DBS a la particularité de ne pas utiliser de nogoods comme la majorité des algorithmes de résolution de DisCSP mais d’utiliser à la place des sessions. Ces sessions sont des nombres permettant d’attribuer un contexte à chaque agent ainsi qu’à chaque message échangé durant la résolution du problème. Il s’agit d’un algorithme complet permettant l’utilisation de filtres sur les messages échangés sans remettre en cause la preuvede complétude. Notre proposition est évaluée, dans les cas mono-variable et multi-variables par agents, sur différents benchmarks classiques (les problèmes de coloration de graphes distribués et les DisCSP aléatoires) ainsi que sur un problème d’exploration en environnement inconnu. / The CSP formalism (Constraint Satisfaction Problem) can represent many problems in a simple and efficient way. However, some of these problems cannot be solved in a classical and centralized way. The causes can be multiple: prohibitive repatriation time, unsecured data and so on. Distributed CSP (DisCSP), domain intersecting MAS and CSP, are used to model and to solve these problems. The intra-agent and inter-agent reasonning are so based on a set of relation between different variables. The agents interact in order to build a global solution from local solutions. We propose, in this work, an algorithm for solving DisCSP named Distributed Backtracking with Sessions (DBS) which allows to solve DisCSP where each agent owns a complex local problem. DBS has the particularity to not use nogoods like the majority of algorithms for solvingDisCSP but to use instead of sessions. These sessions are numbers which allow to assign a context to each agent and each message exchanged during the resolution of the problem. DBS is a complete algorithm which allows the use of filters on messages exchanged without affecting the proof of completeness. Our proposal is evaluated, for mono-variable and multi-variables per agents problems, on different classical benchmarks (distributed graph coloring problems and random DisCSP) and on an unknown environment exploration problem.

En ce qui concerne la hiérarchie de contrôle des micro-réseaux, la coordination des contrôleurs locaux est obligatoire aux niveaux secondaire et tertiaire. Au lieu d'utiliser une unité centrale comme approche conventionnelle, dans ce travail, des schémas distribués sont considérés. Les approches distribuées ont récemment fait l'objet d'une attention particulière en raison de leurs avantages en termes de fiabilité, d'évolutivité et de sécurité. Le système multi-agents est une technique avancée dont les propriétés les rendent aptes à servir de base à la construction de systèmes de contrôle distribués modernes. La thèse porte sur la conception d'agents visant à distribuer des algorithmes de contrôle et d'optimisation dans des micro-réseaux avec un déploiement en ligne réaliste sur une plate-forme Hardware-in-the-Loop. Sur la base de l'architecture à trois couches fournie par micro-réseaux, une plate-forme de laboratoire avec configuration Hardware-in-the-Loop est construite au niveau du système. Cette plateforme comprend deux parties : (1) un simulateur numérique en temps réel permet de simuler en temps réel des micro-réseaux de cas de test avec des contrôleurs locaux ; et (2) un cluster de Raspberry PI représente le système multi-agent fonctionnant dans un réseau de communication physique épars. Un agent est un programme en Python exécuté sur un seul Raspberry PI qui permet de transférer des données à ses voisins et d’effectuer des calculs selon des algorithmes de manière distribuée.Dans la thèse, nous appliquons les algorithmes distribués pour les niveaux de contrôle secondaire et tertiaire. Les contrôles secondaires distribués dans un micro-réseau îloté sont présentés selon deux approches d'algorithme de consensus à temps fini et d'algorithme de consensus moyen avec les améliorations des performances. Une extension de la plate-forme avec la Power Hardware-in-the-Loop et la communication basée sur la norme IEC 61850 est traitée pour rapprocher le déploiement des agents des applications industrielles. Au niveau de contrôle supérieur, les agents exécutent la méthode des multiplicateurs à sens alternatif pour déterminer les points de fonctionnement optimaux des systèmes de micro-réseaux en état d'îlot et de connexion au réseau. Les objectifs de contrôle secondaire et tertiaire sont atteints dans un cadre unique qui est rarement mentionné dans d'autres études.Dans l'ensemble, l'agent est explicitement étudié et déployé dans des conditions réalistes pour faciliter l'application des algorithmes distribués pour le contrôle hiérarchique dans les micro-réseaux. Cette recherche constitue une étape supplémentaire qui rapproche les algorithmes distribués de l'implémentation sur site. / In terms of the control hierarchy of microgrids, the coordination of local controllers is mandatory in the secondary and tertiary levels. Instead of using a central unit as conventional approaches, in this work, distributed schemes are considered. The distributed approaches have been taken attention widely recently due to the advantages of reliability, scalability, and security. The multi-agent system is an advanced technique having properties that make them suitable for acting as a basis for building modern distributed control systems. The thesis focuses on the design of agents aiming to distributed control and optimization algorithms in microgrids with realistic on-line deployment on a Hardware-in-the-loop platform. Based on the provided three-layer architecture of microgrids, a laboratory platform with Hardware-in-the-loop setup is constructed in the system level. This platform includes two parts: (1) a digital real-time simulator uses to simulate test case microgrids with local controllers in real-time; and (2) a cluster of hardware Raspberry PIs represents the multi-agent system operating in a sparse physical communication network. An agent is a Python-based program run on a single Raspberry PI owing abilities to transfer data with neighbors and computing algorithms to control the microgrid in a distributed manner.In the thesis, we apply the distributed algorithms for both secondary and tertiary control level. The distributed secondary controls in an islanded microgrid are presented in two approaches of finite-time consensus algorithm and average consensus algorithm with the improvements in performances. An extension of the platform with Power Hardware-in-the-Loop and IEC 61850-based communication is processed to make the deployment of agents closer to industrial applications. On the top control level, the agents execute the Alternating Direction Method of Multipliers to find out the optimal operation points of microgrid systems in both islanded and grid-connect state. The secondary and tertiary control objectives are achieved in a single framework which is rarely reported in other studies.Overall, the agent is explicitly investigated and deployed in the realistic conditions to facilitate applications of the distributed algorithms for the hierarchical control in microgrids. This research gives a further step making the distributed algorithms closer to onsite implementation.

<p>The main goal of this thesis is the creation o f the tool agent-oriented programming tool AJA. AJA is the acronym for Adaptable Java Agents. AJA consists o f two programming languages:<br />- A higher-level language used for the description of the main agent parts. This language is called HADL, which is the acronym for Higher Agent Definition Language.<br />- A lower-level language used for the programming o f the agent parts defined in HADL. This language is called Java+. It is actually Java enriched with the constructs for accessing higher-level agent parts defined in HADL.<br />A translator from AJA to Java is implemented in the practical part o f the thesis. AJA agents have the following features: - Agent communicates with other agents using a construct called negotiation. The messages sent can be encrypted or digitally signed in order to ensure the security of the system. - Agent possesses adaptable&nbsp; parameters and neural nets that adapt themselves when the environment changes.<br />- Agent has reflexes, which are the reactive component o f the agent architecture.<br />- Agent can perform its actions parallel. Actions execution is synchronized.<br />- Agent is accessible via Internet, because it acts as a simple HTTP server. People can use this way to communicate with an agent.<br />- Agent has Java Swing based graphical user interface. Its owner uses this interface to communicate with the agent.<br />- Because o f the fact that Java-i- language extends Java, it is possible to use all useful Java features in the implementation o f AJA agents (e.g. JDBC for the database access). The thesis also presents an original approach of integrating artificial intelligence techniques, such as neural nets, with a programming language. Having the artificial intelligence components as a part of the programming language runtime environment makes their use straightforward. A programmer uses the language constructs that are implemented using the artificial intelligence<br />without the need for understanding their background and theory.<br />The thesis contains eight chapters and three appendixes. In the first chapter, an overview of agents and multi-agent systems is given. The second chapter surveys existing agent-oriented programming languages and tools. The third chapter introduces AJA and describes the architecture of AJA agents. The syntax and semantics o f AJA languages HADL and Java+ is described in the fourth chapter. The fifth chapter presents adaptable AJA constructs in more details. To demonstrate and test the created tool, a case-study multi-agent system has been implemented in AJA. There are four personal digital assistant agents in the system. The sixth chapter describes the example agents and positively evaluates the tool. In the seventh chapter the related work and tools are analyzed and compared to AJA. The last chapter concludes the thesis. The first appendix describes the implementation details of the AJA to Java translator. The second appendix is a guide for the installation and usage of the implemented AJA to Java translator. Finally, the third<br />appendix describes step by step how to translate, compile, run, and use the example agents. The thesis contains many references, which include almost all the most important and the most actual papers in the field. The reference list can be found at the end o f the thesis.</p> / <p>Glavni doprinos doktorske teze je napravljeni alat za programiranje agenata AJA . AJA - Adaptabilni Java Agenti je jezički alat za programsku implementaciju agenata Sastoji se od dva programska jezika:<br />- Jezik vi&scaron;eg nivoa kojim se opisuju glavne kom ponente agenta. Ovaj jezik se naziva HADL - Higher Agent Definition Language.<br />- Jezik nižeg nivoa koji služi za implementaciju pojedinih komponenti agenta specificiranih HADL jezikom . Ovaj jezik se najava Java+, jer je on zapravo programski jezik Java obogaćen konstrukcijama pomoću kojih je moguće pristupati komponentama agenta, definisanim u jezik u HADL.<br />AJA agent poseduje sledeće osobine:<br />- Sigurna kom unikacija sa drugim A JA agentim a koristeći mehanizam pregovaranja, &scaron;ifrovanje i digitalno potpisivanje poruka.<br />- Mogućnost adaptiranja na promene u okruženju u kom se nalazi, koristeći neuralne mreže i adaptabilne parametre.<br />- Reaktivnost zasnovana n a kom ponenti zvanoj refleks.<br />- Paralelno izvr&scaron;avanje akcija agenta u z njihovu internu sinhronizaciju.<br />- D ostupnost agenta preko Interneta. Agent se pona&scaron;a kao jednostavan HTTP server. Na ovaj način se drugim osobama omogućuje da komuniciraju sa agentom .<br />- G rafički korisnički interfejs zasnovan n a Java Swing tehnologiji<br />- Po&scaron;to se u program iranju agenta koristi Java+, moguće je uposliti sve pogodnosti Jave, kao &scaron;to su na primer pristup bazama podataka koristeći JDBC , rad sa multimedijalnim sadržajem , itd.<br />U tezi je predstavljen i originalni pristup integrisanja tehnika ve&scaron;tačke inteligencije sa program skim jezikom . U građujući kom ponente ve&scaron;tačke inteligencije u izvr&scaron;nu okolinu je z ik a čini n jihovo kori&scaron;ćenje veom a jednostavnim . Programer ne mora da bude ekspert iz ve&scaron;tačke inteligencije a da pri tome koristi konstrukcije jezika koje su implementirane pomoću ve&scaron;tačke inteligencije. AJA specifikacija agenta se sastoji od HADL i Java+ delova. U tezi je implementiran prevodioc kojim se A JA specifikacija prevodi u skup klasa programskog jezika Java. Implementiran je i jedan multi-agentski sistem kojim se praktično pokazuje kori&scaron;ćenje i mogućnosti napravljenog alata D oktorska teza sadrži i detaljan pregled oblasti o agentskpj m etodologiji. O n a kruni&scaron;e vi&scaron;egodi&scaron;nji rad kandidata i njegovog mentora u ovoj sve značajnijoj oblasti računarstva.<br />Teza sadrži o sam glava i tri dodatka. U prvoj glavi se opisuje oblast agenata i m ulti-agentskih sistem a. Pregled postojećih agentskih program skih jezik a i alata se daje u drugoj glavi. O pis A JA agenata i njihove arhitekture je dat u trećoj glavi teze. Četvrta glava se bavi sintaksom i sem antikom oba A JA jezika: H A D L -a i Jave+. Adaptabilni elem enti A JA agenata se opisuju u petoj glavi. U &scaron;estoj glavi je opisan m ulti-agentski sistem koji j e ujed n o i prim er prim ene A JA alata. A JA se sa drugim postojećim agentskim alatim a upoređuje u sedm oj glavi. Osma glava sadrži zaključak. N a kraju se u tri dodatka detaljno opisuju im plem entacija prevodioca A JA -e u Javu, instalacija prevodioca i kori&scaron;ćenje napravljenog m ulti-agentskog sistema respektivno. U doktorskom radu su kori&scaron;ćene i navedene brojne reference kojim a su obuhvaćeni gotovo svi najznačajniji i najaktuelniji radovi iz oblasti multi-agentskih sistema. Lista referenci je navedena na kraju teze.</p>