Little attention has been paid, in depth, to the relationship between fitness evaluation in evolutionary algorithms and reputation mechanisms in multi-agent systems, but if these could be related it opens the way for implementation of distributed evolutionary systems via multi-agent architectures. Our investigation concentrates on the effectiveness with which social selection, in the form of reputation, can replace direct fitness observation as the selection bias in an evolutionary multi-agent system. We do this in two stages: In the first, we implement a peer-to-peer, adaptive Genetic Algorithm (GA), in which agents act as individual GAs that, in turn, evolve dynamically themselves in real-time, using the traditional evolutionary operators of fitness-based selection, crossover and mutation. In the second stage, we replace the fitness-based selection operator with a reputation-based one, in which agents choose their mates based on the collective past experiences of themselves and their peers. Our investigation shows that this simple model of distributed reputation can be successful as the evolutionary drive in such a system, exhibiting practically identical performance and scalability to direct fitness observation. Further, we discuss the effect of noise (in the form of “defective” agents) in both models. We show that the reputation-based model is significantly better at identifying the defective agents, thus showing an increased level of resistance to noise.

In this research, a multi-agent approach was applied to the design of a large axial flow compressor in order to optimise performance and to greatly enlarge the useful operating range of the machine. In this design a number of distributed software/hardware agents co-operate to control the internal geometry of the machine and thereby optimise the compressor characteristics in response to changes in flow conditions. The resulting machine is termed an ‘Intelligent Geometry Compressor’ (IGC). The design of a multi-agent system for the IGC was carried out in three main phases, each supported by computer simulation. In the first phase a steady-state model of the IGC was developed in which global control of the variable geometry is achieved by a single agent. This was used to help identify specific requirements for performance and the underlying parametric relationships. The subsequent phases incorporated additional agents into the machine design to meet these requirements. Initially, agents were deployed to optimise the settings of individual rows of stator vanes. In the final phase, the MAS was extended to incorporate agents into the machine design for the control of individual stator vanes. Simulation results were obtained which demonstrate the effectiveness of the intelligent geometry compressor in achieving delivery pressure regulation over a wide range of steady-state operating conditions whilst optimising overall machine efficiency and avoiding the occurrence of stall. Some of the implications for the physical design of an IGC arising from the MAS concept were briefly considered. The experience of the research supported by the specific results and observations from many simulation trials, led to the conclusion that multi-agent systems can provide an effective and novel alternative approach to the design of an intelligent geometry compressor. By implication, this conclusion may be extended to other intelligent machine applications where similar opportunity to apply a distributed control solution exists.

Natural disasters result in loss of lives, damage to built facilities, and interruption of businesses. The losses are not instantaneous rather they continue to occur until the community is restored to a functional socio-economic entity. Hence, it is essential that policy makers recognize this dynamic aspect of the incurring losses and make realistic plans to enhance the recovery. However, this cannot take place without understanding how homeowners react to recovery signals. These signals can come in different ways: from policy makers showing their strong commitment to restore the community by providing financial support and/or restoration of lifeline infrastructure; or from the neighbors showing their willingness to reconstruct. The goal of this research is to develop a model that can account for homeowners’ dynamic interactions in both organizational and spatial domains. Spatial domain of interactions focuses on how homeowners process signals from the environment such as neighbors reconstructing and local agencies restoring infrastructure, while organizational domain of interactions focuses on how agents process signals from other stakeholders that do not directly affect the environment like insurers. The hypothesis of this study is that these interactions significantly influence decisions to reconstruct and stay, or sell and leave. A multi-agent framework is used to capture emergent behavior such as spatial patterns and formation of clusters. The developed framework is illustrated and validated using experimental data sets.

Software agents and multi-agent systems (MAS) have grown into a very active area of research and commercial development activity. There are many current emerging real-world applications spanning multitude of diverse domains. In the context of agents, ontology has been widely recognised for their significant benefits to interoperability, reusability, and both development and operational aspects of agent systems and applications. Ontology-based multi-agent systems (OBMAS) exploit these advantages in providing intelligent and semantically aware applications. In addressing the lack of support for ontology in existing methodologies for multi-agent development, this thesis proposes a design methodology for the building of such intelligent multi-agent applications called MOMA. This alternative approach focuses on the development of ontology as the driving force of the development process. By allowing the domain and characteristics of utilisation and experimentation to be dictated through ontology, researchers and domain experts can specify the agent application without any knowledge of agent design and lower level programming. Through the use of a structured ontology model and the use of integrated tools, this approach contributes towards the building of semantically aware intelligent applications for use by researchers and domain experts. MOMA is evaluated through case studies in two different domains: financial services and e-Health.

We investigate the problem of developing a formal language for specifying and reasoning about real-time embedded distributed computer systems. In particular we investigate the problem of developing a theoretical framework for specifying and analyzing different aspects of real-time embedded distributed coordination. In addition to the theoretical framework we also consider the practical aspects of developing real-time embedded distributed systems. (For complete abstract open document)

The cooperative control of large-scale multi-agent systems has gained a significant interest in recent years from the robotics and control communities for multi-vehicle control. One motivator for the growing interest is the application of spatially and temporally distributed multiple unmanned aerial vehicle (UAV) systems for distributed sensing and collaborative operations. In this research, the multi-vehicle control problem is addressed using a decentralised control system. The work aims to provide a decentralised control framework that synthesises the self-organised and coordinated behaviour of natural swarming systems into cooperative UAV systems. The control system design framework is generalised for application into various other multi-agent systems including cellular robotics, ad-hoc communication networks, and modular smart-structures. The approach involves identifying suitable relationships that describe the behaviour of the UAVs within the swarm and the interactions of these behaviours to produce purposeful high-level actions for system operators. A major focus concerning the research involves the development of suitable analytical tools that decomposes the general swarm behaviours to the local vehicle level. The control problem is approached using two-levels of abstraction; the supervisory level, and the local vehicle level. Geometric control techniques based on differential geometry are used at the supervisory level to reduce the control problem to a small set of permutation and size invariant abstract descriptors. The abstract descriptors provide an open-loop optimal state and control trajectory for the collective swarm and are used to describe the intentions of the vehicles. Decentralised optimal control is implemented at the local vehicle level to synthesise self-organised and cooperative behaviour. A deliberative control scheme is implemented at the local vehicle level that demonstrates autonomous, cooperative and optimal behaviour whilst the preserv ing precision and reliability at the local vehicle level.

Software agents and multi-agent systems (MAS) have grown into a very active area of research and commercial development activity. There are many current emerging real-world applications spanning multitude of diverse domains. In the context of agents, ontology has been widely recognised for their significant benefits to interoperability, reusability, and both development and operational aspects of agent systems and applications. Ontology-based multi-agent systems (OBMAS) exploit these advantages in providing intelligent and semantically aware applications. In addressing the lack of support for ontology in existing methodologies for multi-agent development, this thesis proposes a design methodology for the building of such intelligent multi-agent applications called MOMA. This alternative approach focuses on the development of ontology as the driving force of the development process. By allowing the domain and characteristics of utilisation and experimentation to be dictated through ontology, researchers and domain experts can specify the agent application without any knowledge of agent design and lower level programming. Through the use of a structured ontology model and the use of integrated tools, this approach contributes towards the building of semantically aware intelligent applications for use by researchers and domain experts. MOMA is evaluated through case studies in two different domains: financial services and e-Health.

Covert channel attacks utilize shared resources to indirectly transmit sensitive information to unauthorized parties. Many current operating systems, such as SELinux, rely on generating labels based on a file's security classification and system-wide security policies and then binding these labels to all such files in the filesystem. Enforcement of security policies in such systems occurs at the time of access to a file or resource. Such mechanisms are flawed, however, in that they do not adequately protect against information laundering by means of covert channels. One recent development, Colored Linux, serves as an extension to SELinux and utilizes watermarking algorithms to "color" the contents of files with their respective security classification in order to enhance resistance to information laundering attacks. In this thesis, a mobile agent-based approach to implementing Colored Linux is proposed to automate the process of detecting and coloring receptive hosts' filesystems and to provide monitoring of the colored filesystem for instances of potential information leakage. Implementation details and execution results are included to illustrate the merits of the proposed approach. An evaluation of the performance of this agent-based system is conducted over a single host as well as a local network of machines and detailed here as well. Finally, third-party analysis of the agent system using formal methods is discussed.

Multi-agent systems rely heavily on coordination and cooperation to achieve a variety of tasks. It is often assumed that these agents will be fully cooperative, or have reliable and equal performance among group members. Instead, we consider cooperation as a spectrum of possible interactions, ranging from performance variations within the group to adversarial agents. This thesis examines several scenarios where cooperation and performance are not guaranteed. Potential applications include sensor coverage, emergency response, wildlife management, tracking, and surveillance. We use geometric methods, such as Voronoi tessellations, for design insight and Lyapunov-based stability theory to analyze our proposed controllers. Performance is verified through simulations and experiments on a variety of ground and aerial robotic platforms. First, we consider the problem of Voronoi-based coverage control, where a group of robots must spread out over an environment to provide coverage. Our approach adapts online to sensing and actuation performance variations with the group. The robots have no prior knowledge of their relative performance, and in a distributed fashion, compensate by assigning weaker robots a smaller portion of the environment. Next, we consider the problem of multi-agent herding, akin to shepherding. Here, a group of dog-like robots must drive a herd of non-cooperative sheep-like agents around the environment. Our key insight in designing the control laws for the herders is to enforce geometrical relationships that allow for the combined system dynamics to reduce to a single nonholonomic vehicle. We also investigate the cooperative pursuit of an evader by a group of quadrotors in an environment with no-fly zones. While the pursuers cannot enter the no-fly zones, the evader moves freely through the zones to avoid capture. Using tools for Voronoi-based coverage control, we provide an algorithm to distribute the pursuers around the zone's boundary and minimize capture time once the evader emerges. Finally, we present an algorithm for the guaranteed capture of multiple evaders by one or more pursuers in a bounded, convex environment. The pursuers utilize properties of the evader's Voronoi cell to choose a control strategy that minimizes the safe-reachable area of the evader, which in turn leads to the evader's capture.

This overview report comprises two projects linked by the theme of the application of intelligent agents. The first project covers the development of RAPIDO, a rapid prototyping toolkit for the development and evaluation of agent applications. The papers and technical reports included for this project look at the implementation and application of the RAPIDO toolkit to a specific test case for evaluation purposes. The second project considers the use of an agent-based simulation of the Internet, called WebAgent, to explore agent-based solutions to improving network performance. The publications present the experimental methodology of WebAgent, and the results of evaluating Expl, an adaptive agent for intelligent control of dynamic caching strategies for web servers and clients. The knowledge gained during the course of these two projects has been published in refereed papers included within the accompanying portfolio. The production of Multi- Agent Systems (MAS), particularly Distributed Artificial Intelligence (DAI) applications, is dependent upon the underlying paradigm. The generic approach to the specification of agent applications, and the object-oriented rapid prototyping technique, have allowed different implementations of a specific problem domain to be evaluated in order to determine the best architecture. The application of agent-based simulation to the field of web document caching has both introduced a new tool for performing evaluations of such techniques and has helped towards the proposal of a new approach, based upon intelligent, adaptive agents. The future of such directions promises to offer far greater application of these ideas to the regulation and management of networks in general.