Hao, Jianye. / Thesis (Ph.D.)--Chinese University of Hong Kong, 2013. / Includes bibliographical references (leaves 216-228). / Electronic reproduction. Hong Kong : Chinese University of Hong Kong, [2012] System requirements: Adobe Acrobat Reader. Available via World Wide Web. / Abstract also in Chinese.

近年来，由于多智能体系统广泛应用于分布式传感器网络的协调和控制、移动机器人、自动驾驶车辆等，其控制设计一直是一个活跃的领域。在趋同、同步、聚类和蜂拥等问题上已经有了很多结果。线性多智能体系统的协作式输出调节问题在近几年也有所研究，但非线性多智能体系统的协作式输出调节问题的结果却很少。在这篇论文中，我们专注于非线性多智能体系统的协作式输出调节问题，分别考虑了局部情况和全局情况。 / 非线性系统的输出调节问题旨在实现轨迹跟踪和不确定非线性被控对象产生的干扰抑制，其中参考输入和干扰是通过一定的动态系统产生的，被称为外部系统。众所周知，有两种解决经典输出调节问题的方法：前馈设计和内模设计。前馈设计使用调节方程的解设计控制律，而内模设计包括两个步骤。首先把被控对象的鲁棒输出调节问题转化成由被控对象和叫做内模的动态补偿器组成的增广系统的鲁棒镇定问题，然后鲁棒镇定增广系统。 / 不同于经典的输出调节问题，协作式输出调节问题处理由N个子系统组成的多智能体系统的渐近跟踪和干扰抑制问题。N个子系统的连接关系用信息图描述。我们可以把外部系统看作领导者，把N个子系统看作外部系统的追随者。根据是否是领导者的邻居，把N个追随者分为知情的追随者和不知情的追随者。知情的追随者一组是外部系统的邻居并且可以使用自己的信息设计控制器，而不知情的追随者一组不是外部系统的邻居并且可以用其邻居的信息进行控制设计。 / 基于经典输出调节问题的这两种方法，我们利用前馈方法考虑的非线性多智能体系统的局部协作式输出调节，和通过内模方法考虑全局情况。论文的主要贡献归纳如下。 / 1. 本文考虑了非线性多智能体系统的局部协作式输出调节问题，即为，设计一个分布式控制器使得整个闭环系统当外部信号设置为零时是渐近稳定的，并且初始条件足够小时输出误差渐进趋于零。由于不知情的追随者的控制器得不到外部信号，其对应的子系统的输出调节问题不能使用自己的状态设计控制器解决。这样输出调节问题就不能用前馈设计一个分散控制器解决。因此，我们考虑协作式控制以解决输出调节问题。为了克服上述困难，我们设计了分布式控制器，包括状态反馈控制器和可测输出反馈控制器。 / 2. 本文通过协作式内膜设计研究了非线性下三角多智能体系统的全局鲁棒输出调节问题。全局鲁棒输出调节问题定义如下：找到一个控制器使得被控对象在任何初始状态下闭环系统的轨迹存在并且有界，并且对所有的初始条件，跟踪误差渐近趋近于零。有两种方法可以解决网络系统的全局鲁棒输出调节问题：分散式方法和协作式方法。通过分散式方法，对每个子系统设计一个内模，这样其控制器的阶数和子系统的数量成正比。现在，通过共享不同的追随者之间的信息，我们将利用协作式方法对所有的子系统设计只有一个内模的控制器，从而得到一个所谓的协作式控制器。这个协作式控制器的阶数和追随者的数量是独立的，并且这种方法远远比分散式方法更直接。 / 最后，我们将使用一些例子来说明我们的两种设计方法的有效性。 / In recent years, the control design of multi-agent systems has been an active area due to its wide applications in the coordination and control of distributed sensor networks, mobile robots, autonomous vehicles, etc. Many results have been obtained in such issues as consensus, synchronization, swarming and flocking. The cooperative output regulation problem for linear multi-agent systems has been studied in recent years, but there are few results on cooperative output regulation of nonlinear multi-agent systems. In this thesis, we concentrate on the cooperative output regulation problem of nonlinear multi-agent systems and consider the local case and the global case, respectively. / The output regulation problem of nonlinear systems aims to achieve asymptotic tracking and disturbance rejection in an uncertain nonlinear plant where the reference inputs and disturbances are generated by an autonomous system called the exosystem. It is known that there are two methods for solving the classical output regulation problem: feed forward design and internal model design. The feed forward design makes use of the solution of the regulator equations to design a control law while the internal model design consists of two steps. The first one is to convert the robust output regulation problem for the given plant into a robust stabilization problem for an augmented system composed of the given plant and a dynamic compensator called internal model, and the second step aims to robustly stabilize the augmented system. / Different from the classical output regulation problem, the cooperative output regulation problem handles the asymptotic tracking and disturbance rejection problem of a system consisting of N subsystems, which is the multi-agent system we consider. The connection of N subsystems is described by an information graph. We can view the exosystem as a leader system and the N subsystems as followers of the exosystem. Depending on whether or not a follower is a neighbor of the leader, the N followers can be classified into the informed followers and the uninformed followers. The group of the informed followers is the set of the neighbors of the exosystem and can use its own information for the control design, while the uninformed followers are not the neighbors of the exosystem and can use their neighbors’ information for the control design. / Based on the two approaches for studying the classical output regulation problem, we consider the local cooperative output regulation for the nonlinear multi-agent system by a feed forward approach, and the global case by an internal model approach. The main contributions are summarized as follows. / 1. The local cooperative output regulation problem for nonlinear multi-agent systems is considered, that is, design a distributed control law such that the overall closed-loop system is asymptotically stable when the exosystem signal is set to zero and the error output approaches zero asymptotically for all suciently small initial conditions. Since the control law of the uninformed followers cannot access to the exogenous signal, the output regulation problem of each uninformed follower subsystem cannot be solved by a control law utilizing its own state. Thus the output regulation problem cannot be solved by a decentralized control scheme using the feedforward design. Therefore, we consider a cooperative control to solve the out¬put regulation problem. To overcome the above diculties, the distributed control schemes are designed, including the state feedback controller and the measurement output feedback controller. / 2. The global robust output regulation problem of nonlinear lower triangular multi-agent system with uncertainties via a cooperative internal model design is studied. The global robust output regulation problem is dened as follows: nd a control law such that the trajectory of the closed-loop system starting from any initial state of the plant exists and is bounded, and the tracking error approaches zero asymptotically for all initial conditions. There are two methods to solve global robust output regulation problem of the networked systems: decentralized method and cooperative method. From decentralized method, an internal model is designed for each subsystem, which leads to a control law whose order is proportional to the number of the subsystems. Here, by sharing the information among dierent followers, we will use cooperative method and manage to design a control law with one single internal model for all subsystems, thus leads to a so-called cooperative control law. The order of the cooperative control law is independent of the number of the followers, and is much more straightforward than the decentralized method. / Finally, we will use some examples to illustrate the eectiveness of our two design methods. / Detailed summary in vernacular field only. / Detailed summary in vernacular field only. / Detailed summary in vernacular field only. / Detailed summary in vernacular field only. / Detailed summary in vernacular field only. / Detailed summary in vernacular field only. / Detailed summary in vernacular field only. / Han, Qiping. / Thesis (M.Phil.)--Chinese University of Hong Kong, 2012. / Includes bibliographical references (leaves 66-75). / Abstracts also in Chinese. / Abstract --- p.i / Acknowledgement --- p.v / Chapter 1 --- Introduction --- p.1 / Chapter 1.1 --- Literature Review --- p.1 / Chapter 1.2 --- Contributions of Thesis --- p.3 / Chapter 1.3 --- Thesis Outline --- p.4 / Chapter 2 --- Preliminaries --- p.6 / Chapter 2.1 --- Review of Graph Theory --- p.6 / Chapter 2.2 --- Fundamentals of Nonlinear Systems --- p.7 / Chapter 2.2.1 --- Lyapunov Stability --- p.7 / Chapter 2.2.2 --- Input-to-State Stability --- p.10 / Chapter 2.3 --- Feedforward Design of Nonlinear Output Regulation --- p.11 / Chapter 2.4 --- Internal Model Design of Nonlinear Output Regulation --- p.14 / Chapter 3 --- Local Cooperative Output Regulation --- p.22 / Chapter 3.1 --- Problem Formulation --- p.22 / Chapter 3.2 --- State Feedback Design --- p.25 / Chapter 3.3 --- Measurement Output Feedback Design --- p.34 / Chapter 3.4 --- Conclusions --- p.41 / Chapter 4 --- Global Robust Output Regulation via a Cooperative Controller --- p.42 / Chapter 4.1 --- Problem Formulation --- p.42 / Chapter 4.2 --- Solvability of the Problem --- p.49 / Chapter 4.3 --- Example --- p.54 / Chapter 4.4 --- Conclusions --- p.64 / Chapter 5 --- Conclusions --- p.65 / Bibliography --- p.66 / Biography --- p.76

Manufacturing intelligent agent simulation has not been widely applied in industry because of its application complexity. This complexity, which includes choosing priority machines or jobs, determining machine maintenance schedules, and allocating working shifts and breaks, requires intelligent decision making. Manufacturing systems are strongly influenced by intelligent decision makers. Especially for a fixed manufacturing layout, system performance improvement depends on intelligent manufacturing decision making. As a result, a manufacturing simulation can not be truly complete if intelligent decision making processes are not represented. This thesis describes an architecture which includes the representation of intelligent agents in manufacturing simulation model. An intelligent agent simulation environment (IASE) is developed under the concepts of distributed artificial intelligence and object oriented methodology. As an extension to an existing simulation environment, IASE inherits primary manufacturing simulation elements and material handling systems from object oriented manufacturing architecture (Beaumariage, 1990) and AGV simulation system (Beaumariage and Wang, 1995). In IASE, production operators, maintenance technicians and job releasers are created to represent manufacturing intelligent agents. Several basic elements such as the blackboard structure and knowledge base for supporting intelligent agent simulation are also developed. In contrast to traditional simulation environments designed for and in procedural programming languages, future extensions or modifications for IASE are eased since IASE is developed in an object oriented fashion. This paper introduces IASE structure both in the conceptual design and implementation methodology levels. At the end, two case studies are performed. The first case study is to verify IASE's implementation and results by comparing it with a model developed in SLAM II. The second case study, a mixed intelligent agent decision making example, demonstrates the intelligent agent simulation ability of IASE. / Graduation date: 1997

Diss. Uppsala : Sveriges lantbruksuniv., 2004.

A project report submitted to the Faculty of Erlglncerlng, University of Witwatersrand, Johannesburg, In partial fulfilment of the requirements for the degree of Master of Science In Engineering Johannesburg 1993 / This Project Repolt r ''"lorts on the study of an approach to building integrated real-time software systems based on re-usable object-oriented components. The basis of the approach is the development of a a-layered structure of components, where each layer is built on the underlying layer of components, The lower layer of components consists of generic re-usable building blocks that may be re-used for building and integrating other real-time applications. The middle layer consists of components that are generic to the application domain, and the top layer consists of components that are specific to each application of that application domain. The Report includes researching and developing methods of communicating between these building blocks using an OSI/CMIP-conformant 'software highway" and in this regard particular attention is given to the formal and de facto industry standards. With this approach, it is argued that the application engineer can effectively build new applications using the re-usable components. This is demonstrated by reporting on the implementation of a large real-world Telecommunications Network Management application. The Project Report contains a critical analysis of the technical, organisational and project management issues of this Object-oriented component approach as compared to the traditional development approach. The Report concludes that despite certain technical and organisational concerns, the object-oriented approach does indeed yield several worthwhile benefits for developing real-time software systems. These benefits include genuine re-usability, and l"1proved productivity, testability and maintainability.

INTRODUÇÃO: A estimulação cerebral profunda (ECP) é usada para tratar a doença de Parkinson (DP) avançada. A estimulação do núcleo subtalâmico (NST) melhora os sintomas de parkinsonismo, mas seu mecanismo de ação permanece pouco compreendido. A ressonância magnética functional (RMf) pode auxiliar no estudo de áreas cerebrais motoras de forma a melhorar o entendimento dos mecanismos de ação da ECP. O objetivo desta tese foi de desenvolver e testar técnicas de RMf para estudo de pacientes com DP tratados com ECP. MÉTODOS: Foram realizados testes para verificar interferência do sistema de ECP nas imagens de RMf e realizadas adaptações de modo a diminuir os artefatos na imagem. A seguir foram examinados pacientes com DP em quatro condições: durante a movimentação da mão direita (antes do implante dos eletrodos para ECP, depois da cirurgia sem estímulo elétrico e depois da cirurgia com estímulo elétrico no NST) e durante o repouso com a estimulação elétrica ligada e desligada. No total foram examinados dez pacientes, dos quais oito foram comparados a voluntários normais. Foram realizadas três sessões de RMf em cada condição, utilizando dois tipos de seqüências: em bloco (BL) e relacionada a eventos (RE). As imagens foram analisadas calculando-se a freqüência de atividade cerebral detectada em 19 áreas sensitivo-motoras. Dados comportamentais durante o exame e a evolução clínica foram analisados. RESULTADOS: Os pacientes não apresentaram complicações decorrentes dos exames de RMf. Após modificações na técnica de implante do eletrodo e ajustes do intervalo pós-cirúrgico para o exame, os artefatos nas imagens foram reduzidos. Nos controles, as sequencias RE mostraram mais atividade que BL nas áreas: área suplementar motora, área pré-motora (pM) direita, cíngulo anterior (Cga), cíngulo posterior (Cgp), tálamo bilateral e putamen direito. Durante a movimentação da mão dominante, comparando as seqüências BL e RE dos pacientes com DP, não houve diferença significativa considerando todos experimentos pré-operatórios e pósoperat órios sem o estímulo elétrico. Com o estímulo elétrico ligado, nas seqüências BL houve maior atividade em relação às RE, na área sensitivomotora primária (SM1) esquerda. Durante o repouso, quando a estimulação elétrica foi ligada houve maior atividade das seguintes áreas: cerebelo direito, SM1 esquerda, Cgp, pM bilateral, mesencéfalo esquerdo e Cga. Houve melhora clínica dos pacientes e tanto a avaliação motora na primeira semana pós-operatória, na fase sem medicação, bem como a avaliação global em seis meses estiveram correlacionadas com os parâmetros motores aferidos durante os exames de RMf. CONCLUSÕES: Foi desenvolvido método para a aplicação da RMf em pacientes com DP submetidos à ECP que permitiu as seguintes observações: as seqüências BL mostraram maior freqüência de atividade na SM1 nos pacientes com DP e ECP ligada, enquanto as seqüências RE mostraram maior freqüência de atividade nos voluntários normais nas áreas motoras primárias e secundárias; e o estímulo elétrico no repouso produziu atividade detectada no cerebelo e nas regiões motoras primárias e secundárias / INTRODUCTION: Deep brain stimulation (DBS) is used to treat advanced Parkinson\'s disease (PD). Stimulation of the subthalamic nucleus (STN) is effective to improve the symptoms related to parkinsonism, but its mechanism of action remains poorly understood. Functional magnetic resonance imaging (fMRI) can be applied to study brain areas involved in motor activity, as a mean to better understand the effects of DBS. In this work we aimed to develop and test fMRI techniques to study DP patients treated with DBS. METHODS: We have initially performed tests to check the interference of the DBS in image quality and made adaptations that minimized the artifacts. After this initial phase PD patients were examined by fMRI in four different phases: during right hand movement (before surgery to implant DBS electrodes, after the surgery with the electrical stimulation turned off, and after the surgery with the electrical stimulation turned on the STN) and at rest with electrical stimulation turned on. In total, ten patients were examined, eight of them paired to matched normal volunteers. All tasks were performed in three independent sessions for each condition, using two types of runs: blocked (BK) and event-related (ER). The images were analyzed calculating the frequency of activation detected in 19 sensory-motor areas. Behavioral data during fMRI exams and clinical data were also recorded. RESULTS: There were no clinical complications due to fMRI exams. The modifications in the DBS procedure and post-surgical time to fMRI examination resulted in a reduction of the image artifacts. In the controls the ER runs showed more activity than BK in: supplementary motor area, right pre-motor area (pM), anterior cingulated gyrus (aCg), posterior cingulated gyrus (pCg), bilateral thalamus, and right putamen. During the dominant hand movements, when comparing ER and BK runs in PD patients there was no significant difference considering pre and post operative phases without electrical stimulation. When the electrical stimulation was turned on, BK runs showed more activation in the left primary sensory-motor cortex (SM1) compared to ER runs. In the rest state, when the electrical stimulation was turned on, there was more activation in the following areas: right cerebellum, left SM1, pCg, bilateral pM, left mesencephalus and aCg. There was clinical improvement in the patients, and the motor performance in the first post operative week, in the drug withdrawn phase as well as in the global evaluation after six months were correlated with the motor parameters recorded during the fMRI exams. CONCLUSIONS: we have developed a method for fMRI in PD patients with DBS, which enabled the following observations: BK runs showed increased frequency of activity in SM1 in PD patients with electrical stimulation turned on, while the ER runs showed more frequency of activation in normal volunteers in primary and secondary motor regions; the electrical stimulations in rest state produced activity detected in cerebellum, primary and secondary motor regions

INTRODUÇÃO: A estimulação cerebral profunda (ECP) é usada para tratar a doença de Parkinson (DP) avançada. A estimulação do núcleo subtalâmico (NST) melhora os sintomas de parkinsonismo, mas seu mecanismo de ação permanece pouco compreendido. A ressonância magnética functional (RMf) pode auxiliar no estudo de áreas cerebrais motoras de forma a melhorar o entendimento dos mecanismos de ação da ECP. O objetivo desta tese foi de desenvolver e testar técnicas de RMf para estudo de pacientes com DP tratados com ECP. MÉTODOS: Foram realizados testes para verificar interferência do sistema de ECP nas imagens de RMf e realizadas adaptações de modo a diminuir os artefatos na imagem. A seguir foram examinados pacientes com DP em quatro condições: durante a movimentação da mão direita (antes do implante dos eletrodos para ECP, depois da cirurgia sem estímulo elétrico e depois da cirurgia com estímulo elétrico no NST) e durante o repouso com a estimulação elétrica ligada e desligada. No total foram examinados dez pacientes, dos quais oito foram comparados a voluntários normais. Foram realizadas três sessões de RMf em cada condição, utilizando dois tipos de seqüências: em bloco (BL) e relacionada a eventos (RE). As imagens foram analisadas calculando-se a freqüência de atividade cerebral detectada em 19 áreas sensitivo-motoras. Dados comportamentais durante o exame e a evolução clínica foram analisados. RESULTADOS: Os pacientes não apresentaram complicações decorrentes dos exames de RMf. Após modificações na técnica de implante do eletrodo e ajustes do intervalo pós-cirúrgico para o exame, os artefatos nas imagens foram reduzidos. Nos controles, as sequencias RE mostraram mais atividade que BL nas áreas: área suplementar motora, área pré-motora (pM) direita, cíngulo anterior (Cga), cíngulo posterior (Cgp), tálamo bilateral e putamen direito. Durante a movimentação da mão dominante, comparando as seqüências BL e RE dos pacientes com DP, não houve diferença significativa considerando todos experimentos pré-operatórios e pósoperat órios sem o estímulo elétrico. Com o estímulo elétrico ligado, nas seqüências BL houve maior atividade em relação às RE, na área sensitivomotora primária (SM1) esquerda. Durante o repouso, quando a estimulação elétrica foi ligada houve maior atividade das seguintes áreas: cerebelo direito, SM1 esquerda, Cgp, pM bilateral, mesencéfalo esquerdo e Cga. Houve melhora clínica dos pacientes e tanto a avaliação motora na primeira semana pós-operatória, na fase sem medicação, bem como a avaliação global em seis meses estiveram correlacionadas com os parâmetros motores aferidos durante os exames de RMf. CONCLUSÕES: Foi desenvolvido método para a aplicação da RMf em pacientes com DP submetidos à ECP que permitiu as seguintes observações: as seqüências BL mostraram maior freqüência de atividade na SM1 nos pacientes com DP e ECP ligada, enquanto as seqüências RE mostraram maior freqüência de atividade nos voluntários normais nas áreas motoras primárias e secundárias; e o estímulo elétrico no repouso produziu atividade detectada no cerebelo e nas regiões motoras primárias e secundárias / INTRODUCTION: Deep brain stimulation (DBS) is used to treat advanced Parkinson\'s disease (PD). Stimulation of the subthalamic nucleus (STN) is effective to improve the symptoms related to parkinsonism, but its mechanism of action remains poorly understood. Functional magnetic resonance imaging (fMRI) can be applied to study brain areas involved in motor activity, as a mean to better understand the effects of DBS. In this work we aimed to develop and test fMRI techniques to study DP patients treated with DBS. METHODS: We have initially performed tests to check the interference of the DBS in image quality and made adaptations that minimized the artifacts. After this initial phase PD patients were examined by fMRI in four different phases: during right hand movement (before surgery to implant DBS electrodes, after the surgery with the electrical stimulation turned off, and after the surgery with the electrical stimulation turned on the STN) and at rest with electrical stimulation turned on. In total, ten patients were examined, eight of them paired to matched normal volunteers. All tasks were performed in three independent sessions for each condition, using two types of runs: blocked (BK) and event-related (ER). The images were analyzed calculating the frequency of activation detected in 19 sensory-motor areas. Behavioral data during fMRI exams and clinical data were also recorded. RESULTS: There were no clinical complications due to fMRI exams. The modifications in the DBS procedure and post-surgical time to fMRI examination resulted in a reduction of the image artifacts. In the controls the ER runs showed more activity than BK in: supplementary motor area, right pre-motor area (pM), anterior cingulated gyrus (aCg), posterior cingulated gyrus (pCg), bilateral thalamus, and right putamen. During the dominant hand movements, when comparing ER and BK runs in PD patients there was no significant difference considering pre and post operative phases without electrical stimulation. When the electrical stimulation was turned on, BK runs showed more activation in the left primary sensory-motor cortex (SM1) compared to ER runs. In the rest state, when the electrical stimulation was turned on, there was more activation in the following areas: right cerebellum, left SM1, pCg, bilateral pM, left mesencephalus and aCg. There was clinical improvement in the patients, and the motor performance in the first post operative week, in the drug withdrawn phase as well as in the global evaluation after six months were correlated with the motor parameters recorded during the fMRI exams. CONCLUSIONS: we have developed a method for fMRI in PD patients with DBS, which enabled the following observations: BK runs showed increased frequency of activity in SM1 in PD patients with electrical stimulation turned on, while the ER runs showed more frequency of activation in normal volunteers in primary and secondary motor regions; the electrical stimulations in rest state produced activity detected in cerebellum, primary and secondary motor regions