No description available.

Aggregation of multiple Reinforcement Learning (RL) algorithms is a new and effective technique to improve the quality of Sequential Decision Making (SDM). The quality of a SDM depends on long-term rewards rather than the instant rewards. RL methods are often adopted to deal with SDM problems. Although many RL algorithms have been developed, none is consistently better than the others. In addition, the parameters of RL algorithms significantly influence learning performances. There is no universal rule to guide the choice of algorithms and the setting of parameters. To handle this difficulty, a new multiple RL system - Aggregated Multiple Reinforcement Learning System (AMRLS) is developed. In AMRLS, each RL algorithm (learner) learns individually in a learning module and provides its output to an intelligent aggregation module. The aggregation module dynamically aggregates these outputs and provides a final decision. Then, all learners take the action and update their policies individually. The two processes are performed alternatively. AMRLS can deal with dynamic learning problems without the need to search for the optimal learning algorithm or the optimal values of learning parameters. It is claimed that several complementary learning algorithms can be integrated in AMRLS to improve the learning performance in terms of success rate, robustness, confidence, redundance, and complementariness. There are two strategies for learning an optimal policy with RL methods. One is based on Value Function Learning (VFL), which learns an optimal policy expressed as a value function. The Temporal Difference RL (TDRL) methods are examples of this strategy. The other is based on Direct Policy Search (DPS), which directly searches for the optimal policy in the potential policy space. The Genetic Algorithms (GAs)-based RL (GARL) are instances of this strategy. A hybrid learning architecture of GARL and TDRL, HGATDRL, is proposed to combine them together to improve the learning ability. AMRLS and HGATDRL are tested on several SDM problems, including the maze world problem, pursuit domain problem, cart-pole balancing system, mountain car problem, and flight control system. Experimental results show that the proposed framework and method can enhance the learning ability and improve learning performance of a multiple RL system.

This thesis focuses on three fundamental issues that concern data aggregation protocols for periodic data collection in sensor networks: <i>which</i> sensor nodes should report their data, <i>when</i> should they report it, and should they use <i>unicast</i> or <i>broadcast</i> based protocols for this purpose. <p> The issue of when nodes should report their data is considered in the context of real-time monitoring applications. The first part of this thesis shows that asynchronous aggregation, in which the time of each nodes transmission is determined adaptively based on its local history of past packet receptions from its children, outperforms synchronous aggregation by providing lower delay for a given end-to-end loss rate. <p> Second, new broadcast-based aggregation protocols that minimize the number of packet transmissions, relying on multipath delivery rather than automatic repeat request for reliability, are designed and evaluated. The performance of broadcast-based aggregation is compared to that of unicast-based aggregation, in the context of both real-time and delay-tolerant data collection. <p> Finally, this thesis investigates the potential benefits of dynamically, rather than semi-statically, determining the set of nodes reporting their data, in the context of applications in which coverage of some monitored region is to be maintained. Unicast and broadcast-based coverage-preserving data aggregation protocols are designed and evaluated. The performance of the proposed protocols is compared to that of data collection protocols relying on node scheduling.

Recently, ¡§Pyrene¡¨ is a well-known substitutive group because the rigid structure and hole-injection ability of pyrene units can improve the thermal and electronic properties of blue OLED materials. The aromatic ring of pyrene not only improves the thermal and hole-injection ability of derivatives, but also provides high photoluminescence (PL) efficiency and high carrier mobility. Through these characteristics we can understand that the electron-rich pyrene derivatives can enhance the properties of OLED device. In this study, we developed low-molecular-weight structures with spiro-type molecules based on 9,9-spirobifluorene and fabricated the OLED device with the structure of ITO(170 nm)/PEDOT:PSS(50 nm)/PVK:TPSBF (40%)(90 mm)/BPhen (30 nm)/ LiF(1 nm)/Al(200 nm). It exhibited a maximum luminance at 500 mA/cm2 of 4130 cd/m2 with the Commission Internationale de l'Eclairage (CIE) of (0.16 , 0.16), and the maximum current and power efficiency were 1.9 cd/A and 0.9 lm/W, respectively. We concluded that TPSBF has good emission efficiency according to device performances. The PL maximum of the thick film of TPSBF, prepared by vacuum vapor deposition appears broadband spectrum, that resulted from the aggregation of the pyrene moieties. From Atomatic Force Microscopy (AFM) results, we propose three emission mechanisms. 1. Intramolecular spectrum ¡÷ 450 nm 2. Molecular aggregation spectrum ¡÷ 500 nm 3. Longer conjugation spectrum of intermolecular ¡÷ 550 nm We could fabricate the organic white light emitting device with a single and thicker emitting layer TPSBF and the more broadband emitting spectrum can be obtained. Finally, we fabricated the organic white light emitting device with a structure of ITO(170 nm)/2T-NATA(15 nm)/NPB(65 nm)/TPSBF(50 nm)/Alq3(30 nm)/LiF(0.8 nm)/Al(200 nm). It exhibited a maximum luminance at 1300 mA/cm2 of 57680 cd/m2, the maximum current and power efficiency were 6.51 cd/A and 4.07 lm/W, respectively, and with good CIE coordinate of (0.29 , 0.36).

Many proteins can easily attain a non-native fold and be of no use or even a detriment to the host. The host cell has a myriad of molecules dedicated to assisting nascent and existing proteins in folding properly and maintaining the native fold. Of these molecular chaperones, the small Heat Shock Proteins (sHSP’s) are an important group and worthy of study. The sHSP’s are a diverse group of proteins that have in common an a-crystallin domain and generally display a chaperone activity. A sHSP (HSP20) isolated from the cattle parasite Babesia bovis has similar activities, and limited sequence homology to other a-crystallins. The gene encoding HSP20 was cloned into an expression system where the gene product was induced and purified for study. It was shown that HSP20 inhibits thermally induced aggregation of alcohol dehydrogenase at equimolar ratios. HSP20 was also used to significantly reduce amyloid formation of the b-Amyloid (1-40) Peptide in vitro at the sub-stoichiometric ratio of 1:10. A study of the oligomeric forms of HSP20 using size exclusion chromatography and gel electrophoresis revealed a broad range of multimers present in solution. The distribution of oligomers was affected by altering the solution conditions and concentration of the protein. The domains responsible for multimerization of HSP20 were mapped via sequence homology with known a-crystallins. These regions correspond to 12 carboxy-terminal amino acids and 50 amino-terminal amino acids. Truncated versions of HSP20 lacking these proposed oligomerization domains were created using PCR of the original gene and cloning into an expression vector as before. Using size exclusion chromatography, gel electrophoresis and analytical centrifugation, we show that the deleted domains alter the multimeric population of the protein in solution. The carboxy-terminal domain has a slight effect on multimerization while the amino-terminal deletion results in a drastic reduction in any multimers above a dimer under the conditions tested. Despite this drastic change in the multimerization of HSP20, there were no changes in the activities observed when compared to the full-length form. From this we conclude that the regions responsible for multimerization play little role in the observed activities of HSP20.

Thesis (Ph. D.)--Rutgers University, 2009. / "Graduate Program in Biomedical Engineering." Includes bibliographical references.

Thesis (Ph. D.) in Chemistry--University of Maine, 2002. / Includes vita. Includes bibliographical references (leaves 157-169).

This thesis presents a methodology for data aggregation for capacity management. It is assumed that there are a very large number of products manufactured in a company and that every product is stored in the database with its standard unit per hour and attributes that uniquely specify each product. The methodology aggregates products into families based on the standard units-per-hour and finds a subset of attributes that unambiguously identifies each family. Data reduction and classification are achieved using well-known multivariate statistical techniques such as cluster analysis, variable selection and discriminant analysis. The experimental results suggest that the efficacy of the proposed methodology is good in terms of data reduction.

Attracting prey by exploiting a visual sensory bias is a common theme in stationary predators across many taxa, particularly for obligate ambush predators, such as orb-weaving spiders, because they construct complex prey traps. Mimicry of UV-reflecting floral-guides has been suggested as the mechanism behind the tendency for spiders and silk web decorations (stabilimenta) to reflect in the UV, to attract pollinators that they then prey upon. Also, many insects are attracted to UV because it most commonly indicates open sky, or a safe flight path. My study focuses on the prey attraction function of stabilimenta, in Argiope trifasciata in eastern Ontario. Decorated webs were no more likely to contain prey than undecorated webs, but for adult spiders, longer stabilimenta were associated with increased likelihood of prey capture. For both adults and juveniles, larger webs were more likely to contain prey in undecorated webs, but for decorated webs, web size was not a predictor of prey presence. I interpret this as evidence for a trade-off between two alternative prey capture strategies: building a web with a large capture area, or building a small web with a stabilimentum. In further support of this trade-off, smaller webs were more likely to contain a stabilimentum, for both juveniles and adults. My data also suggest that close neighbours compete rather than cooperate with each other. Adult webs were spaced farther apart from each other than juvenile webs, more than would be expected based on web diameter difference. For juveniles, webs with a closer neighbour were more likely to be decorated, implying an increased need for prey attraction in the presence of a nearby competitor. For adults, prey was more likely to be found in webs that were more solitary. My results do not support the hypothesis that visually attractive spiders increased prey capture by aggregating. / Thesis (Master, Biology) -- Queen's University, 2009-09-28 10:57:18.156

No description available.