1 Web sites offer a huge amount of information. Often it is a page generated from data stored in databases. However, emphasis is placed on the display of information, but not on their machine processing. Part of the thesis is design and implementation of a prototype system to retrieve data from dynamically generated web using programming by demonstration technique. Such a system allows the user to show with mouse to the system how to proceed with gathering information from the website. Based on such a example, the system will derive a procedure to acquire information on similar sites. The implemented system is able to collect user relevant information from similar sites for example in form of a simple table suitable for further machine processing.

OLIVEIRA, Tânia Elizabeth Sampaio. Efeito da inclusão de raspa integral de mandioca e formas de arraçoamento sobre o desempenho de leitões na fase inicial. 2005. xiii, 47 f. : Dissertação (Mestrado) - Universidade Federal do Ceará, Centro de Ciências, Departamento de Zootecnia, Programa de Pós-Graduação em Zootecnia. Fortaleza-CE, 2005. / Submitted by Eric Santiago (erichhcl@gmail.com) on 2016-08-09T15:36:22Z No. of bitstreams: 1 2005_dis_tesoliveira.pdf: 1307024 bytes, checksum: c10f4579160e01dd61401d00cba3e598 (MD5) / Approved for entry into archive by Nádja Goes (nmoraissoares@gmail.com) on 2016-08-09T15:42:22Z (GMT) No. of bitstreams: 1 2005_dis_tesoliveira.pdf: 1307024 bytes, checksum: c10f4579160e01dd61401d00cba3e598 (MD5) / Made available in DSpace on 2016-08-09T15:42:22Z (GMT). No. of bitstreams: 1 2005_dis_tesoliveira.pdf: 1307024 bytes, checksum: c10f4579160e01dd61401d00cba3e598 (MD5) Previous issue date: 2005 / 32 piglets were used to castrate commercial line weaned at 21 days of age with approximately 6.0 kilograms of weight, to evaluate the effects of different levels (0, 12, 24 and 36%) of full inclusion of scraping of cassava (RIM) and forms of arraçoamento on the performance of breeding pigs in the initial stage - I (21 to 42 days of age), the initial phase - II (42 to 70 days old) and total phase (21 to 70 days of age), and its economic viability. The diets were isoproteic (21.0 and 19.0%) and isocaloric (3,100 and 3,200 kcalEM / kg), respectively. The experimental design was a block at random in a 4 x 2 factorial (four levels of inclusion of RIM) and two forms of arraçoamento (dry and wet diets), with four repetitions per eatment and one animal per share. The criterion for training block was the initial weight of piglets. The gain in average daily weight (GPMD), the average daily consumption of feed (CRMD), and feed conversion (CA) did not differ significantly (P> 0.05) for different levels of between RIM and the forms of arraçoamento. It follows that it is technically feasible to use the full scraping of cassava to the level of 36% in pig feed in the initial phase (21 to 70 days of age), regardless of the form of arraçoamento and that the level of inclusion of 12% RIM, which was the best response showed bioeconômica. / Foram utilizado 32 leitões machos castrados de linhagem comercial desmamados com 21 dias de idade com aproximadamente 6,0 kg de peso vivo, com o objetivo de avaliar os efeitos de diferentes níveis (0; 12; 24 e 36%) de inclusão de raspa integral de mandioca (RIM) e formas de arraçoamento sobre o desempenho zootécnico de suínos na fase inicial - I (21 a 42 dias de idade), fase inicial - II (42 a 70 dias de idade) e fase total (21 a 70 dias de idade), bem como a sua viabilidade econômica. As rações foram isoprotéicas (21,0 e 19,0%) e isocalóricas (3.100 e 3.200 kcalEM/kg), respectivamente. O delineamento experimental foi o de blocos ao acaso num esquema fatorial 4 x 2 ( quatro níveis de inclusão de RIM) e duas formas de arraçoamento ( dietas secas e úmidas), com quatro repetições por ratamento e um animal por parcela. O critério para formação de blocos foi o peso inicial dos leitões. O ganho de peso médio diário (GPMD), o consumo de ração médio diário (CRMD), e a conversão alimentar (CA) não diferem significativamente (P>0,05) para os diferentes níveis de RIM e entre as formas de arraçoamento. Conclui-se que é tecnicamente viável a utilização da raspa integral de mandioca até o nível de 36% nas rações de suínos na fase inicial (21 a 70 dias de idade), independente da forma de arraçoamento e que o nível de inclusão de 12% de RIM foi o que mostrou melhor resposta bioeconômica.

Title: Interactive crawling and data extraction Author: Bc. Petr Fejfar Author's e-mail address: pfejfar@gmail.com Department: Department of Distributed and Dependable Systems Supervisor: Mgr. Pavel Je ek, Ph.D., Department of Distributed and De- pendable Systems Abstract: The subject of this thesis is Web crawling and data extraction from Rich Internet Applications (RIA). The thesis starts with analysis of modern Web pages along with techniques used for crawling and data extraction. Based on this analysis, we designed a tool which crawls RIAs according to the instructions defined by the user via graphic interface. In contrast with other currently popular tools for RIAs, our solution is targeted at users with no programming experience, including business and analyst users. The designed solution itself is implemented in form of RIA, using the Web- Driver protocol to automate multiple browsers according to user-defined instructions. Our tool allows the user to inspect browser sessions by dis- playing pages that are being crawled simultaneously. This feature enables the user to troubleshoot the crawlers. The outcome of this thesis is a fully design and implemented tool enabling business user to extract data from the RIAs. This opens new opportunities for this type of user to collect data from Web pages for use...

På internet finns det idag ett stort utbud av försäljningswebbsidor där det hela tiden inkommer nya annonser. Vi ser att det finns ett behov av ett verktyg som övervakar de här webbsidorna dygnet runt för att se hur mycket som säljs och vad som säljs. Att skapa ett program som övervakar webbsidor är tidskrävande, därför har vi skapat ett ramverk som underlättar skapandet av webbskrapare som är fokuserade på att listbaserade försäljningswebbsidor på nätet. Det finns flera olika ramverk för webbskrapning, men det finns väldigt få som endast är fokuserade på den här typen av webbsidor.

CoordenaÃÃo de AperfeiÃoamento de Pessoal de NÃvel Superior / Foram utilizado 32 leitÃes machos castrados de linhagem comercial desmamados com 21 dias de idade com aproximadamente 6,0 kg de peso vivo, com o objetivo de avaliar os efeitos de diferentes nÃveis (0; 12; 24 e 36%) de inclusÃo de raspa integral de mandioca (RIM) e formas de arraÃoamento sobre o desempenho zootÃcnico de suÃnos na fase inicial - I (21 a 42 dias de idade), fase inicial - II (42 a 70 dias de idade) e fase total (21 a 70 dias de idade), bem como a sua viabilidade econÃmica. As raÃÃes foram isoprotÃicas (21,0 e 19,0%) e isocalÃricas (3.100 e 3.200 kcalEM/kg), respectivamente. O delineamento experimental foi o de blocos ao acaso num esquema fatorial 4 x 2 ( quatro nÃveis de inclusÃo de RIM) e duas formas de arraÃoamento ( dietas secas e Ãmidas), com quatro repetiÃÃes por ratamento e um animal por parcela. O critÃrio para formaÃÃo de blocos foi o peso inicial dos leitÃes. O ganho de peso mÃdio diÃrio (GPMD), o consumo de raÃÃo mÃdio diÃrio (CRMD), e a conversÃo alimentar (CA) nÃo diferem significativamente (P>0,05) para os diferentes nÃveis de RIM e entre as formas de arraÃoamento. Conclui-se que à tecnicamente viÃvel a utilizaÃÃo da raspa integral de mandioca atà o nÃvel de 36% nas raÃÃes de suÃnos na fase inicial (21 a 70 dias de idade), independente da forma de arraÃoamento e que o nÃvel de inclusÃo de 12% de RIM foi o que mostrou melhor resposta bioeconÃmica. / 32 piglets were used to castrate commercial line weaned at 21 days of age with approximately 6.0 kilograms of weight, to evaluate the effects of different levels (0, 12, 24 and 36%) of full inclusion of scraping of cassava (RIM) and forms of arraÃoamento on the performance of breeding pigs in the initial stage - I (21 to 42 days of age), the initial phase - II (42 to 70 days old) and total phase (21 to 70 days of age), and its economic viability. The diets were isoproteic (21.0 and 19.0%) and isocaloric (3,100 and 3,200 kcalEM / kg), respectively. The experimental design was a block at random in a 4 x 2 factorial (four levels of inclusion of RIM) and two forms of arraÃoamento (dry and wet diets), with four repetitions per eatment and one animal per share. The criterion for training block was the initial weight of piglets. The gain in average daily weight (GPMD), the average daily consumption of feed (CRMD), and feed conversion (CA) did not differ significantly (P> 0.05) for different levels of between RIM and the forms of arraÃoamento. It follows that it is technically feasible to use the full scraping of cassava to the level of 36% in pig feed in the initial phase (21 to 70 days of age), regardless of the form of arraÃoamento and that the level of inclusion of 12% RIM, which was the best response showed bioeconÃmica.

No description available.

<div>Reduction in the cost of Network Cameras along with a rise in connectivity enables entities all around the world to deploy vast arrays of camera networks. Network cameras offer real-time visual data that can be used for studying traffic patterns, emergency response, security, and other applications. Although many sources of Network Camera data are available, collecting the data remains difficult due to variations in programming interface and website structures. Previous solutions rely on manually parsing the target website, taking many hours to complete. We create a general and automated solution for indexing Network Camera data spread across thousands of uniquely structured webpages. We analyze heterogeneous webpage structures and identify common characteristics among 73 sample Network Camera websites (each website has multiple web pages). These characteristics are then used to build an automated camera discovery module that crawls and indexes Network Camera data. Our system successfully extracts 57,364 Network Cameras from 237,257 unique web pages. </div>

Cílem této práce je vytvořit platformu pro sběr a zobrazování metadat o kryptoměnových adresách z veřejného i temného webu. K dosažení tohoto cíle jsem použil technologie zpracování webu napsané v PHP. Komplikace doprovázející automatické zpracování webových stránek byly vyřešeny techonologí Apache Kafka a jejími schopnosti škálování procesů. Modularita platformy byla dosažena pomocí architektury microservices a Docker containerization. Práce umožňuje jedinečný způsob, jak hledat potenciální kriminální aktivity, které se odehrály mimo rámec blockchain, pomocí webové aplikace pro správu platformy a vyhledávání v extrahovaných datech. Vytvořená platforma zjednodušuje přidávání nových, na sobě nezávislých modulů, kde Apache Kafka zprostředkovává komunikaci mezi nimi. Výsledek této práce může být použit pro detekci a prevenci kybernetické kriminality. Uživatelé tohoto systému mohou být orgány činné v trestním řízení nebo ostatní činitelé a uživatelé, zajímající se o reputaci a kreditibilitu kryptoměnových adres.

I en värld där alltmer information lagras på internet är det svårt för en vanlig användare att hänga med. Även när informationen finns tillgänglig på en och samma hemsida kan den hemsidan sakna funktioner eller vara svår att läsa av. Idén bakom att skrapa hemsidor, tidningar eller spel på information är inte ny och detta examensarbete fokuserar på att bygga en web scraper med tillhörande hemsida där användare kan ladda upp sitt schema skrapat från TimeEdit. Hemsidan ska sedan presentera denna skrapade data på ett visuellt tilltalande sett. När system är färdigutvecklade utvärderas dem för att se om examensarbetets mål har uppnåtts samt om systemen har förbättrat det befintliga sättet att hantera schemaläggning i TimeEdit hos lärare och studenter. I sammanfattningen finns sedan framtida forskning och arbeten presenterat. / The concept of scraping the web is not new, however, with modern programming languages it is possible to build web scrapers that can collect unstructured data and save this in a structured way. TimeEdit, a scheduling platform used by Mid Sweden University, has no feasible way to count how many hours has been scheduled at any given week to a specific course, student, or professor. The goal of this thesis is to build a python-based web scraper that collects data from TimeEdit and saves this in a structured manner. Users can then upload this text file to a dynamic website where it is extracted from the file and saved into a predetermined database and unique to that user. The user can then get this data presented in a fast, efficient, and user-friendly way. This platform is developed and evaluated with the resulting platform being a good and fast way to scan a TimeEdit schedule and evaluate the extracted data. With the platform built future work is recommended to make it a finishes product ready for live use by all types of users.

The thesis describes the creation of the acquisition and analysis of data from the public register of contracts and other defined sources. In the introduction there are described the existing variants of scrapping tools and their use, as well as the problems of Business Intelligence and data warehouses. The next section is devoted to identifying source data. Subsequently, the procedure and design of the solution are described, on which basis was designed the data warehouse. Implementation of ETL processes and creation of final reports are mentioned in the implementation part.