Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 41 for “"Web crawling"”.
-
Topic-Oriented Collaborative Web Crawling
A <i>web crawler</i> is a program that "walks" the Web to gather web resources. In order to scale to the ever-increasing Web, multiple crawling agents may be deployed in a distributed fashion to retrieve web data co-operatively. A common approach is to divide the Web into many partitions with an …
-
Web crawling, analysis and archiving
The Web is increasingly important for all aspects of our society, culture and economy. Webarchiving is the process of gathering digital materials from the Web, ingesting it, ensuringthat these materials are preserved in an archive, and making the collected materials availablefor future use and …
-
Intelligent Web Crawling using Semantic Signatures
The quantity of test that is added to the web in the digital form continues to grow and the quest for tools that can process this huge amount of data to retrieve the data of our interest is an ongoing process. Moreover, observing these large volumes of data over a period of time is a tedious task …
-
Analysis, Modeling, and Algorithms for Scalable Web Crawling
… work accurately on finite streams (e.g., sampled web graphs, click stream) as well. In addition, we present accurate models for various crawl characteristics of random graphs, which can forecast a number of aspects of crawl experience based on the graph properties (e.g., degree distribution). All …
-
Heuristic phishing detection based on web crawling and user behaviour monitoring with a deterministic approach for cybersecurity
Com o aprimoramento das técnicas utilizadas pelos atacantes, a detecção e prevenção de ameaças como phishing e malware podem representar um problema e desafio computacional. Uma pesquisa recente descobriu que o phishing e a infecção por código malicioso são as principais ameaças desencadeadas pela …
-
Debesų kompiuterijos sprendimais paremtas modernių saityno programų peržiūros robotas /
In this paper, Web Crawling systems are investigated. Such systems are mostly used in Web archiving, gathering massive amounts of input data used in Machine Learning, also in search engi- nes – discovery of changing Web content is performed and detected resources are indexed. Desc- ribed systems …
-
Large-Scale Content Extraction from Heterogeneous Sources
… large scale content extraction from heterogenous web sources. This task is a very important step in a range of web crawling, indexing and data mining tasks. The described approach makes calculations on the Document Object Model (DOM) in order to uncover which nodes contain relevant content, and …
-
Automated Discovery, Binding, and Integration Of GIS Web Services
… demonstrated steady growth and utilization of Web Service technology. While Web Services have become significant in a number of IT domains such as eCommerce, digital libraries, data feeds, and geographical information systems, common portals or registries of Web Services require manual …
-
Distributed Web Crawler
… possible improvements in distributed web-crawlers. Web-crawling is the cornerstone of search-engines and a well defined part of Internet technology. Due to the size of the Web, it is important that a web-crawler is fast and efficient, since a web-crawler should be able to find the …
-
Thematic web data collection for social sciences
… sciences require collecting a large number of web documents which are semantically related but dispersed across many decentralized sources. We refer to this problem as thematic web data collection: assembling semantically relevant documents that share a common theme but are scattered across …
-
Investigating Social Presence Dynamics in Online Education
… of five key stages, involving Python-based web crawling, manual keyword identification, data processing, statistical analysis using R, and qualitative exploration. The insights obtained offer valuable suggestions for enhancing social presence in future online educational settings. While …
-
Analyse und Vorhersage der Aktualisierungen von Web-Feeds
… über Aktualisierungen oder neue Beiträge auf Webseiten zu informieren. Da bei Feeds in der Regel keine Benachrichtigungsfunktionalitäten angeboten werden, müssen Interessenten Feeds regelmäßig auf Aktualisierungen überprüfen. Die Betrachtung entsprechender Techniken bildet den Kern der Arbeit. …
-
Data-centric strategies for machine translation: efficient acquisition, cleaning, and exploitation of parallel resources
… acquiring high-quality parallel corpora from the web presents significant efficiency and quality challenges. This thesis proposes a comprehensive framework for the acquisition, cleaning, and exploitation of parallel data. First, we tackle the inefficiency of traditional web crawling with a novel …
-
Automated Search and Management for Geographical Web Services
… thesis holds the result of a study in focused web-information search, retrieval and management of retrieved data. Focused web-information search means that the search is exclusive for one type of content or topic. The only topic examined in this search is OGC web-services. More specifically, …
-
Entity finder: A system for entity web page retrieval using pseudo-relevance feedback
… of information available on the World Wide Web, crawling and searching the web may be an attractive technological approach that can help update a database to make it more complete and up to date. In this thesis, we propose a retrieval system that crawls and searches the web in order to …
-
Energy management and consumer modeling in smart grid systems
… footprint induced by an ICT system, namely, the web crawling component of a web search engine. This component discovers and downloads new pages on the Web as well as refreshes previously downloaded pages in the web repository. We introduce the problem of green web crawling, where the objective is …
-
A web application to assist in preparing for ABET accreditation
… data collection process. This work presents a web-based application software tool to automate data collection and report generation efforts in preparing an ABET accreditation document. Requirements for this application were gathered after several meetings with stakeholders of the ABET …
-
Automated domain-aware form understanding with OPAL with a case study in the UK real-estate domain
<p>Web forms are the interfaces to the deep web, and automated form understanding is the key to unlock its contents. It is a fundamental problem in many applications and research fields, such as deep web crawling, data integration, or information extraction. It is also essential for improving web …
-
An investigation of English-Irish machine translation and associated resources
… through EU-supported data collection efforts and web-crawling, showing that though Irish is a low-resource language it is possible to increase the corpora available through concerted data collection efforts. We investigate how increased corpora affect domain-specific (public administration) …
-
Towards completely automatized HTML form discovery on the web
… HTML forms is one of the main challenges in Deep Web crawling. Automatic solutions for this problem perform two main tasks. The first is locating HTML forms on the Web, which is done through the use of traditional/focused crawlers. The second is identifying which of these forms are indeed meant …
Page 1 of 3