Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 37 for “"test collections"”.
-
Test collections for web-scale datasets using Dynamic Sampling
… It is used for the construction of statistical test collections for evaluating information retrieval systems. Dynamic Sampling has been shown to lead to comparable or better test collections compared to pooling methods, at a fraction of the assessment effort. In this work, we adapt a high-recall …
-
Reliable and low-cost test collections construction using machine learning
… requires an evaluation framework in which A/B testing of new vs. existing algorithms can be reliably performed. While today's search evaluation methodology is reliable, it relies heavily upon people manually annotating the relevance of many search results, which is slow and expensive. Moreover, …
-
Crowdsourcing construction of information retrieval test collections for conversational speech
Building a test collection for an ad hoc information retrieval system on conversational speech raises new challenges for researchers. Traditional methods for building test collections are costly, and thus they are not feasible to apply to large scale conversational speech data. Constructing a large …
-
The Effect of IOX Objectives-Based Reading Test Collections upon Fifth-Grade Comprehension and Word-Attack Skills
… compares the effect of the objectives-based test collections of the Instructional Objectives Exchange on reading comprehension and word-attack skills of fifth-grade students in a basal reader program. The IOX, a non-profit educational organization, was established in the late 1960's to …
-
Leveraging Formulae and Text for Improved Math Retrieval
Large collections containing millions of math formulas are available online. Retrieving math expressions from these collections is challenging. Users can use formula, formula+text, or math questions to express their math information needs. The structural complexity of formulas requires specialized …
-
Cross-Domain Sentence Modeling for Relevance Transfer with BERT
… to ``ad hoc'' document retrieval on newswire collections: relevance judgments in existing test collections are provided only at the document level, and documents often exceed the length that BERT was designed to handle. To overcome these challenges, we compute and aggregate sentence-level …
-
Arabic multi-document text summarisation
… areas. The first area was the creation of Arabic test collections. The second area was concerned with the actual summarisation process to find methods that improve the quality of Arabic summaries. To address both points we created single and multi-document Arabic test collections both …
-
Building query-based relevance sets without human intervention
collections are the standard framework used in the evaluation of an information retrieval system and the comparison between different systems. A text test collection consists of a set of documents, a set of topics, and a set of relevance assessments which is a list indicating the relevance of each …
-
Facilitating Cross-Lingual Information Retrieval Evaluations for African Languages
… a different language. To support CLIR studies, test collections are actively curated in the information retrieval (IR) field for the evaluation of methods and systems. Resources which support the evaluation of CLIR for African languages exist, however, these resources are few and are mostly …
-
A study of the kinematics of probabilities in information retrieval
… four models is analysed and compared using five test collections of different sizes and characteristics. The results of this experimentation depend heavily on the choice of term weight and term similarity measures adopted. The most important conclusion of this thesis is that theoretically a …
-
An Information Retrieval Test Collection for English SMS Conversations
… research is to build an information retrieval test collection from informal conversational messages and to demonstrate the use of that collection to compare the retrieval effectiveness of some information retrieval systems. The test collection is based on the Linguistic Data Consortium's …
-
Applying local latent semantic indexing for information retrieval visualization
… Experiments with LLSI/Cluster on three test collections of MEDLINE articles indicate that similar articles tend to cluster together. These findings suggest that LLSI/Cluster has potential as a visualization method for displaying a large set of documents to the user in a graphical manner.
-
On Design and Evaluation of High-Recall Retrieval Systems for Electronic Discovery
… to facilitate the use of retrieval systems on collections that cannot be distributed due to the sensitivity or privacy of the material contained within. Accordingly, a Web API is used to distribute document collections, informations needs, and corresponding relevance assessments in a …
-
Enabling Cross-lingual Information Retrieval for African Languages
… Motivated by this, we created AfriCLIRMatrix, a test collection for cross-lingual information retrieval research in 15 diverse African languages automatically created from Wikipedia. The dataset comprises 6 million queries in English and 23 million relevance judgments automatically extracted from …
-
Using context to integrate Hypermedia with Information Retrieval Systems
… taken into consideration by using five distinct test collections.</p>
-
On the evaluation of aggregated web search
… challenging. The Cranfield paradigm, use of test collections and evaluation measures to assess the effectiveness of information retrieval (IR) systems, is the de-facto standard evaluation strategy in the IR research community and it has its origins in work dating to the early 1960s. This …
-
Using contour information and segmentation for object registration, modeling and retrieval
… of content-based indexing and retrieval in large collections of images. Target applications include retrieval in collections of closed silhouettes, holistic w ord recognition in handwritten historical manuscripts and shape registration. Also, the thesis explores the feasibility of contour-based …
-
The voting model for people search
… evaluated on three standard expert search test collections, deriving conclusions concerning each component of the Voting Model, namely the method used to identify the documents that represent each candidate's expertise areas, the weighting models that are used to rank the documents, and the …
-
A Generic Approach to Component-Level Evaluation in Information Retrieval
… paradigm using a specific collection of test queries in combination with relevance assessments in a laboratory environment is the classic approach to compare the impact of retrieval systems and their underlying models on retrieval effectiveness. In the past two decades international …
-
The Effects of Time Constraints and Document Excerpts on Relevance Assessing Behavior
… They play a significant role in making test collections which can be used in evaluations and system designs. Relevance assessment is also highly important for e-discovery where relevant documents and materials should be found with acceptable cost and in an efficient way. In order to …
Page 1 of 2