Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 27 for “"offline evaluation"”.
-
A Test Collection for Offline Evaluation of Recommender Systems
… A complaint about this approach is that the evaluation measures can only use a small number of known preferences and have no information about the majority of recommended items. Prior research has shown that offline evaluation of recommendation systems using a test/train split methodology may …
-
Offline Evaluation via Human Preference Judgments: A Dueling Bandits Problem
… by neural rankers create a need for novel evaluation methods. If every ranker returns highly relevant items in the top ranks, it becomes difficult to recognize meaningful differences between them and to build reusable test collections. Several recent papers explore pairwise preference …
-
Algorizmi: A Configurable Virtual Testbed to Generate Datasets for Offline Evaluation of Intrusion Detection Systems
… problem remains orthogonal to the others: IDS evaluation. In other words, researchers have not yet succeeded to agree on a general systematic methodology and/or a set of metrics to fairly evaluate different IDS algorithms. This leads to another problem: the lack of an appropriate IDS evaluation …
-
Best Practices for Offline Evaluation for Top-<i>N</i> Recommendation: Candidate Set Sampling and Statistical Inference
Evaluation of recommender systems is key to ensuring that we are making progress by only promoting proposed algorithms that actually outperform the state-of-the-art. Evaluation can be performed offline using logged historic data, or online such as A/B tests. Offline evaluation is the most popular …
-
Active learning in recommender systems: an unbiased and beyond-accuracy perspective
… to identify the query items. As with the evaluation of RSs, preliminary evaluation of AL strategies must be done offline. An offline evaluation can help to narrow the number of promising strategies that need to be evaluated in subsequent costly user trials and online experiments. Where the …
-
Using interaction data for improving the offline and online evaluation of search engines
This thesis investigates how web search evaluation can be improved using historical interaction data. Modern search engines combine offline and online evaluation approaches in a sequence of steps that a tested change needs to pass through to be accepted as an improvement and subsequently deployed. …
-
Unsupervised anomaly detection framework for multiple-connection based network intrusions
… analysis technique. The second experiment is an offline evaluation based on 1998 DARPA intrusion detection dataset. In the offline evaluation, we compare our framework with three other unsupervised anomaly detection approaches, namely, plain k-means clustering, univariate outlier detection and …
-
Music Recommendations Based on Real-Time Data
… These implementations were tested with offline evaluation which showed that for our problem, a contextual bandit model had the best accuracy.
-
POPR: Probabilistic Offline Policy Ranking with Expert Data
While existing off-policy evaluation (OPE) methods typically estimate the value of a policy, in real-world applications, OPE is often used to compare and rank policies before deploying them in the real world. This is also known as the offline policy ranking problem. While one can rank the policies …
-
A Preference Judgment Interface for Authoritative Assessment
For offline evaluation of information retrieval systems, preference judgments have been demonstrated to be a superior alternative to graded or binary relevance judgments. In contrast to graded judgments, where each document is assigned to a pre-defined grade level, with preference judgments, …
-
Towards closing the generalization gap in autonomous driving
… in transitioning from simulation-based evaluations to real-world implementations. While simulation environments offer controlled settings for training driving agents, real-world scenarios introduce unforeseen complexities crucial for assessing the robustness and adaptability of these …
-
Hardware-in-the-Loop Evaluation of Sensor-Source Selection for Prosthetic Locomotion Intent Recognition
… but sensor configurations that perform well offline may be unsuitable for resource-constrained embedded hardware. Existing sensor-selection methods generally prioritize classification accuracy without directly accounting for processing latency, memory usage, or other hardware-dependent …
-
Sensing and sorting ore using a relational influence diagram
… variables, and utility nodes. We learn the model offline and do online inference. Inference is achieved using a combination of exhaustive and random search. The model parameters are learned using Sequential Model-based Algorithm Configuration (SMAC). We simulate the diverters for offline …
-
Information Retrieval Evaluation Measures Based on Preference Graphs
Offline evaluation for web search has used mostly graded judgments to evaluate the performance of information retrieval systems. While graded judgments suffer several known problems, preference judgments simply judge one item over another, which avoids the problem of complex definition of relevance …
-
A Real Time Facial Expression Recognition System Using Deep Learning
… both accuracy and speed is deployed in both offline and real-time frameworks to enable fast and accurate real-time output. Evaluations for both offline and real-time experiments are provided in our work. The offline evaluation is carried out by first evaluating two publicly available …
-
Real-time AI assistance for disorienting control tasks: performance, behavior, and trust
… and a navigation task in a flight simulator. An offline evaluation reveals that an AI system can select actions, per the task's specifications, objectively better than humans. The results align with the hypothesis that an AI system is not susceptible to the same sensory disruptions as humans and …
-
Estimating Error and Bias of Offline Recommender System Evaluation Results
… researchers and practitioners generally conduct offline evaluations to compare the accuracy of top- recommendation lists among candidate algorithms using users’ history consumption data. These offline evaluations typically use metrics and methodologies borrowed from machine learning and …
-
Recommending Answers to Math Questions Using KL-Divergence and the Approximate XML Tree Matching Approach
… state-of-the-art MathIR systems based on an offline evaluation, and (ii) a top-of-the-line machine learning system based on an online performance analysis.
-
Modele rekomendacyjne wspólnej filtracji w serwisach ogłoszeniowych
… oraz ewaluacji. Przedstawiamy wyniki ewaluacji offline oraz online dla istniejących modeli oraz pokazujemy przewagę modelu RP3Beta nad pozostałymi metodami. Przedstawiamy infrastrukturę pozwalającą na generowanie rekomendacji w czasie rzeczywistym oraz pokazujemy możliwość jej zastosowania dla …
-
Essays on Digital Transformation and Business Decision-Making
… fostered transformation of various online and offline environments, which in turn created opportunities and challenges on modern management and decision-making strategies. In this dissertation, I examine three areas that are subject to the impact of such transformation, using evidence-based …
Page 1 of 2