Global ETD Search

Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.

Results

Showing 1 to 20 of 27 for “"offline evaluation"”.

  1. A Test Collection for Offline Evaluation of Recommender Systems

    … A complaint about this approach is that the evaluation measures can only use a small number of known preferences and have no information about the majority of recommended items. Prior research has shown that offline evaluation of recommendation systems using a test/train split methodology may …

    waterloo Repository record for A Test Collection for Offline Evaluation of Recommender Systems (opens in a new tab)

  2. Offline Evaluation via Human Preference Judgments: A Dueling Bandits Problem

    … by neural rankers create a need for novel evaluation methods. If every ranker returns highly relevant items in the top ranks, it becomes difficult to recognize meaningful differences between them and to build reusable test collections. Several recent papers explore pairwise preference …

    waterloo Repository record for Offline Evaluation via Human Preference Judgments: A Dueling Bandits Problem (opens in a new tab)

  3. Algorizmi: A Configurable Virtual Testbed to Generate Datasets for Offline Evaluation of Intrusion Detection Systems

    … problem remains orthogonal to the others: IDS evaluation. In other words, researchers have not yet succeeded to agree on a general systematic methodology and/or a set of metrics to fairly evaluate different IDS algorithms. This leads to another problem: the lack of an appropriate IDS evaluation …

    waterloo Repository record for Algorizmi: A Configurable Virtual Testbed to Generate Datasets for Offline Evaluation of Intrusion Detection Systems (opens in a new tab)

  4. Best Practices for Offline Evaluation for Top-<i>N</i> Recommendation: Candidate Set Sampling and Statistical Inference

    Evaluation of recommender systems is key to ensuring that we are making progress by only promoting proposed algorithms that actually outperform the state-of-the-art. Evaluation can be performed offline using logged historic data, or online such as A/B tests. Offline evaluation is the most popular …

    boise Repository record for Best Practices for Offline Evaluation for Top-<i>N</i> Recommendation: Candidate Set Sampling and Statistical Inference (opens in a new tab)

  5. Active learning in recommender systems: an unbiased and beyond-accuracy perspective

    … to identify the query items. As with the evaluation of RSs, preliminary evaluation of AL strategies must be done offline. An offline evaluation can help to narrow the number of promising strategies that need to be evaluated in subsequent costly user trials and online experiments. Where the …

    cork Repository record for Active learning in recommender systems: an unbiased and beyond-accuracy perspective (opens in a new tab)

  6. Using interaction data for improving the offline and online evaluation of search engines

    This thesis investigates how web search evaluation can be improved using historical interaction data. Modern search engines combine offline and online evaluation approaches in a sequence of steps that a tested change needs to pass through to be accepted as an improvement and subsequently deployed. …

    glasgow Download PDF for Using interaction data for improving the offline and online evaluation of search engines (opens in a new tab)

  7. Unsupervised anomaly detection framework for multiple-connection based network intrusions

    … analysis technique. The second experiment is an offline evaluation based on 1998 DARPA intrusion detection dataset. In the offline evaluation, we compare our framework with three other unsupervised anomaly detection approaches, namely, plain k-means clustering, univariate outlier detection and …

    uvic Repository record for Unsupervised anomaly detection framework for multiple-connection based network intrusions (opens in a new tab)

  8. Music Recommendations Based on Real-Time Data

    … These implementations were tested with offline evaluation which showed that for our problem, a contextual bandit model had the best accuracy.

    chalmers Repository record for Music Recommendations Based on Real-Time Data (opens in a new tab)

  9. POPR: Probabilistic Offline Policy Ranking with Expert Data

    While existing off-policy evaluation (OPE) methods typically estimate the value of a policy, in real-world applications, OPE is often used to compare and rank policies before deploying them in the real world. This is also known as the offline policy ranking problem. While one can rank the policies …

    byu Repository record for POPR: Probabilistic Offline Policy Ranking with Expert Data (opens in a new tab) Download PDF for POPR: Probabilistic Offline Policy Ranking with Expert Data (opens in a new tab)

  10. A Preference Judgment Interface for Authoritative Assessment

    For offline evaluation of information retrieval systems, preference judgments have been demonstrated to be a superior alternative to graded or binary relevance judgments. In contrast to graded judgments, where each document is assigned to a pre-defined grade level, with preference judgments, …

    waterloo Repository record for A Preference Judgment Interface for Authoritative Assessment (opens in a new tab)

  11. Towards closing the generalization gap in autonomous driving

    … in transitioning from simulation-based evaluations to real-world implementations. While simulation environments offer controlled settings for training driving agents, real-world scenarios introduce unforeseen complexities crucial for assessing the robustness and adaptability of these …

    bu Repository record for Towards closing the generalization gap in autonomous driving (opens in a new tab)

  12. Hardware-in-the-Loop Evaluation of Sensor-Source Selection for Prosthetic Locomotion Intent Recognition

    … but sensor configurations that perform well offline may be unsuitable for resource-constrained embedded hardware. Existing sensor-selection methods generally prioritize classification accuracy without directly accounting for processing latency, memory usage, or other hardware-dependent …

    calpoly Repository record for Hardware-in-the-Loop Evaluation of Sensor-Source Selection for Prosthetic Locomotion Intent Recognition (opens in a new tab)

  13. Sensing and sorting ore using a relational influence diagram

    … variables, and utility nodes. We learn the model offline and do online inference. Inference is achieved using a combination of exhaustive and random search. The model parameters are learned using Sequential Model-based Algorithm Configuration (SMAC). We simulate the diverters for offline …

    ubc Repository record for Sensing and sorting ore using a relational influence diagram (opens in a new tab) Download PDF for Sensing and sorting ore using a relational influence diagram (opens in a new tab)

  14. Information Retrieval Evaluation Measures Based on Preference Graphs

    Offline evaluation for web search has used mostly graded judgments to evaluate the performance of information retrieval systems. While graded judgments suffer several known problems, preference judgments simply judge one item over another, which avoids the problem of complex definition of relevance …

    waterloo Repository record for Information Retrieval Evaluation Measures Based on Preference Graphs (opens in a new tab)

  15. A Real Time Facial Expression Recognition System Using Deep Learning

    … both accuracy and speed is deployed in both offline and real-time frameworks to enable fast and accurate real-time output. Evaluations for both offline and real-time experiments are provided in our work. The offline evaluation is carried out by first evaluating two publicly available …

    ottawa-retro Repository record for A Real Time Facial Expression Recognition System Using Deep Learning (opens in a new tab)

  16. Real-time AI assistance for disorienting control tasks: performance, behavior, and trust

    … and a navigation task in a flight simulator. An offline evaluation reveals that an AI system can select actions, per the task's specifications, objectively better than humans. The results align with the hypothesis that an AI system is not susceptible to the same sensory disruptions as humans and …

    colostate Repository record for Real-time AI assistance for disorienting control tasks: performance, behavior, and trust (opens in a new tab)

  17. Estimating Error and Bias of Offline Recommender System Evaluation Results

    … researchers and practitioners generally conduct offline evaluations to compare the accuracy of top- recommendation lists among candidate algorithms using users’ history consumption data. These offline evaluations typically use metrics and methodologies borrowed from machine learning and …

    boise Repository record for Estimating Error and Bias of Offline Recommender System Evaluation Results (opens in a new tab)

  18. Modele rekomendacyjne wspólnej filtracji w serwisach ogłoszeniowych

    … oraz ewaluacji. Przedstawiamy wyniki ewaluacji offline oraz online dla istniejących modeli oraz pokazujemy przewagę modelu RP3Beta nad pozostałymi metodami. Przedstawiamy infrastrukturę pozwalającą na generowanie rekomendacji w czasie rzeczywistym oraz pokazujemy możliwość jej zastosowania dla …

    amu-pl Repository record for Modele rekomendacyjne wspólnej filtracji w serwisach ogłoszeniowych (opens in a new tab)

  19. Essays on Digital Transformation and Business Decision-Making

    … fostered transformation of various online and offline environments, which in turn created opportunities and challenges on modern management and decision-making strategies. In this dissertation, I examine three areas that are subject to the impact of such transformation, using evidence-based …

    washington Repository record for Essays on Digital Transformation and Business Decision-Making (opens in a new tab)

Page 1 of 2