Global ETD Search

Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.

Results

Showing 1 to 7 of 7 for “"low-precision arithmetic"”.

  1. Tapered-Precision Numerical Formats for Deep Learning Inference and Training

    … in applications ranging from healthcare to precision agriculture. However, a major challenge with current deep learning models, is their computational complexity. One approach to address this limitation is to compress the deep learning models by employing low-precision numerical formats. …

    rit Repository record for Tapered-Precision Numerical Formats for Deep Learning Inference and Training (opens in a new tab)

  2. Using mixed low-precision formats in multiply-accumulate (MAC) units for DNN training

    … effort of each operation is reduced using low-precision arithmetic. While the use of small data types is common in DNN inference, this is not yet common in DNN training. Previous work in the area is somewhat limited, sometimes only considering 16-bit floating-point formats or overlooking …

    ubc Repository record for Using mixed low-precision formats in multiply-accumulate (MAC) units for DNN training (opens in a new tab) Download PDF for Using mixed low-precision formats in multiply-accumulate (MAC) units for DNN training (opens in a new tab)

  3. Towards Fast and Efficient Representation Learning

    … and generalization. In particular, we ask following questions and provide our solutions: 1) How to reduce the computation cost for fast inference? 2) How to train low-precision models on resources-constrained devices? 3) What does the loss surface looks like for neural nets and how it affects …

    maryland Repository record for Towards Fast and Efficient Representation Learning (opens in a new tab)

  4. Towards using AI accelerators for scientific computing

    … for this purpose. AI hardware typically supports low-precision arithmetic, and the computational patterns it can execute efficiently are limited. This thesis explores whether AI hardware can be used for scientific computing, with a particular focus on stencil computations, linear system and PDE …

    lund Repository record for Towards using AI accelerators for scientific computing (opens in a new tab) Download PDF for Towards using AI accelerators for scientific computing (opens in a new tab)

  5. Towards Lightweight AI: Leveraging Stochasticity, Quantization, and Tensorization for Forecasting

    … and quantitatively at both high-level and low-level abstractions for training and inference. At the algorithmic level, a novel deep, yet lightweight, recurrent architecture is proposed that extends the conventional echo state network. The architecture employs random dynamics, brain-inspired …

    rit Repository record for Towards Lightweight AI: Leveraging Stochasticity, Quantization, and Tensorization for Forecasting (opens in a new tab)

  6. Low-precision climate computing: preserving information despite fewer bits

    … models are not com- putationally efficient. High precision calculations are unnecessary, despite be- ing the standard, given the uncertainties in the climate system and the errors from discretisation, data assimilation and unresolved climate processes. In this thesis, we advance several aspects of …

    oxford Repository record for Low-precision climate computing: preserving information despite fewer bits (opens in a new tab)

  7. Comparing the Performance of Small Word-Size Floating-Point Numerics to Fixed-Point Numerics in Neural Networks

    … become increasingly important. While fixed-point arithmetic offers resource advantages, it suffers from limited dynamic range and quantization inflexibility. This thesis introduces an alternative approach—Adaptive Precision Training (APT)—which leverages reduced-precision floating-point formats …

    gatech Repository record for Comparing the Performance of Small Word-Size Floating-Point Numerics to Fixed-Point Numerics in Neural Networks (opens in a new tab)