Global ETD Search

Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.

Results

Showing 1 to 1 of 1 for “"Rotary Position Embeddings"”.

  1. On positional information in transformers in the era of hardware-aware architecture design

    Imparting positional information has been a crucial component in Transformers due to attention's invariance to permutation. Methods that bias attention weights, like Relative Positional Bias (RPB), have been preferred choice in more recent transformer-based architectures for vision. In parallel, …

    gatech Repository record for On positional information in transformers in the era of hardware-aware architecture design (opens in a new tab)