PE | 🍎 Paper Today I Read 🦔

[112] RoFormer: Enhanced Transformer with Rotary Position Embedding

[55] Position Prediction as an Effective Pretraining Strategy

ViT PE 2022Q2 25min apple

[4] Conditional Positional Encodings for Vision Transformers