Browsing Mathematics (Faculty of) by Subject "Machine Translation"
Now showing items 1-1 of 1
-
Multi-Resolution and Asymmetric Implementation of Attention in Transformers
(University of Waterloo, 2022-04-29)Transformers are the state-of-the-art for machine translation and grammar error correction. One of the most important components of transformers are the attention layers, but they require significant computational power. ...