X Amatriain｜Transformer模型介绍与分类

Transformer models: an introduction and catalog

X Amatriain

在过去的几年里，已经有几十种 Transformer 族模型迅速出现，所有这些模型的名字都很有趣，但并不是显而易见。本文的目的是为最流行的 Transformer 模型提供一个比较全面又简单的目录和分类。本文还介绍了 Transformer 模型最重要的方面和创新。

In the past few years we have seen the meteoric appearance of dozens of models of the Transformer family, all of which have funny, but not self-explanatory, names. The goal of this paper is to offer a somewhat comprehensive but simple catalog and classification of the most popular Transformer models. The paper also includes an introduction to the most important aspects and innovation in Transformer models.

https://arxiv.org/abs/2302.07730