Transformer

A transformer is a neural network architecture that processes sequences (like sentences) using a mechanism called attention.