Transformer
What does Transformer mean?
A neural network architecture built around attention mechanisms, widely used in language and other modalities.
A practical example
A text model uses attention to combine information from earlier tokens.
MICHAEL ORACLE’S AI DICTIONARY
Training & models · Advanced