TERMIUM Plus®
The Government of Canada’s terminology and linguistic data bank.
TRANSFORMER NEURAL NETWORK [1 record]
Record 1 - internal organization data 2025-04-16
Record 1, English
Record 1, Subject field(s)
- Artificial Intelligence
Record 1, Main entry term, English
- transformer
1, record 1, English, transformer
correct, noun
Record 1, Abbreviations, English
Record 1, Synonyms, English
- transformer neural network 2, record 1, English, transformer%20neural%20network
correct, noun
- transformer network 2, record 1, English, transformer%20network
correct, noun
Record 1, Textual support, English
Record number: 1, Textual support number: 1 CONT
Transformers are a type of neural networks designed to analyze sequential data, like text, and produce relevant responses considering the context of the input. 3, record 1, English, - transformer
Record number: 1, Textual support number: 2 CONT
Transformers learn the context and meaning of data and track relationships between sequence components. 4, record 1, English, - transformer
Record number: 1, Textual support number: 1 OBS
One of the core components of transformers is the self-attention mechanism. There are other types of neural networks that also use this mechanism to varying degrees, including certain variants of networks that do not traditionally employ self-attention. 5, record 1, English, - transformer
Record number: 1, Textual support number: 1 PHR
transformer architecture, transformer model 5, record 1, English, - transformer
Record 1, French
Record 1, Domaine(s)
- Intelligence artificielle
Record 1, Main entry term, French
- transformeur
1, record 1, French, transformeur
correct, masculine noun
Record 1, Abbreviations, French
Record 1, Synonyms, French
- transformateur 2, record 1, French, transformateur
correct, masculine noun
Record 1, Textual support, French
Record number: 1, Textual support number: 1 CONT
[...] un transformateur est un réseau de neurones qui apprend des éléments de contexte et construit du sens [...] en explorant les relations existant entre des données qui se suivent, comme par exemple les mots à l'intérieur d'une phrase. 2, record 1, French, - transformeur
Record number: 1, Textual support number: 1 OBS
L'un des éléments centraux des transformeurs est le mécanisme d'autoattention. D'autres types de réseaux de neurones font également appel à ce mécanisme à divers degrés, y compris certaines variantes de réseaux qui n'emploient traditionnellement pas l'autoattention. 3, record 1, French, - transformeur
Record number: 1, Textual support number: 2 OBS
transformeur : désignation publiée au Journal officiel de la République française le 6 septembre 2024. 3, record 1, French, - transformeur
Record number: 1, Textual support number: 1 PHR
architecture de transformeur, modèle basé sur un transformeur 3, record 1, French, - transformeur
Record 1, Spanish
Record 1, Textual support, Spanish
Copyright notice for the TERMIUM Plus® data bank
© Public Services and Procurement Canada, 2025
TERMIUM Plus®, the Government of Canada's terminology and linguistic data bank
A product of the Translation Bureau
Features
Language Portal of Canada

Access a collection of Canadian resources on all aspects of English and French, including quizzes.
Writing tools

The Language Portal’s writing tools have a new look! Easy to consult, they give you access to a wealth of information that will help you write better in English and French.
Glossaries and vocabularies

Access Translation Bureau glossaries and vocabularies.
- Date Modified: