TERMIUM Plus®

The Government of Canada’s terminology and linguistic data bank.

TRANSFORMER NEURAL NETWORK [1 record]

Record 1 2025-04-16

English

Subject field(s)
  • Artificial Intelligence
CONT

Transformers are a type of neural networks designed to analyze sequential data, like text, and produce relevant responses considering the context of the input.

CONT

Transformers learn the context and meaning of data and track relationships between sequence components.

OBS

One of the core components of transformers is the self-attention mechanism. There are other types of neural networks that also use this mechanism to varying degrees, including certain variants of networks that do not traditionally employ self-attention.

PHR

transformer architecture, transformer model

French

Domaine(s)
  • Intelligence artificielle
CONT

[...] un transformateur est un réseau de neurones qui apprend des éléments de contexte et construit du sens [...] en explorant les relations existant entre des données qui se suivent, comme par exemple les mots à l'intérieur d'une phrase.

OBS

L'un des éléments centraux des transformeurs est le mécanisme d'autoattention. D'autres types de réseaux de neurones font également appel à ce mécanisme à divers degrés, y compris certaines variantes de réseaux qui n'emploient traditionnellement pas l'autoattention.

OBS

transformeur : désignation publiée au Journal officiel de la République française le 6 septembre 2024.

PHR

architecture de transformeur, modèle basé sur un transformeur

Spanish

Save record 1

Copyright notice for the TERMIUM Plus® data bank

© Public Services and Procurement Canada, 2025
TERMIUM Plus®, the Government of Canada's terminology and linguistic data bank
A product of the Translation Bureau

Features

Language Portal of Canada

Access a collection of Canadian resources on all aspects of English and French, including quizzes.

Writing tools

The Language Portal’s writing tools have a new look! Easy to consult, they give you access to a wealth of information that will help you write better in English and French.

Glossaries and vocabularies

Access Translation Bureau glossaries and vocabularies.

Date Modified: