TERMIUM Plus®
From: Translation Bureau
On social media
Consult the Government of Canada’s terminology data bank.
TEXT TOKEN [1 record]
Record 1 - internal organization data 2026-06-03
Record 1, English
Record 1, Subject field(s)
- Information Processing (Informatics)
- Artificial Intelligence
Record 1, Main entry term, English
- token
1, record 1, English, token
correct, noun
Record 1, Abbreviations, English
Record 1, Synonyms, English
- text token 2, record 1, English, text%20token
correct, noun
Record 1, Textual support, English
Record number: 1, Textual support number: 1 CONT
Tokens are the basic units of text that AI models ... use to process and generate language. ... Tokens can be as short as a single character or as long as a full word. Spaces, punctuation and even parts of words count as tokens. The model splits ... text into tokens before processing and generating responses. 3, record 1, English, - token
Record 1, French
Record 1, Domaine(s)
- Traitement de l'information (Informatique)
- Intelligence artificielle
Record 1, Main entry term, French
- jeton
1, record 1, French, jeton
correct, masculine noun
Record 1, Abbreviations, French
Record 1, Synonyms, French
- jeton textuel 2, record 1, French, jeton%20textuel
correct, masculine noun
Record 1, Textual support, French
Record number: 1, Textual support number: 1 DEF
Donnée élémentaire d'un grand modèle de langage, qui est constituée d'une suite de caractères obtenue par la segmentation automatique d'un texte. 2, record 1, French, - jeton
Record number: 1, Textual support number: 1 OBS
La segmentation en jetons textuels est utilisée aussi bien dans la phase d'apprentissage automatique que dans la phase de traitement d'une instruction générative. 2, record 1, French, - jeton
Record number: 1, Textual support number: 2 OBS
Le nombre de jetons textuels sert à mesurer la taille d'un grand modèle de langage; il permet aussi d'estimer et de facturer le coût de fonctionnement des grands modèles de langage commerciaux. 2, record 1, French, - jeton
Record number: 1, Textual support number: 3 OBS
jeton textuel : désignation et définition publiées au Journal officiel de la République française le 6 septembre 2024. 3, record 1, French, - jeton
Record 1, Spanish
Record 1, Campo(s) temático(s)
- Tratamiento de la información (Informática)
- Inteligencia artificial
Record 1, Main entry term, Spanish
- token
1, record 1, Spanish, token
correct, masculine noun
Record 1, Abbreviations, Spanish
Record 1, Synonyms, Spanish
- token de texto 2, record 1, Spanish, token%20de%20texto
correct, masculine noun
Record 1, Textual support, Spanish
Record number: 1, Textual support number: 1 CONT
Antes de que un modelo de lenguaje pueda procesar texto, es necesario convertir las palabras en una representación numérica comprensible para la máquina. A este proceso se le llama tokenización. Un token es una unidad mínima de texto que el modelo utiliza para entender y generar información: puede ser una palabra completa, una sílaba o incluso un fragmento de palabra, dependiendo de la estrategia empleada. 3, record 1, Spanish, - token
Copyright notice for the TERMIUM Plus® data bank
© Public Services and Procurement Canada, 2026
TERMIUM Plus®, the Government of Canada's terminology and linguistic data bank
A product of the Translation Bureau
Features
GCtranslate (available on the Government of Canada network only)
Use this artificial intelligence prototype to translate Government of Canada content up to and including Protected B. Available to employees of selected departments and agencies only.
Writing tools
The Language Portal’s writing tools have a new look! Easy to consult, they give you access to a wealth of information that will help you write better in English and French.
Glossaries and vocabularies
Access Translation Bureau glossaries and vocabularies.
- Date Modified: