Glossary entry
BERT
बर्ट (BERT)
Definition (English)
An influential transformer model that reads text in both directions to understand context.
अर्थ (नेपालीमा)
सन्दर्भ बुझ्न पाठलाई दुवैतर्फ पढ्ने प्रभावशाली ट्रान्सफर्मर मोडेल।
Related terms
Other terms related to BERT.
-
Context Window
सन्दर्भ विन्डो
The maximum amount of text a model can consider at once when generating a response.
-
GPT
जीपीटी (GPT)
A family of generative transformer models that produce text by predicting the next token.
-
Language Model
भाषा मोडेल
A model that predicts likely sequences of words to understand or generate text.
-
Large Language Model (LLM)
ठूलो भाषा मोडेल
A very large neural network trained on massive text to understand and generate language.
-
Long Context
लामो सन्दर्भ
The capacity of a model to process very large amounts of input text at once.
-
Multimodal AI
बहुविध एआई
AI that can understand and combine multiple data types, such as text, images, and audio.
-
Next Token Prediction
अर्को टोकन अनुमान
The core training task of LLMs: predicting the next piece of text given prior context.
-
Artificial General Intelligence (AGI)
कृत्रिम सामान्य बुद्धिमत्ता
A hypothetical AI that can understand and perform any intellectual task a human can, across many domains.