Glossary entry
Long Context
लामो सन्दर्भ
Definition (English)
The capacity of a model to process very large amounts of input text at once.
अर्थ (नेपालीमा)
मोडेलले एकैपटक धेरै ठूलो इनपुट पाठ प्रशोधन गर्न सक्ने क्षमता।
Related terms
Other terms related to Long Context.
-
Context Window
सन्दर्भ विन्डो
The maximum amount of text a model can consider at once when generating a response.
-
Large Language Model (LLM)
ठूलो भाषा मोडेल
A very large neural network trained on massive text to understand and generate language.
-
BERT
बर्ट (BERT)
An influential transformer model that reads text in both directions to understand context.
-
Corpus
कोर्पस / पाठ सङ्ग्रह
A large, structured collection of text used to train or study language models.
-
Data
डाटा / तथ्याङ्क
Raw facts, numbers, text, images, or sounds that AI systems learn from and process.
-
Data Mining
डाटा माइनिङ
Discovering useful patterns and knowledge from large amounts of data.
-
Distributed Training
वितरित तालिम
Training a model across many machines or chips at once to handle large workloads.
-
Next Token Prediction
अर्को टोकन अनुमान
The core training task of LLMs: predicting the next piece of text given prior context.