Glossary entry
अर्को टोकन अनुमान
Definition (English)
The core training task of LLMs: predicting the next piece of text given prior context.
अर्थ (नेपालीमा)
एलएलएमको मूल तालिम काम: अघिल्लो सन्दर्भ हेरी पाठको अर्को टुक्रा अनुमान गर्ने।
Related terms
GPT
जीपीटी (GPT)
A family of generative transformer models that produce text by predicting the next token.
In-Context Learning
इन-कन्टेक्स्ट सिकाइ
A model learning to perform a task purely from examples given in the prompt, without retraining.
Prediction
भविष्यवाणी / अनुमान
The output a model produces for a given input, such as a label, number, or generated text.
BERT
बर्ट (BERT)
An influential transformer model that reads text in both directions to understand context.
Context Window
सन्दर्भ विन्डो
The maximum amount of text a model can consider at once when generating a response.
Fine-Tuning
फाइन-ट्युनिङ
Further training a pre-trained model on specific data to specialize it for a task.
Long Context
लामो सन्दर्भ
The capacity of a model to process very large amounts of input text at once.
Online Learning
अनलाइन सिकाइ
Training a model continuously as new data arrives, one piece at a time.