Glossary entry
LoRA
लोरा (LoRA)
Definition (English)
A lightweight fine-tuning method that adapts a large model by training small added layers.
अर्थ (नेपालीमा)
थोरै थपिएका तह तालिम दिएर ठूलो मोडेल ढाल्ने हलुका फाइन-ट्युनिङ विधि।
Glossary entry
लोरा (LoRA)
Definition (English)
A lightweight fine-tuning method that adapts a large model by training small added layers.
अर्थ (नेपालीमा)
थोरै थपिएका तह तालिम दिएर ठूलो मोडेल ढाल्ने हलुका फाइन-ट्युनिङ विधि।
Related terms
Fine-Tuning
फाइन-ट्युनिङ
Further training a pre-trained model on specific data to specialize it for a task.
Pre-training
पूर्व-तालिम
The initial large-scale training of a model on broad data before any task-specific tuning.
Batch
ब्याच
A small subset of training data processed together in one step of training.
Distributed Training
वितरित तालिम
Training a model across many machines or chips at once to handle large workloads.
Instruction Tuning
इन्स्ट्रक्सन ट्युनिङ
Fine-tuning a model on examples of instructions and responses so it follows directions better.
Semi-Supervised Learning
अर्ध-पर्यवेक्षित सिकाइ
Learning from a small amount of labeled data combined with a large amount of unlabeled data.
Adam Optimizer
एडम अप्टिमाइजर
A widely used optimizer that adapts the learning rate for each parameter.
Bagging
ब्यागिङ
Training many models on random data subsets and averaging them to reduce variance.