Glossary entry
Distillation
डिस्टिलेसन
Definition (English)
Training a smaller model to mimic a larger one, keeping most of its capability.
अर्थ (नेपालीमा)
ठूलो मोडेलको अधिकांश क्षमता राख्दै त्यसलाई नक्कल गर्न सानो मोडेल तालिम दिने काम।
Glossary entry
डिस्टिलेसन
Definition (English)
Training a smaller model to mimic a larger one, keeping most of its capability.
अर्थ (नेपालीमा)
ठूलो मोडेलको अधिकांश क्षमता राख्दै त्यसलाई नक्कल गर्न सानो मोडेल तालिम दिने काम।
Related terms
Active Learning
सक्रिय सिकाइ
A method where the model selects the most useful examples for humans to label.
Attention Mechanism
एटेन्सन मेकानिज्म / ध्यान संयन्त्र
A technique that lets a model focus on the most relevant parts of the input.
Bagging
ब्यागिङ
Training many models on random data subsets and averaging them to reduce variance.
Batch
ब्याच
A small subset of training data processed together in one step of training.
Batch Normalization
ब्याच नर्मलाइजेसन
A technique that stabilizes and speeds up training by normalizing layer inputs.
Bias (in AI)
पूर्वाग्रह (एआईमा)
Systematic unfairness in AI outputs, often reflecting biases present in training data.
Carbon Footprint (AI)
कार्बन फुटप्रिन्ट (एआई)
The greenhouse-gas emissions caused by training and running AI systems.
Checkpoint
चेकपोइन्ट
A saved snapshot of a model's state during training so it can be resumed or reused.