Glossary entry
Distributed Training
वितरित तालिम
Definition (English)
Training a model across many machines or chips at once to handle large workloads.
अर्थ (नेपालीमा)
ठूलो काम सम्हाल्न एकैपटक धेरै मेसिन वा चिपमा मोडेल तालिम दिने तरिका।
Related terms
Other terms related to Distributed Training.
-
Federated Learning
फेडरेटेड लर्निङ
Training a shared model across many devices without moving their private data to a server.
-
Sharding
सार्डिङ
Splitting a large model or database across machines to scale beyond one device.
-
Artificial General Intelligence (AGI)
कृत्रिम सामान्य बुद्धिमत्ता
A hypothetical AI that can understand and perform any intellectual task a human can, across many domains.
-
Bagging
ब्यागिङ
Training many models on random data subsets and averaging them to reduce variance.
-
Early Stopping
अर्ली स्टपिङ
Halting training once validation performance stops improving to avoid overfitting.
-
Foundation Model
आधार मोडेल
A large model trained on broad data that can be adapted to many downstream tasks.
-
Layer Normalization
लेयर नर्मलाइजेसन
Normalizing values across features within a layer to stabilize training.
-
Long Context
लामो सन्दर्भ
The capacity of a model to process very large amounts of input text at once.