Glossary entry
Momentum
मोमेन्टम
Definition (English)
An optimization trick that uses past updates to speed up and smooth learning.
अर्थ (नेपालीमा)
अघिल्ला अद्यावधिक प्रयोग गरी सिकाइ छिटो र सहज बनाउने अनुकूलन उपाय।
Related terms
Other terms related to Momentum.
-
Learning Rate
लर्निङ रेट / सिकाइ दर
A setting that controls how big each step is when a model updates its parameters.
-
Stochastic Gradient Descent (SGD)
स्टोकास्टिक ग्र्याडियन्ट डिसेन्ट
Gradient descent that updates weights using small random batches for speed.
-
Active Learning
सक्रिय सिकाइ
A method where the model selects the most useful examples for humans to label.
-
Adam Optimizer
एडम अप्टिमाइजर
A widely used optimizer that adapts the learning rate for each parameter.
-
Artificial Intelligence (AI)
कृत्रिम बुद्धिमत्ता
The field of building machines and software that can perform tasks normally requiring human intelligence, such as reasoning, learning, and decision-making.
-
Autoencoder
अटोइन्कोडर
A network that compresses data into a compact code and reconstructs it, useful for learning features.
-
Bayesian Optimization
बेजियन अनुकूलन
An efficient method for tuning hyperparameters by modeling which settings work best.
-
Catastrophic Forgetting
विनाशकारी विस्मरण
When a model learning a new task abruptly loses its ability on previous tasks.