Glossary entry
Rate Limit
रेट लिमिट / दर सीमा
Definition (English)
A cap on how many requests a user can make to a service in a time window.
अर्थ (नेपालीमा)
तोकिएको समयभित्र प्रयोगकर्ताले सेवामा गर्न सक्ने अनुरोधको सीमा।
Glossary entry
रेट लिमिट / दर सीमा
Definition (English)
A cap on how many requests a user can make to a service in a time window.
अर्थ (नेपालीमा)
तोकिएको समयभित्र प्रयोगकर्ताले सेवामा गर्न सक्ने अनुरोधको सीमा।
Related terms
Batch Inference
ब्याच इन्फरेन्स
Running predictions on many inputs together rather than one at a time.
Throughput
थ्रुपुट
The number of requests or items a system can process in a given time.
Adam Optimizer
एडम अप्टिमाइजर
A widely used optimizer that adapts the learning rate for each parameter.
Artificial General Intelligence (AGI)
कृत्रिम सामान्य बुद्धिमत्ता
A hypothetical AI that can understand and perform any intellectual task a human can, across many domains.
Autoregressive
अटोरिग्रेसिभ
Generating output one token at a time, each based on all the tokens produced before it.
Bagging
ब्यागिङ
Training many models on random data subsets and averaging them to reduce variance.
Churn Prediction
ग्राहक छुट्ने अनुमान
Using models to predict which customers are likely to stop using a product or service.
Cold Start
कोल्ड स्टार्ट
The delay or difficulty when a system or model runs for the first time after being idle.