Glossary entry
Latency
ल्याटेन्सी / विलम्ब
Definition (English)
The delay between sending a request to a model and receiving its response.
अर्थ (नेपालीमा)
मोडेललाई अनुरोध पठाएदेखि जवाफ आउनेसम्मको ढिलाइ।
Glossary entry
ल्याटेन्सी / विलम्ब
Definition (English)
The delay between sending a request to a model and receiving its response.
अर्थ (नेपालीमा)
मोडेललाई अनुरोध पठाएदेखि जवाफ आउनेसम्मको ढिलाइ।
Related terms
REST API
रेस्ट एपीआई
A common style of web API for sending and receiving data over standard requests.
Token Streaming
टोकन स्ट्रिमिङ
Sending a model's response token by token as it is generated, for faster feedback.
Backpropagation
ब्याकप्रोपागेसन
The algorithm that adjusts weights by sending error signals backward through the network.
Bias-Variance Tradeoff
बायस-भेरियन्स सन्तुलन
The balance between a model being too simple (high bias) and too sensitive to data (high variance).
Brain-Computer Interface
मस्तिष्क-कम्प्युटर अन्तरापृष्ठ
Technology that enables direct communication between the brain and a computer.
Build vs Buy
बनाउने कि किन्ने
The decision between developing an AI solution in-house or purchasing an existing one.
Cold Start
कोल्ड स्टार्ट
The delay or difficulty when a system or model runs for the first time after being idle.
Context Window
सन्दर्भ विन्डो
The maximum amount of text a model can consider at once when generating a response.