Latency
What does Latency mean?
The time between a request and a response or defined stage of processing.
A practical example
A team measures how long users wait for the first response token.
MICHAEL ORACLE’S AI DICTIONARY
Building & deployment · Intermediate
The time between a request and a response or defined stage of processing.
A team measures how long users wait for the first response token.