AI Operations & Cost
Latency
Definition
The time between making a request and receiving a response or completing an operation.
Why it matters for your business
An assistant that is accurate but slow can still frustrate customers or hold up a workflow.
In practice
A team measures how long a chatbot takes to begin answering and to finish its reply.