Closed
Description
Description
If the client cancels a prediction request (e.g. due to timeout), the request should not be processed.
If it's difficult to cancel a request that is actively being processed, that could be converted into a separate github issue, and the initial implementation could be to only cancel requests that have not yet started processing.
May be related to #1452