Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Vertex AI endpoint predict timeout feature for model prediction when using raw_predict #2663

Open
anuragbisht-turing opened this issue Oct 3, 2023 · 1 comment
Labels
api: vertex-ai Issues related to the googleapis/python-aiplatform API. type: feature request ‘Nice-to-have’ improvement, new feature or different behavior or design.

Comments

@anuragbisht-turing
Copy link

Thanks for stopping by to let us know something could be better!

PLEASE READ: If you have a support contract with Google, please create an issue in the support console instead of filing on GitHub. This will ensure a timely response.

Is your feature request related to a problem? Please describe.
Currently we wanted to use raw predictions in our pipelines but having a timeout value due to some business constraints.
Describe the solution you'd like
vertex ai endpoint has option to give raw_prediction as response, but the timeout doesn't work, setting the timeout should be respected in when real_predict is true.
Describe alternatives you've considered
We have set timeout explicitly.
Additional context
this is related to endpoint functionality of vertex ai python package

@product-auto-label product-auto-label bot added the api: vertex-ai Issues related to the googleapis/python-aiplatform API. label Oct 3, 2023
@sasha-gitg sasha-gitg added the type: feature request ‘Nice-to-have’ improvement, new feature or different behavior or design. label Oct 4, 2023
@ntakouris
Copy link

ntakouris commented Jan 22, 2024

Did you check:

from google.api_core.future.polling import DEFAULT_POLLING

### Set the default timeoutto 3600 seconds
DEFAULT_POLLING._timeout = 3600

?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
api: vertex-ai Issues related to the googleapis/python-aiplatform API. type: feature request ‘Nice-to-have’ improvement, new feature or different behavior or design.
Projects
None yet
Development

No branches or pull requests

3 participants