Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Configurable api server timeout on embedded nginx #24471

Merged
merged 5 commits into from
Jul 6, 2023

Conversation

sum35h
Copy link
Contributor

@sum35h sum35h commented Jun 14, 2023

Description

Testing

How Has This Been Tested?

  • Manual
  • Jest
  • Cypress

@sum35h sum35h linked an issue Jun 14, 2023 that may be closed by this pull request
1 task
@github-actions github-actions bot added the Enhancement New feature or request label Jun 14, 2023
@sum35h sum35h changed the title feat: Configurable api server timeout value on Nginx feat: Configure api server timeout value on embedded nginx Jun 14, 2023
@sum35h sum35h requested a review from sharat87 June 14, 2023 17:22
@sum35h sum35h added the DevOps Pod Issues related to devops label Jun 14, 2023
@sum35h sum35h changed the title feat: Configure api server timeout value on embedded nginx feat: Configurable api server timeout value on embedded nginx Jun 14, 2023
@sum35h sum35h changed the title feat: Configurable api server timeout value on embedded nginx feat: Configurable api server timeout on embedded nginx Jun 14, 2023
@sum35h
Copy link
Contributor Author

sum35h commented Jun 14, 2023

/build-deploy-preview skipTests=true

@github-actions
Copy link

Deploying Your Preview: https://github.com/appsmithorg/appsmith/actions/runs/5270272390.
Workflow: On demand build Docker image and deploy preview.
skip-tests: . env: .
PR: 24471.
recreate: .

@github-actions
Copy link

Deploy-Preview-URL: https://ce-24471.dp.appsmith.com

@sum35h sum35h requested a review from pratapaprasanna June 16, 2023 08:59
@sum35h
Copy link
Contributor Author

sum35h commented Jun 21, 2023

/ok-to-test

@github-actions
Copy link

Tests running at: https://github.com/appsmithorg/appsmith/actions/runs/5333899127.
Workflow: Appsmith External Integration Test Workflow.
Commit: ``.
PR: 24471.
Perf tests will be available at https://app.appsmith.com/app/performance-infra-dashboard/pr-details-638dd7cd2913ba43778b915e?pr=24471&runId=5333899127_1

@github-actions
Copy link

Workflow run: https://github.com/appsmithorg/appsmith/actions/runs/5333899127.
Commit: ``.
The following are new failures, please fix them before merging the PR:

  1. cypress/e2e/Regression/ClientSide/Templates/Fork_Template_Existing_app_spec.js

To know the list of identified flaky tests - Refer here

Copy link
Member

@sharat87 sharat87 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I wanted to confirm if a long-running API call can be made in the DP, but the DP seems to be down. Can you check please? Can you also review the below and share you thoughts?

From http://nginx.org/en/docs/http/ngx_http_proxy_module.html#proxy_read_timeout

The timeout is set only between two successive read operations, not for the transmission of the whole response.

So, the effective timeout from setting this can be much longer. Is this what we're expecting here?

From http://nginx.org/en/docs/http/ngx_http_proxy_module.html#proxy_connect_timeout,

[...] timeout for establishing a connection with a proxied server.

This is the time for just establishing the connection, and shouldn't affect timeouts from long-running queries, right?

From http://nginx.org/en/docs/http/ngx_http_proxy_module.html#proxy_send_timeout,

[...] timeout for transmitting a request to the proxied server.

This is timeout between adjacent bytes of data sent to the backend. This is also not what we want here, right?

Also, the default value for all three from docs is shown as 60s, not 60. Does it work without the s as well?

@sum35h
Copy link
Contributor Author

sum35h commented Jun 29, 2023

@sharat87 The configs work without specifying seconds.

  • proxy_connect_timeout - is not required to increase the query time out.
  • proxy_read_timeout - does actually increase the query timeout despite the description, so this will be required.
  • proxy_write_timeout - did not try this but I think it will increase timeout for post/put, so it would alos be required?

@sum35h sum35h requested a review from sharat87 June 30, 2023 04:37
Copy link
Member

@sharat87 sharat87 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Tested and works. Made suggestions for some whitespace cleanup, but otherwise ready to merge.

sum35h and others added 2 commits July 3, 2023 14:22
Co-authored-by: Shrikant Sharat Kandula <shrikant@appsmith.com>
Co-authored-by: Shrikant Sharat Kandula <shrikant@appsmith.com>
@sum35h sum35h requested a review from sharat87 July 3, 2023 08:53
@sum35h
Copy link
Contributor Author

sum35h commented Jul 3, 2023

/ok-to-test

@github-actions
Copy link

github-actions bot commented Jul 3, 2023

Tests running at: https://github.com/appsmithorg/appsmith/actions/runs/5444864297.
Workflow: Appsmith External Integration Test Workflow.
Commit: ``.
PR: 24471.
Perf tests will be available at https://app.appsmith.com/app/performance-infra-dashboard/pr-details-638dd7cd2913ba43778b915e?pr=24471&runId=5444864297_1

@github-actions
Copy link

github-actions bot commented Jul 3, 2023

Workflow run: https://github.com/appsmithorg/appsmith/actions/runs/5444864297.
Commit: ``.
Cypress dashboard: Click here!
The following are new failures, please fix them before merging the PR:

  1. cypress/e2e/Regression/ClientSide/MobileResponsiveTests/AutoFillWidgets_Reflow_spec.ts

To know the list of identified flaky tests - Refer here

@sum35h
Copy link
Contributor Author

sum35h commented Jul 4, 2023

/ok-to-test

@github-actions
Copy link

github-actions bot commented Jul 4, 2023

Tests running at: https://github.com/appsmithorg/appsmith/actions/runs/5450871447.
Workflow: Appsmith External Integration Test Workflow.
Commit: ``.
PR: 24471.
Perf tests will be available at https://app.appsmith.com/app/performance-infra-dashboard/pr-details-638dd7cd2913ba43778b915e?pr=24471&runId=5450871447_1

@github-actions
Copy link

github-actions bot commented Jul 4, 2023

Workflow run: https://github.com/appsmithorg/appsmith/actions/runs/5450871447.
Commit: ``.
Cypress dashboard url: Click here!
All cypress tests have passed 🎉🎉🎉

@shalomy-cyera
Copy link

@sum35h Thanks for this fix!
Will it be available also for helm install?

@sum35h sum35h merged commit 16d21ed into release Jul 6, 2023
@sum35h sum35h deleted the 14535-feature-increasing-timeout-on-internal-nginx branch July 6, 2023 12:31
@sum35h
Copy link
Contributor Author

sum35h commented Jul 6, 2023

@shalomy-cyera For the helm deployment, we'll need to apply the same settings to the ingress controller. We will update you once we publish the docs to apply the setting to helm installations.

@shalomy-cyera
Copy link

@shalomy-cyera For the helm deployment, we'll need to apply the same settings to the ingress controller. We will update you once we publish the docs to apply the setting to helm installations.

Thanks a lot @sum35h !

@tlawrence-TAG
Copy link

You need to add configuration settings to the UI

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
DevOps Pod Issues related to devops Enhancement New feature or request
Projects
No open projects
Archived in project
Development

Successfully merging this pull request may close these issues.

[Feature]: Increasing timeout on internal nginx
4 participants