Skip to content
This repository was archived by the owner on Sep 30, 2024. It is now read-only.

Conversation

@Strum355
Copy link
Contributor

@Strum355 Strum355 commented Aug 22, 2023

Our HTTP endpoints have a hard-coded timelimit of 75s. On slower connections with multipart uploads, it is possible for the bandwidth congestion of the competing upload parts to result in the upload failing due to any part taking longer than 75s to upload.
This PR adds a new toggleable to configure the number of parts to be uploaded concurrently, so reduce the congestion/competing between parts.

Test plan

Tested in combination with src-cli over at sourcegraph/src-cli#1023

@Strum355 Strum355 requested a review from efritz August 22, 2023 11:57
@Strum355 Strum355 self-assigned this Aug 22, 2023
@cla-bot cla-bot bot added the cla-signed label Aug 22, 2023
@Strum355 Strum355 added team/graph Graph Team (previously Code Intel/Language Tools/Language Platform) src-cli labels Aug 22, 2023
@Strum355 Strum355 marked this pull request as ready for review August 25, 2023 12:33
@sourcegraph-bot
Copy link
Contributor

Codenotify: Notifying subscribers in CODENOTIFY files for diff 5c7e13f...3a44a08.

Notify File(s)
@efritz lib/codeintel/upload/BUILD.bazel
lib/codeintel/upload/upload.go
lib/codeintel/upload/upload_options.go

@Strum355 Strum355 merged commit de4d547 into main Aug 28, 2023
@Strum355 Strum355 deleted the nsc/codeintel-upload-concurrency branch August 28, 2023 20:56
jhchabran added a commit that referenced this pull request Aug 29, 2023
jhchabran added a commit that referenced this pull request Aug 29, 2023
)

Revert "codeintel: allow configuring max concurrency in uploads (#56117)"

This reverts commit de4d547.
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

cla-signed src-cli team/graph Graph Team (previously Code Intel/Language Tools/Language Platform)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants