Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Client tools auto update #47466

Merged
merged 16 commits into from
Oct 18, 2024
Merged

Client tools auto update #47466

merged 16 commits into from
Oct 18, 2024

Conversation

vapopov
Copy link
Contributor

@vapopov vapopov commented Oct 10, 2024

In this PR implemented logic for client tools auto update {tsh, tctl} described in this RFD #39805

Update logic downloads Teleport binaries from CDN, extracts data in tools sub-directory (going to be used $TELEPORT_HOME/bin/{UUID-update-pkg}/{tsh,tctl}) and creates symlinks for {tsh,tctl} to $TELEPORT_HOME/bin/{tsh,tctl}.
Added integration tests which compiles updater binary with update logic only to simulate command execution with requested version to downloads them from fake test CDN server.

@vapopov vapopov added the no-changelog Indicates that a PR does not require a changelog entry label Oct 10, 2024
return 0, trace.Errorf("invalid size")
}
avail := stat.Bavail * uint64(stat.Bsize)
avail := uint64(stat.Bavail) * uint64(stat.Bsize)
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This change related to this comment #47060 (comment)
also I'm locally checking linter for warnings related touint64(stat.Bavail)

integration/autoupdate/client_update_test.go Outdated Show resolved Hide resolved
lib/autoupdate/client_update.go Outdated Show resolved Hide resolved
lib/autoupdate/client_update.go Outdated Show resolved Hide resolved
lib/autoupdate/client_update.go Outdated Show resolved Hide resolved
lib/autoupdate/client_update.go Outdated Show resolved Hide resolved
lib/autoupdate/client_update.go Outdated Show resolved Hide resolved
lib/autoupdate/client_update.go Outdated Show resolved Hide resolved
lib/autoupdate/client_update.go Outdated Show resolved Hide resolved
lib/autoupdate/progress.go Outdated Show resolved Hide resolved
lib/autoupdate/utils.go Outdated Show resolved Hide resolved
Move integration tests to client tools specific dir
Use context cancellation with SIGTERM, SIGINT
Remove cancelable tee reader with context replacement
Renaming
Fix archive cleanup if hash is not valid
Limit the archive write bytes
lib/autoupdate/tools/utils.go Outdated Show resolved Hide resolved
integration/autoupdate/tools/main_test.go Outdated Show resolved Hide resolved
lib/autoupdate/tools/updater.go Outdated Show resolved Hide resolved
lib/autoupdate/tools/updater.go Outdated Show resolved Hide resolved
lib/autoupdate/tools/updater.go Outdated Show resolved Hide resolved
lib/autoupdate/tools/updater.go Outdated Show resolved Hide resolved
@vapopov vapopov requested a review from sclevine October 16, 2024 22:27
integration/autoupdate/tools/main_test.go Outdated Show resolved Hide resolved
integration/autoupdate/tools/updater_test.go Outdated Show resolved Hide resolved
lib/autoupdate/tools/utils.go Outdated Show resolved Hide resolved
lib/autoupdate/tools/updater.go Outdated Show resolved Hide resolved
lib/autoupdate/tools/updater.go Outdated Show resolved Hide resolved
lib/autoupdate/tools/updater.go Outdated Show resolved Hide resolved
lib/autoupdate/tools/updater.go Outdated Show resolved Hide resolved
lib/autoupdate/tools/updater.go Outdated Show resolved Hide resolved
lib/autoupdate/tools/updater.go Outdated Show resolved Hide resolved
lib/autoupdate/tools/updater.go Outdated Show resolved Hide resolved
Replace hash for bytes matching
Proper temp file close for archive download
@vapopov vapopov requested a review from sclevine October 17, 2024 20:17
lib/autoupdate/feature.go Outdated Show resolved Hide resolved
lib/autoupdate/tools/utils.go Outdated Show resolved Hide resolved
Copy link
Contributor

@hugoShaka hugoShaka left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me but we might wanbt to check if there's a saner way to detect enterprise builds. I'll open a thread in #teleport-dev

Edit: just saw your comment

@sclevine
Copy link
Member

@hugoShaka note lib/modules might not work for tbot: #47565 (comment)

@@ -0,0 +1,25 @@
//go:build fips
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@zmb3 should I move this one to lib/modules to identify if the build supports the FIPS? Or there already a way to get this info from modules package

Copy link
Member

@sclevine sclevine Oct 18, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this is present as modules.GetModules().IsBoringCrypto() -- BoringCrypto is FIPS validated

@hugoShaka
Copy link
Contributor

hugoShaka commented Oct 18, 2024

@hugoShaka note lib/modules might not work for tbot: #47565 (comment)

I think tbot should be considered an agent like teleport and be updated by the agent updater we're building (as opposed to tools self-update). According to the RFD we going to have a single agent updater for oss, ent, fips and it will figure out the right build from /find or /ping rather than any existing binary version or build flag. So I think everything will fit nicely?

@sclevine
Copy link
Member

@hugoShaka tbot also has a oneshot mode for CI/CD use cases. The current (possibly only verbally discussed) plan is to allow tbot to be upgraded through either method. But this may not ship in the first release of client tools updates.

@vapopov
Copy link
Contributor Author

vapopov commented Oct 18, 2024

@avatus @EdwardDowling would appreciate your review, need one more approval

@vapopov vapopov added this pull request to the merge queue Oct 18, 2024
Merged via the queue into master with commit 84719b3 Oct 18, 2024
39 checks passed
@vapopov vapopov deleted the vapopov/client-auto-update branch October 18, 2024 20:53
vapopov added a commit that referenced this pull request Nov 8, 2024
* Add client tools auto update

* Replace fork for posix platform for re-exec
Move integration tests to client tools specific dir
Use context cancellation with SIGTERM, SIGINT
Remove cancelable tee reader with context replacement
Renaming

* Fix syscall path execution
Fix archive cleanup if hash is not valid
Limit the archive write bytes

* Cover the case with single package for darwin platform after v17

* Move updater logic to tools package

* Move context out from the library
Base URL renaming

* Add more context in comments

* Changes in find endpoint

* Replace test http server with `httptest`
Replace hash for bytes matching
Proper temp file close for archive download

* Add more context to comments

* Move feature flag to main package to be reused

* Constant rename

* Replace build tag with lib/modules to identify enterprise build

* Replace fips tag with modules flag
vapopov added a commit that referenced this pull request Nov 8, 2024
* Add client tools auto update

* Replace fork for posix platform for re-exec
Move integration tests to client tools specific dir
Use context cancellation with SIGTERM, SIGINT
Remove cancelable tee reader with context replacement
Renaming

* Fix syscall path execution
Fix archive cleanup if hash is not valid
Limit the archive write bytes

* Cover the case with single package for darwin platform after v17

* Move updater logic to tools package

* Move context out from the library
Base URL renaming

* Add more context in comments

* Changes in find endpoint

* Replace test http server with `httptest`
Replace hash for bytes matching
Proper temp file close for archive download

* Add more context to comments

* Move feature flag to main package to be reused

* Constant rename

* Replace build tag with lib/modules to identify enterprise build

* Replace fips tag with modules flag
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
no-changelog Indicates that a PR does not require a changelog entry size/lg
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants