Polaris super consumer #450
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* Update consumers to 0.12.0 * Update models for tracking consumer and add TRACK_LENGTH. * Update chart with new version and new env vars. * Bump version in all helmfiles too * Update Chart version too.
* Update autoscaler to 0.7.0 to support kubernetes API 18.x * Update janitor to 0.6.0 to support kubernetes API 18.x * Update default KUBERNETES_VERSION to 1.19 This is the earliest supported version on GKE.
* Update app version to 0.8.1 * Add default REACT_APP environment variables * Bump chart version * Use new chart version in helmfile
* Pin mistune<2 to resolve issue with m2r and mistune. * Pin docutils to 0.16 to match deepcell environment.
Uses tensorflow-serving 2.5.3.
* Upgrade default KUBERNETES_VERSION to 1.20. * Update autoscaler and janitor to latest version with kube 20.x support. * Upgrade bucket monitor to latest version using Python 3.8
* Update default KUBERNETES_VERSION to 1.21. * Upgrade autoscaler to use the kubernetes 21 client. * Upgrade janitor to use the kubernetes 21 client.
This has a patch for the caliban refactor.
msschwartz21
approved these changes
Apr 21, 2022
willgraf
added a commit
that referenced
this pull request
Jul 1, 2022
* Adding Polaris consumer and Polaris zip consumer (#448) * Initial commit of Polaris consumer * Add polaris autoscaling * Update spot detection model * Update Docker image tags frontend 0.9.0 and consumer 0.14.0 * Polaris super consumer (#450) * Initial commit of super consumer * Add changes from stable * Initial commit of spot zip consumer * Revert React setting to stable * Decrease TF_MAX_BATCH_SIZE * Pin Jinja version * Update Docker tags and pull policies * Correct integration-test to use google-github-actions/setup-gcloud@main instead of @master * chore: update to Kubernetes 1.22 (#461) * chore: update default k8s version * fix: update frontend ingress for v1. Followed guide: https://kubernetes.io/docs/reference/using-api/deprecation-guide/#ingress-v122 * chore: update cert-manager to v1.8.2. * chore: update rbac auth API to v1. * chore: use apps/v1 instead of extensions/v1beta1. * chore: update prometheus-adapter to newest v2.x * chore: bump frontend chart version * chore: update prometheus-redis-exporter to latest 3.x * chore: bump frontend default container version * fix: update service for frontend. * chore: update ingress to latest version. * feat: upgrade prometheus-operator to kube-prometheus-stack. Lots of major version changes, but that is because of the CRDs. Seemingly no values change is required. * fix: update prometheus URL. * chore: update redis exporter to latest version. * fix: update make cmd for new prometheus name * chore: bump prometheus-adapter to latest version * chore: rename prometheus-operator to kube-prometheus-stack * chore: update redis to latest helm chart * feat: remove service from redis-consumer chart. bump chart version and update default app version to 0.15.0 * chore: bump version to 0.16.2 (prod version) * fix: update display IP command. * chore: update docs with minor OVPN note. * fix: spot-consumer custom metric name. * chore: update autoscaler and janitor to k8s client 22.x * chore: bump version to 1.8.0 * Merge several updates from dev branch into stable (#463) * Bump Mesmer model version to 8 and update consumer to 0.16.1 (#455) Co-authored-by: William Graf <7930703+willgraf@users.noreply.github.com> Co-authored-by: Emily Laubscher <43769564+elaubsch@users.noreply.github.com> Co-authored-by: msschwartz21 <msschwartz21@gmail.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR creates the Polaris super consumer. The Polaris queue and consumer previously handled spot detection tasks but have been refactored to the
spotsqueue and consumer. The changes to maximum batch size are an attempt to address #449, but the issue is persisting. A temporary solution was implemented in this PR.