Skip to content

Container as a Service (CaaS) #2173

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 87 commits into from
Jun 4, 2021
Merged
Changes from 1 commit
Commits
Show all changes
87 commits
Select commit Hold shift + click to select a range
6fb6c44
Add dd
RobertLucian May 12, 2021
3eb736b
CaaS WIP
RobertLucian May 13, 2021
22067dc
Remove gRPC
RobertLucian May 13, 2021
c7a5274
Merge branch 'master' into feature/caas-api
RobertLucian May 13, 2021
aa6b367
WIP CaaS
RobertLucian May 13, 2021
74dc9c1
WIP CaaS
RobertLucian May 13, 2021
05caab0
Prevent use of reserved/duplicate container names
RobertLucian May 13, 2021
9b68260
Moving around consts
RobertLucian May 13, 2021
24ced7d
Fix make operator-local command
RobertLucian May 13, 2021
70a9f95
Merge branch 'fix/operator-local' into feature/caas-api
RobertLucian May 13, 2021
92adc2f
WIP CaaS
RobertLucian May 14, 2021
6bad607
Add docker client helper fn (might have to rm later on)
RobertLucian May 14, 2021
1af3ee6
Use kubexit just for batch/task APIs
RobertLucian May 14, 2021
6fb6bfb
WIP CaaS
RobertLucian May 14, 2021
6744ec8
Add task example (plus some fixes)
RobertLucian May 14, 2021
f326d62
Rename container for example API
RobertLucian May 14, 2021
73ddf51
Use istio metrics for cortex get (might have to do this in the proxy …
RobertLucian May 17, 2021
c49eff5
Use the rest of istio metrics for cortex get
RobertLucian May 17, 2021
d9b8e6e
HTTP Reverse Proxy implementation (#2172)
May 17, 2021
c501d53
Replace request-monitor with cortex proxy (#2174)
May 17, 2021
2ef2353
Fix make tests command
RobertLucian May 17, 2021
4976481
Operator changes for CaaS implementation (#2177)
RobertLucian May 19, 2021
a123f54
Add readiness probe to realtime cortex proxy (#2176)
May 19, 2021
fbbf1b5
Support binary data in configmap helper
deliahu May 19, 2021
9722b5a
Update CLI and Python Client (#2189)
deliahu May 22, 2021
5d21a40
Add readiness/liveness probes to k8s CaaS resources (#2187)
RobertLucian May 24, 2021
0cad67b
Support exec probe for realtime's readiness probe (#2190)
RobertLucian May 24, 2021
079c20c
Initial docs pass (#2192)
deliahu May 25, 2021
0a1e2c2
CaaS - test APIs and E2E tests (#2191)
RobertLucian May 27, 2021
d7c03dc
CaaS - fix cortex CLI (#2194)
RobertLucian May 27, 2021
481e17e
Fix build-and-push-test-images make cmd
RobertLucian May 27, 2021
ee712f3
Update docs (#2196)
deliahu May 27, 2021
86620a7
Update lint.sh
deliahu May 27, 2021
a51f947
Dequeuer proxy for Async and Batch APIs (#2181)
May 28, 2021
c04bd6e
CaaS - move max_concurrency/max_queue_length fields (#2198)
RobertLucian May 28, 2021
89c0665
CaaS - cleanup and fixes (#2195)
RobertLucian May 28, 2021
54ef26b
Update test status code offsets
deliahu May 28, 2021
42747e9
Remove offset value from print
RobertLucian May 28, 2021
1842bbb
Merge branch 'master' of github.com:cortexlabs/cortex into feature/ca…
deliahu May 28, 2021
66038e2
Update versions.md
deliahu May 28, 2021
e027242
Update CONTRIBUTING.md
deliahu May 28, 2021
fd55001
Remove dev/load
deliahu May 28, 2021
992e6d9
Misc changes
deliahu May 28, 2021
7508c76
Remove support for max_concurrency and max_queue_length for Async APIs
deliahu May 28, 2021
72578d6
Move the max_concurrency/max_queue_length fields for the test APIs (#…
RobertLucian May 28, 2021
85138e9
CaaS - move the shm field to the compute section (#2202)
RobertLucian May 28, 2021
ef41343
Delete projectID
deliahu May 28, 2021
8501030
Fix projectID deletion
deliahu May 28, 2021
8d82a18
Rename handlerID to podID
deliahu May 28, 2021
da7cc02
Delete unnecessary comment
deliahu May 28, 2021
b626d39
Rename Container Implementation
deliahu May 28, 2021
486584a
Update docs
deliahu May 28, 2021
30eea01
CaaS - Async/Batch Deployments (#2201)
RobertLucian May 28, 2021
30efa6d
Add configmap permissions to controller (#2205)
vishalbollu May 31, 2021
e4edc33
Update docs
deliahu May 31, 2021
7dadcd0
CaaS - healthcheck probes for Async/Batch/Realtime (#2206)
RobertLucian May 31, 2021
2b4badd
Add cortex prefix to labels in fluent bit (#2197)
vishalbollu Jun 1, 2021
8b27181
Fix statsd metrics exporting to prometheus (#2207)
vishalbollu Jun 1, 2021
750e7a0
Display cloudwatch url as output for cortex logs (#2208)
vishalbollu Jun 1, 2021
b9bdf43
Update respond.go (#2209)
RobertLucian Jun 1, 2021
527bf25
CaaS - fix respond function (#2213)
RobertLucian Jun 1, 2021
fae614a
Update test image build scripts
deliahu Jun 2, 2021
c0b85bf
Update test/utils/build.sh
deliahu Jun 2, 2021
596a556
Add docs for chaining APIs
deliahu Jun 2, 2021
6a966bf
Update docs
deliahu Jun 2, 2021
8a05a14
Remove hard coded API name and Job ID values in _completedJobLogURLTe…
vishalbollu Jun 2, 2021
2343383
Fix async API queue deletion during cluster down (#2216)
deliahu Jun 2, 2021
d4d7095
Prevent nil pointer and improve logging on failed health checks (#2211)
vishalbollu Jun 2, 2021
8a9a9a6
CaaS - E2E fixes (#2212)
RobertLucian Jun 2, 2021
cd19bbf
Schedule dequeuer first and then user provided containers for BatchAP…
vishalbollu Jun 2, 2021
7705d64
Add test/apis/realtime/hello-world/build-cpu.sh
deliahu Jun 2, 2021
531337f
cache dequeuer in registry.sh
deliahu Jun 2, 2021
48f42eb
Merge branch 'master' into feature/caas-api
RobertLucian Jun 2, 2021
d21509e
Close the request body in batch handler
vishalbollu Jun 2, 2021
76547a2
Persist metrics when status is in completed with failures state
vishalbollu Jun 2, 2021
0d871ce
Update test APIs
deliahu Jun 3, 2021
27d3cd8
Add build-and-push-test-images command
deliahu Jun 3, 2021
8a246af
Rename build-test-api-images
deliahu Jun 3, 2021
6215883
Rename containers.md
deliahu Jun 3, 2021
2882436
Nits
RobertLucian Jun 3, 2021
0e8839e
Update env list formatting
deliahu Jun 3, 2021
38ffa7d
CaaS - batch probe fixes (#2220)
RobertLucian Jun 3, 2021
9d0d7fe
Merge branch 'feature/caas-api' of github.com:cortexlabs/cortex into …
deliahu Jun 3, 2021
3d10a86
CaaS - nits and fixes (#2221)
RobertLucian Jun 3, 2021
7f2aaed
Update examples
deliahu Jun 3, 2021
b178912
Update main.py
deliahu Jun 3, 2021
ca7e454
Update dev workflow
deliahu Jun 4, 2021
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Update env list formatting
  • Loading branch information
deliahu committed Jun 3, 2021
commit 0e8839ef1d10c94e4c94e3d4e4eab184ef2699c3
16 changes: 7 additions & 9 deletions cli/types/cliconfig/environment.go
Original file line number Diff line number Diff line change
Expand Up @@ -17,12 +17,12 @@ limitations under the License.
package cliconfig

import (
"fmt"
"strings"

cr "github.com/cortexlabs/cortex/pkg/lib/configreader"
"github.com/cortexlabs/cortex/pkg/lib/console"
"github.com/cortexlabs/cortex/pkg/lib/errors"
"github.com/cortexlabs/cortex/pkg/lib/pointer"
"github.com/cortexlabs/cortex/pkg/lib/table"
"github.com/cortexlabs/cortex/pkg/lib/urls"
)

Expand All @@ -32,19 +32,17 @@ type Environment struct {
}

func (env Environment) String(isDefault bool) string {
var items table.KeyValuePairs
var envStr string

if isDefault {
items.Add("name", env.Name+" (default)")
envStr += console.Bold(env.Name + " (default)")
} else {
items.Add("name", env.Name)
envStr += console.Bold(env.Name)
}

items.Add("cortex operator endpoint", env.OperatorEndpoint)
envStr += fmt.Sprintf("\ncortex operator endpoint: %s\n", env.OperatorEndpoint)

return items.String(&table.KeyValuePairOpts{
BoldFirstLine: pointer.Bool(true),
})
return envStr
}

func CortexEndpointValidator(val string) (string, error) {
Expand Down