Skip to content

Commit a14be01

Browse files
authored
Update docs (#1904)
1 parent 75f23ac commit a14be01

File tree

20 files changed

+61
-306
lines changed

20 files changed

+61
-306
lines changed

README.md

Lines changed: 11 additions & 22 deletions
Original file line numberDiff line numberDiff line change
@@ -2,29 +2,25 @@
22

33
<br>
44

5-
# Run inference at scale
6-
7-
Cortex is an open source platform for large-scale machine learning inference workloads.
5+
[Website](https://www.cortex.dev)[Slack](https://community.cortex.dev)[Docs](https://docs.cortex.dev)
86

97
<br>
108

11-
## Workloads
9+
# Model serving at scale
1210

13-
### Realtime APIs - respond to prediction requests in real-time
11+
Cortex is a platform for deploying, managing, and scaling machine learning in production.
1412

15-
* Deploy TensorFlow, PyTorch, and other models.
16-
* Scale to handle production workloads with server-side batching and request-based autoscaling.
17-
* Configure rolling updates and live model reloading to update APIs without downtime.
18-
* Serve many models efficiently with multi-model caching.
19-
* Perform A/B tests with configurable traffic splitting.
20-
* Stream performance metrics and structured logs to any monitoring tool.
13+
<br>
2114

22-
### Batch APIs - run distributed inference on large datasets
15+
## Key features
2316

24-
* Deploy TensorFlow, PyTorch, and other models.
25-
* Configure the number of workers and the compute resources for each worker.
26-
* Recover from failures with automatic retries and dead letter queues.
17+
* Run realtime inference, batch inference, and training workloads.
18+
* Deploy TensorFlow, PyTorch, ONNX, and other models to production.
19+
* Scale to handle production workloads with server-side batching and request-based autoscaling.
20+
* Configure rolling updates and live model reloading to update APIs without downtime.
21+
* Serve models efficiently with multi-model caching and spot / preemptible instances.
2722
* Stream performance metrics and structured logs to any monitoring tool.
23+
* Perform A/B tests with configurable traffic splitting.
2824

2925
<br>
3026

@@ -77,10 +73,3 @@ $ cortex deploy text_generator.yaml
7773
```bash
7874
$ curl http://example.com/text-generator -X POST -H "Content-Type: application/json" -d '{"text": "hello world"}'
7975
```
80-
81-
<br>
82-
83-
## Get started
84-
85-
* [Install Cortex](https://docs.cortex.dev)
86-
* [Join our community](https://join.slack.com/t/cortex-dot-dev/shared_invite/zt-lf58axgy-0QkLZzFSSku5_Jybd9yiZQ)

cli/cmd/root.go

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -148,7 +148,7 @@ func initTelemetry() {
148148
var _rootCmd = &cobra.Command{
149149
Use: "cortex",
150150
Aliases: []string{"cx"},
151-
Short: "run inference at scale",
151+
Short: "model serving at scale",
152152
}
153153

154154
func Execute() {

docs/clients/install.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -26,7 +26,7 @@ pip install --upgrade cortex
2626
<!-- CORTEX_VERSION_README x2 -->
2727
```bash
2828
# For example to download CLI version 0.29.0 (Note the "v"):
29-
$ bash -c "$(curl -sS https://raw.githubusercontent.com/cortexlabs/cortex/v0.29.0/get-cli.sh)"
29+
bash -c "$(curl -sS https://raw.githubusercontent.com/cortexlabs/cortex/v0.29.0/get-cli.sh)"
3030
```
3131

3232
By default, the Cortex CLI is installed at `/usr/local/bin/cortex`. To install the executable elsewhere, export the `CORTEX_INSTALL_PATH` environment variable to your desired location before running the command above.

docs/clusters/aws/networking/custom-domain.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -79,7 +79,7 @@ ssl_certificate_arn: <ARN of your certificate>
7979
Create a Cortex cluster:
8080
8181
```bash
82-
$ cortex cluster up --config cluster.yaml
82+
cortex cluster up --config cluster.yaml
8383
```
8484

8585
## Add DNS record

docs/clusters/kubernetes/install.md

Lines changed: 0 additions & 215 deletions
This file was deleted.

docs/clusters/kubernetes/uninstall.md

Lines changed: 0 additions & 15 deletions
This file was deleted.

docs/clusters/registry.md

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -7,23 +7,23 @@ Follow the instructions for [AWS](aws/kubectl.md) or [GCP](gcp/kubectl.md).
77
## Setting credentials
88

99
```bash
10-
$ DOCKER_USERNAME=***
11-
$ DOCKER_PASSWORD=***
10+
DOCKER_USERNAME=***
11+
DOCKER_PASSWORD=***
1212

13-
$ kubectl create secret docker-registry registry-credentials \
13+
kubectl create secret docker-registry registry-credentials \
1414
--namespace default \
1515
--docker-username=$DOCKER_USERNAME \
1616
--docker-password=$DOCKER_PASSWORD
1717

18-
$ kubectl patch serviceaccount default --namespace default \
18+
kubectl patch serviceaccount default --namespace default \
1919
-p "{\"imagePullSecrets\": [{\"name\": \"registry-credentials\"}]}"
2020
```
2121

2222
## Deleting credentials
2323

2424
```bash
25-
$ kubectl delete secret --namespace default registry-credentials
25+
kubectl delete secret --namespace default registry-credentials
2626

27-
$ kubectl patch serviceaccount default --namespace default \
27+
kubectl patch serviceaccount default --namespace default \
2828
-p "{\"imagePullSecrets\": []}"
2929
```

docs/start.md

Lines changed: 2 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,7 @@
33
## Install the CLI
44

55
```bash
6-
$ pip install cortex
6+
pip install cortex
77
```
88

99
See [here](clients/install.md) for alternative installation options.
@@ -12,9 +12,8 @@ See [here](clients/install.md) for alternative installation options.
1212

1313
* [Launch a Cortex cluster on your AWS account](clusters/aws/install.md)
1414
* [Launch a Cortex cluster on your GCP account](clusters/gcp/install.md)
15-
* [Install Cortex on your Kubernetes cluster](clusters/kubernetes/install.md)
1615

17-
## Run inference workloads
16+
## Run machine learning workloads
1817

1918
* [Realtime API](workloads/realtime/example.md)
2019
* [Batch API](workloads/batch/example.md)

docs/summary.md

Lines changed: 2 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -51,7 +51,7 @@
5151

5252
## Clusters
5353

54-
* Cortex Cloud on AWS
54+
* AWS
5555
* [Install](clusters/aws/install.md)
5656
* [Update](clusters/aws/update.md)
5757
* [Security](clusters/aws/security.md)
@@ -63,13 +63,10 @@
6363
* [VPC peering](clusters/aws/networking/vpc-peering.md)
6464
* [Setting up kubectl](clusters/aws/kubectl.md)
6565
* [Uninstall](clusters/aws/uninstall.md)
66-
* Cortex Cloud on GCP
66+
* GCP
6767
* [Install](clusters/gcp/install.md)
6868
* [Logging](clusters/gcp/logging.md)
6969
* [Credentials](clusters/gcp/credentials.md)
7070
* [Setting up kubectl](clusters/gcp/kubectl.md)
7171
* [Uninstall](clusters/gcp/uninstall.md)
72-
* Cortex Core on Kubernetes
73-
* [Install](clusters/kubernetes/install.md)
74-
* [Uninstall](clusters/kubernetes/uninstall.md)
7572
* [Private Docker registry](clusters/registry.md)

0 commit comments

Comments
 (0)