Skip to content

Commit

Permalink
demo updates
Browse files Browse the repository at this point in the history
  • Loading branch information
viragtripathi committed May 17, 2022
1 parent 73ed4bf commit e457a71
Show file tree
Hide file tree
Showing 3 changed files with 45 additions and 6 deletions.
39 changes: 37 additions & 2 deletions examples/vertica/demo/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ README.md config extlib setup_re.sh setup_vertica.sh
## Setup Vertica database (Source)
<br>Execute [setup_vertica.sh](setup_vertica.sh)</br>
```bash
demo$ ./setup_vertica.sh latest
demo$ ./setup_vertica.sh latest 5433
```

## Setup Redis Enterprise cluster, databases and RedisInsight in docker (Target)
Expand Down Expand Up @@ -84,4 +84,39 @@ start: init Redis Connect Instance (Cluster Member)
```

</p>
</details>
</details>

**Open browser to access Swagger UI -** [http://localhost:8282/swagger-ui/index.html]()
<br>_For quick start, use '**cdc_job**' as **jobName**_
<br><br><img src="/images/Redis Connect Swagger Front Page.jpg" style="float: right;" width = 700px height = 425px/>

**Create Job Configuration** - `/connect/api/vi/job/config/{jobName}`
<br>_For quick start, use the sample `cdc-job.json` configuration:_ <a href="/examples/vertica/demo/config/samples/payloads/cdc-job.json">Vertica</a>
<br><br><img src="/images/Redis Connect Save Job Config.png" style="float: right;" width = 700px height = 375px/>
<br>

**Or Use `curl` to create the `cdc-job` configuration** <br>
`demo$ curl -v -X POST "http://localhost:8282/connect/api/v1/job/config/cdc-job" -H "accept: */*" -H "Content-Type: multipart/form-data" -F "file=@config/samples/payloads/cdc-job.json;type=application/json"`

-------------------------------

### Initial Loader Step

**Start Job -** `/connect/api/vi/job/transition/start/{jobName}/{jobType}`
<br>Use '**load**' as _**jobType**_
<br><br><img src="/images/Redis Connect Start Job.png" style="float: right;" width = 700px height = 375px/>

**Or Use `curl` to start the initial load for `cdc-job`** <br>
`demo$ curl -X POST "http://localhost:8282/connect/api/v1/job/transition/start/cdc-job/load" -H "accept: */*"`

<details><summary><b>Query for the above inserted record in Redis (target)</b></summary>
<p>

```bash
demo$ sudo docker exec -it re-node1 bash -c 'redis-cli -p 12000 ft.search idx:emp "@employee_key:[1 10]"'

demo$ sudo docker exec -it re-node1 bash -c 'redis-cli -p 12000 ft.search idx:cust "@customer_key:[1 10]"'
```

</p>
</details>
4 changes: 3 additions & 1 deletion examples/vertica/demo/setup_re.sh
Original file line number Diff line number Diff line change
Expand Up @@ -62,8 +62,10 @@ echo $timeseries_semantic_version

echo "Creating idx:emp index for search.."
sleep 10
sudo docker exec -it re-node1 bash -c "/opt/redislabs/bin/redis-cli -p 12000 ft.create idx:emp on hash prefix 1 'emp:' schema EmpNum numeric sortable FName text sortable LName text Job tag sortable Manager numeric HireDate text Salary numeric Commission numeric Department numeric"
sudo docker exec -it re-node1 bash -c "/opt/redislabs/bin/redis-cli -p 12000 ft.create idx:emp on hash prefix 1 'employee_dimension:' schema employee_key numeric sortable"
sudo docker exec -it re-node1 bash -c "/opt/redislabs/bin/redis-cli -p 12000 ft.create idx:cust on hash prefix 1 'customer_dimension:' schema customer_key numeric sortable"
sudo docker exec -it re-node1 bash -c "/opt/redislabs/bin/redis-cli -p 12000 ft.info idx:emp"
sudo docker exec -it re-node1 bash -c "/opt/redislabs/bin/redis-cli -p 12000 ft.info idx:cust"
echo "Database port mappings per node. We are using mDNS so use the IP and exposed port to connect to the databases."
echo "node1:"
sudo docker port re-node1 | egrep "12000|12001"
Expand Down
8 changes: 5 additions & 3 deletions examples/vertica/demo/setup_vertica.sh
Original file line number Diff line number Diff line change
@@ -1,11 +1,13 @@
#!/bin/bash

version="$1"
db_port="$2"
db_user=redisconnect
db_pwd=Redis123
[[ -z "$version" ]] && { echo "Error: Missing docker version tag e.g. 11.1.0-0, latest"; exit 1; }
[[ -z "$db_port" ]] && { echo "Error: Missing database port e.g. 5433"; exit 1; }

container_name="vertica-$(hostname)"
container_name="vertica-$(hostname)-$db_port"
# delete the existing container if it exist
sudo docker kill $container_name;sudo docker rm $container_name;

Expand All @@ -16,12 +18,12 @@ sudo chmod a+w -R $(pwd)/$container_name/data

echo "Creating $container_name docker container."
sudo docker run --name $container_name \
-p 5433:5433 \
-p $db_port:5433 \
-e APP_DB_USER=$db_user \
-e APP_DB_PASSWORD=$db_pwd \
-e VERTICA_DB_NAME="RedisConnect" \
-v $(pwd)/$container_name/data:/data \
-d vertica/vertica-ce:$version
-d vertica/vertica-ce:$version

while ! nc -vz $(sudo docker inspect --format='{{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}}' $container_name) 5433 < /dev/null
do
Expand Down

0 comments on commit e457a71

Please sign in to comment.