Skip to content

Commit

Permalink
Add tutorial on docker persistence (airbytehq#1276)
Browse files Browse the repository at this point in the history
* Give names to docker volumes used in airbyte

* Add tutorial on config persistence (airbytehq#993 and airbytehq#994)

* Include output results in markdown file

* Update outputs of notebook

* Update docs

* Update workspace numbers

* Tweaks from review
  • Loading branch information
ChristopheDuong authored Dec 11, 2020
1 parent f51c7a7 commit b9bc9c8
Show file tree
Hide file tree
Showing 11 changed files with 1,434 additions and 1 deletion.
4 changes: 3 additions & 1 deletion .env
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,9 @@ DATABASE_PASSWORD=docker
DATABASE_DB=airbyte
CONFIG_ROOT=/data
WORKSPACE_ROOT=/tmp/workspace
WORKSPACE_DOCKER_MOUNT=workspace
DATA_DOCKER_MOUNT=airbyte_data
DB_DOCKER_MOUNT=airbyte_db
WORKSPACE_DOCKER_MOUNT=airbyte_workspace
# todo (cgardens) - when we are mount raw directories instead of named volumes, *_DOCKER_MOUNT must
# be the same as *_ROOT.
# Issue: https://github.com/airbytehq/airbyte/issues/578
Expand Down
1 change: 1 addition & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -14,6 +14,7 @@ __pycache__
.eggs
.venv
.mypy_cache
.ipynb_checkpoints

# dbt
profiles.yml
2 changes: 2 additions & 0 deletions docker-compose.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -95,4 +95,6 @@ volumes:
workspace:
name: ${WORKSPACE_DOCKER_MOUNT}
data:
name: ${DATA_DOCKER_MOUNT}
db:
name: ${DB_DOCKER_MOUNT}
911 changes: 911 additions & 0 deletions docs/tutorial/airbyte_config_persistence.ipynb

Large diffs are not rendered by default.

517 changes: 517 additions & 0 deletions docs/tutorial/airbyte_config_persistence.md

Large diffs are not rendered by default.

Binary file added docs/tutorial/airbyte_config_persistence_1.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/tutorial/airbyte_config_persistence_2.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/tutorial/airbyte_config_persistence_3.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/tutorial/airbyte_config_persistence_4.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/tutorial/airbyte_config_persistence_5.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/tutorial/airbyte_config_persistence_6.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

0 comments on commit b9bc9c8

Please sign in to comment.