Currently loads the following data:
Table | Contains |
---|---|
users |
Items of the users model |
The official verified source has a few drawbacks:
- on usage of the verified source, a copy of the current state of
the
dlt-hub/verified-sources
repository is copied into your project; Once you make changes to it, it effectively becomes a fork, making it hard to update after the fact. - This makes use of a preexisting client implementation
Create a .dlt/secrets.toml
with your API token
(see dlt_source_slack/manifest.yml
for a Slack
app manifest that has the necessary credentials):
slack_bot_token = "xoxb-..."
and then run the default source with optional list references:
from dlt_source_slack import source as slack_source
pipeline = dlt.pipeline(
pipeline_name="slack_pipeline",
destination="duckdb",
dev_mode=True,
)
slack_data = slack_source()
pipeline.run(slack_data)
This project is using devenv.
Commands:
Command | What does it do? |
---|---|
format |
Formats & lints all code |
sample-pipeline-run |
Runs the sample pipeline. |
sample-pipeline-show |
Starts the streamlit-based dlt hub |
SLACK_BOT_TOKEN=[xoxb-...] \
sample-pipeline-run
alternatively you can also create a .dlt/secrets.toml
(excluded from git) with the following content:
slack_bot_token = "xoxb-..."