Skip to content

Commit

Permalink
Merge pull request #36 from nextstrain/ingest-nextstrain-automation
Browse files Browse the repository at this point in the history
ingest/build-configs/nextstrain-automation: Add README
  • Loading branch information
joverlee521 authored Mar 14, 2024
2 parents a3d692b + dc9af57 commit 6e494b9
Showing 1 changed file with 38 additions and 0 deletions.
38 changes: 38 additions & 0 deletions ingest/build-configs/nextstrain-automation/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,38 @@
# Nextstrain automation

> [!NOTE]
> External users can ignore this directory!
> This build config/customization is tailored for the internal Nextstrain team
> to extend the core ingest workflow for automated workflows.
## Update the config

Update the [config.yaml](config.yaml) for your pathogen:

1. Edit the `s3_dst` param to add the pathogen repository name.
2. Edit the `files_to_upload` param to a mapping of files you need to upload for your pathogen.
The default includes suggested files for uploading curated data and Nextclade outputs.

## Run the workflow

Provide the additional config file to the Snakemake options in order to
include the custom rules from [upload.smk](upload.smk) in the workflow.
Specify the `upload_all` target in order to run the additional upload rules.

The upload rules will require AWS credentials for a user that has permissions
to upload to the Nextstrain data bucket.

The customized workflow can be run from the top level pathogen repo directory with:
```
nextstrain build \
--env AWS_ACCESS_KEY_ID \
--env AWS_SECRET_ACCESS_KEY \
ingest \
upload_all \
--configfile build-configs/nextstrain-automation/config.yaml
```

## Automated GitHub Action workflows

Additional instructions on how to use this with the shared `pathogen-repo-build`
GitHub Action workflow to come!

0 comments on commit 6e494b9

Please sign in to comment.