Skip to content

Install and configure Apptainer and Nextflow #559

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 1 commit into
base: main
Choose a base branch
from
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
20 changes: 20 additions & 0 deletions ansible/extras.yml
Original file line number Diff line number Diff line change
Expand Up @@ -48,6 +48,26 @@
name: cuda
tasks_from: "{{ 'runtime.yml' if appliances_mode == 'configure' else 'install.yml' }}"

- name: Setup Apptainer
hosts: apptainer
gather_facts: yes
tags: apptainer
tasks:
- name: Install and configure Apptainer
include_role:
name: azimuth_cloud.image_utils.apptainer
tasks_from: "{{ 'configure.yml' if appliances_mode == 'configure' else 'main.yml' }}"

- name: Setup Apptainer
hosts: nextflow
gather_facts: yes
tags: nextflow
tasks:
- name: Install and configure Nextflow
include_role:
name: azimuth_cloud.image_utils.nextflow
tasks_from: "{{ 'configure.yml' if appliances_mode == 'configure' else 'main.yml' }}"

- name: Persist hostkeys across rebuilds
# Must be after filesystems.yml (for storage)
# and before portal.yml (where OOD login node hostkeys are scanned)
Expand Down
4 changes: 2 additions & 2 deletions environments/.stackhpc/tofu/cluster_image.auto.tfvars.json
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"cluster_image": {
"RL8": "openhpc-RL8-250514-1502-5a923b2c",
"RL9": "openhpc-RL9-250514-1502-5a923b2c"
"RL8": "openhpc-RL8-250204-1352-8d071ba8",
"RL9": "openhpc-RL9-250204-1432-8d071ba8"
}
}
7 changes: 7 additions & 0 deletions environments/common/inventory/group_vars/all/apptainer.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
---

# Mounting /tmp by default can break assumptions made
# by some containers used in nf-core workflows.
apptainer_config_overrides:
- directive: "mount tmp"
value: "no"
4 changes: 4 additions & 0 deletions environments/common/inventory/group_vars/all/nextflow.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
---

nextflow_skel_config: |
process.executor = 'slurm'
1 change: 0 additions & 1 deletion environments/common/inventory/group_vars/all/openhpc.yml
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,6 @@ openhpc_packages_default:
- ohpc-gnu12-openmpi4-perf-tools # for hpctests
- openblas-gnu12-ohpc # for hpctests (HPL)
# EPEL packages:
- apptainer
- podman-compose
openhpc_packages_extra: []
openhpc_packages: "{{ (openhpc_packages_default + openhpc_packages_extra) | select | list }}"
Expand Down
6 changes: 6 additions & 0 deletions environments/common/inventory/groups
Original file line number Diff line number Diff line change
Expand Up @@ -182,3 +182,9 @@ extra_packages

[gateway]
# Add builder to this group to install gateway ansible-init playbook into image

[apptainer]
# Hosts to install and configure Apptainer on

[nextflow]
# Hosts to install and configure Nextflow on
7 changes: 7 additions & 0 deletions environments/common/layouts/everything
Original file line number Diff line number Diff line change
Expand Up @@ -125,3 +125,10 @@ builder
[gateway:children]
# Add builder to this group to install gateway ansible-init playbook into image
builder

[apptainer:children]
login
compute

[nextflow:children]
login
2 changes: 1 addition & 1 deletion requirements.yml
Original file line number Diff line number Diff line change
Expand Up @@ -48,7 +48,7 @@ collections:
version: 0.4.0
- name: https://github.com/azimuth-cloud/ansible-collection-image-utils
type: git
version: 0.5.0
version: apptainer
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Update to new tag when its released.

# stackhpc.pulp has pulp.squeezer as dependency, any version, but latest
# requires newer ansible than can install
- name: pulp.squeezer
Expand Down
Loading