Skip to content

Commit 74028b2

Browse files
committed
flux commands
Improvement on sections and table for flux commands, and addition of flux accounting to container (likely will not easily work). Signed-off-by: vsoch <vsoch@users.noreply.github.com>
1 parent c3012c6 commit 74028b2

File tree

3 files changed

+935
-270
lines changed

3 files changed

+935
-270
lines changed

2024-RADIUSS-AWS/JupyterNotebook/README.md

Lines changed: 34 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -32,7 +32,40 @@ to build them unless you are developing or changing them.
3232

3333
If you do build (and use a different name) be sure to push your images to a public registry (or load them locally to your development cluster).
3434

35-
35+
### TODO
36+
37+
After we add the flux-accounting:
38+
- after flux resource list, to see queues available (flux queue list)
39+
40+
- more carbon copy examples
41+
- move flux batch aboe hierarchy
42+
- transition into "what if I flux batch in my flux batch" (in my interactive allocation)
43+
- yooo dawg
44+
- check out riken tutorial for example
45+
- drop the tree thing
46+
- drop the throughput thing
47+
- better way to render script in the notebook
48+
- "construct a job submission object, called a jobspec"
49+
- Python, make handle, create job description (jobspec), submit and info (monitor)
50+
- collapse json dump
51+
- add watch / track events for some job
52+
- reproduce cheese / pancakes example here
53+
- how to list jobs
54+
- hot to get output for a job
55+
- figure out way to collapse the last section
56+
- typo at top of chapter 2
57+
- do a section for flux exec? (show doing something across our "nodes"
58+
- move flux archive into main tutorial
59+
- Plumbing to Porcelain - "the toilet vs. the pipes" 💩️🚽️
60+
- squash Deep Dive into section above it
61+
- set up flux-accounting and see if it works
62+
- how to specify a bank for a job
63+
- list banks (all) - flux account view-bank --tree
64+
- specify banks - flux account view user $USER
65+
66+
- Chapter 2: Flux Plumbing 💩️🚽️
67+
- add flux job submit, show --dry-run
68+
3669
## Local Usage
3770

3871
While the tutorial here is intended for deployment on AWS or Google Cloud, you can also give it a try on your local machine with a single container! You will need to [install Docker](https://docs.docker.com/engine/install/). When you have Docker available, you can build and run the tutorial with:

2024-RADIUSS-AWS/JupyterNotebook/docker/Dockerfile.spawn

Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -79,6 +79,13 @@ RUN git clone https://github.com/flux-framework/dyad.git \
7979
COPY ./flux-tree/* /usr/libexec/flux/cmd/
8080
RUN chmod +x /usr/libexec/flux/cmd/flux-tree*
8181

82+
# Flux accounting
83+
RUN git clone https://github.com/flux-framework/flux-accounting && \
84+
cd flux-accounting && \
85+
./autogen.sh && \
86+
./configure --prefix=/usr && \
87+
make && make install
88+
8289
RUN apt-get update && apt-get install -y nodejs && apt-get clean && rm -rf /var/lib/apt/lists/*
8390

8491
RUN wget https://nodejs.org/dist/v20.15.0/node-v20.15.0-linux-x64.tar.xz && \
@@ -119,6 +126,13 @@ COPY ./docker/start.sh /start.sh
119126
RUN mkdir -p $HOME/.local/share && \
120127
chmod 777 $HOME/.local/share
121128

129+
# Quick setup of flux-accounting (not working)
130+
# RUN flux start /bin/bash -c "nohup flux account create-db && flux account-service & flux account add-bank root 1" && \
131+
# flux start flux account add-bank --parent-bank=root default 1 && \
132+
# flux start flux account add-user --username=jovyan --bank=default && \
133+
# flux start flux jobtap load mf_priority.so && \
134+
# flux start flux account-update-db
135+
122136
USER ${NB_USER}
123137

124138
CMD ["flux", "start", "--test-size=4", "jupyter", "lab"]

0 commit comments

Comments
 (0)