Skip to content

Commit

Permalink
vignette
Browse files Browse the repository at this point in the history
  • Loading branch information
wlandau committed Nov 13, 2024
1 parent da957ae commit 0e66c30
Show file tree
Hide file tree
Showing 2 changed files with 4 additions and 1 deletion.
1 change: 1 addition & 0 deletions inst/WORDLIST
Original file line number Diff line number Diff line change
Expand Up @@ -24,6 +24,7 @@ Kirill's
Kirill’s
Kretch
Kubernetes
retryable
L'Ecuyer
LFS
LSF
Expand Down
4 changes: 3 additions & 1 deletion vignettes/plugins.Rmd
Original file line number Diff line number Diff line change
Expand Up @@ -100,7 +100,9 @@ launcher$call(

# Worker retries

The `launch_worker()` method can call `self$crashes(index = worker)` to get the number of consecutive times the worker has crashed (exited without completing all its tasks). You can use the crash count to assign more memory, CPU cores, or other resources to a worker launch. Here is a pseudo-code sketch which increases available memory by 4 GB each time a worker crashes, then resets back to the original 16 GB when the worker succeeds:
The `launch_worker()` method can call `self$crashes(index = worker)` to get the number of consecutive times the worker has crashed (exited without completing all its tasks). When a worker crashes, its crash count increments by 1. The next time a worker does not crash (exits only after completing all its tasks) the crash count resets back to zero.

You can use the crash count to assign more memory, CPU cores, or other resources to a worker launch. Here is a pseudo-code sketch which increases available memory by 4 GB each time a worker crashes, then resets back to the original 16 GB when the worker succeeds:

```r
launch_worker = function(call, name, launcher, worker, instance) {
Expand Down

0 comments on commit 0e66c30

Please sign in to comment.