Task concurrency

Task concurrency

By default, sortingview will run 4 tasks at a time of various types. That is, it will calculate 4 correlograms at a time in parallel, 4 average waveforms in parallel, etc. To override the defaults, create a .yaml file somewhere on your computer and set the SORTINGVIEW_JOB_HANDLER_CONFIG environment variable to the full path of that file prior to running the backend.

export SORTINGVIEW_JOB_HANDLER_CONFIG=<path-to-yaml-file>

Example contents of this configuration file (which could be named sortingview.yaml):

job_handlers:
  clusters:
    params:
      num_workers: 4
    type: parallel
  correlograms:
    params:
      num_workers: 4
    type: parallel
  extract_snippets:
    params:
      num_workers: 4
    type: parallel
  metrics:
    params:
      num_workers: 4
    type: parallel
  misc:
    params:
      num_workers: 4
    type: parallel
  timeseries:
    params:
      num_workers: 4
    type: parallel
  waveforms:
    params:
      num_workers: 4
    type: parallel