Skip to content

design: consider partitions as a separate abstraction from queues #6567

Open
@garlick

Description

@garlick

As noted in #5240, partitions may be a useful abstraction, distinct from queues.

My thought is that a Flux partition would be defined so that it implies a scheduler instance operating on a non-overlapping resource subset.

We don't currently allow there to be more than one scheduler so that would require changes to

@grondo brought up in #5240 (quoting loosely):

  • how partitions and queues would work together (many of our current use cases for queues would probably be served better by partitions)
  • how would partitions would be reflected in tools output, etc.
  • it might be nice to think about how we could do better with partitions and make them dynamic (e.g. move resources around at runtime instead of requiring sysadmins to write a config file, commit it to version control, distribute it to all nodes, reconfigure and reload modules)

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions