Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rework service tasks #3062

Open
mtitov opened this issue Oct 11, 2023 · 2 comments
Open

Rework service tasks #3062

mtitov opened this issue Oct 11, 2023 · 2 comments

Comments

@mtitov
Copy link
Contributor

mtitov commented Oct 11, 2023

Based on Andre's proposal

After discussion we plan to implement the following schema

  • services are defined as normal RP tasks (special task type though)
  • service tasks are tagged to a specific pilot instance by setting the pilot field in the TD
  • they are submitted via the tmgr
  • we introduce a new control message which signals the event that a service task is ready (which implies it has reached AGENT_EXECUTING state. That message type will have the fwd flag set by default
  • the tmgr will collect those events and will issue ready-callbacks which are definable on service task types

#3006 (comment)

@mtitov
Copy link
Contributor Author

mtitov commented Oct 11, 2023

Should be considered #2899 - approach is to use tags (exclusive per node)

@andre-merzky
Copy link
Member

After this set of PRs is merged, we will consider the following branches for PRs/merges to progress on service tasks and related matters:

  • feature/nodb_and_tracer
  • feature/sched_reconfig
  • feature/service_startup
  • feature/zmq_events
  • fix/scheduler

These branches all improve the agent service management, profiling (including tapping into the profiling by those services), and adaptive task scheduling (the scheduler also tapping into the profiles and/or getting data from agent services).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants