Skip to content

[Feature] Add ability to schedule a datasource ingestion job  #8

@mawandm

Description

@mawandm

Currently all ingestion jobs run on the same schedule. This isn't practical as some document repositories might be expensive to access and or are not updated frequently and it doesn't scale.

This feature introduces the ability to schedule an ingestion job at a regular interval. The schedule should be expressible in a unix cron format.

Acceptance Criteria

  1. An endpoint for scheduling. This will be /v1/tasks. It should accept POST, PUT, GET, DELETE
  2. Introduce RBAC policy to allow for creating tasks. The RBAC resource id is in the format tasks/*

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions