endpoints to get and delete minion task metadata

[klsince]

add two minion tasks related endpoints to allow GET and DELETE /tasks/{taskType}/{tableNameWithType}/metadata

Release Notes

Added 2 http endpoints for getting and deleting the minion task metadata, like the watermark of RealtimeToOfflineTask.

• GET /tasks/{taskType}/{tableNameWithType}/metadata
• DELETE /tasks/{taskType}/{tableNameWithType}/metadata

[codecov-commenter]

Codecov Report

Merging #8551 (138059e) into master (05a7f28) will decrease coverage by 45.06%.
The diff coverage is 27.29%.

❗ Current head 138059e differs from pull request most recent head 0d6edf1. Consider uploading reports for the commit 0d6edf1 to get more accurate results

@@              Coverage Diff              @@
##             master    #8551       +/-   ##
=============================================
- Coverage     70.77%   25.71%   -45.07%     
=============================================
  Files          1681     1675        -6     
  Lines         87957    87894       -63     
  Branches      13320    13314        -6     
=============================================
- Hits          62252    22599    -39653     
- Misses        21354    63135    +41781     
+ Partials       4351     2160     -2191     

Flag	Coverage Δ
integration1	?
integration2	25.71% <27.29%> (-0.20%)	⬇️
unittests1	?
unittests2	?

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
...or/BaseExponentialBackoffRetryFailureDetector.java	0.00% <0.00%> (ø)
...ker/failuredetector/ConnectionFailureDetector.java	0.00% <0.00%> (ø)
...roker/requesthandler/GrpcBrokerRequestHandler.java	78.37% <ø> (ø)
...ker/routing/instanceselector/InstanceSelector.java	100.00% <ø> (ø)
...n/function/scalar/DataTypeConversionFunctions.java	0.00% <0.00%> (ø)
...troller/api/exception/NoTaskMetadataException.java	0.00% <0.00%> (ø)
...roller/api/resources/PinotTaskRestletResource.java	0.00% <0.00%> (-2.92%)	⬇️
...a/org/apache/pinot/core/transport/QueryRouter.java	63.85% <0.00%> (-21.86%)	⬇️
...rg/apache/pinot/core/transport/ServerResponse.java	92.30% <ø> (-3.85%)	⬇️
...va/org/apache/pinot/spi/utils/BigDecimalUtils.java	0.00% <0.00%> (-100.00%)	⬇️
... and 1261 more

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 05a7f28...0d6edf1. Read the comment docs.

[mcvsubbu]

helix deletes task metadata after sometime, right ? Why provide an endpoint to delete it? Have you verified with helix that this ok? and there is no race condition?

[klsince]

Helix task framework is not aware of the task metadata here, e.g. RealtimToOfflineTask keeps a timestamp as watermark in a ZNode under /Propertystore/MINION_TASK_METADATA/ to manage its progress.