Add documentation to canary and improvements

[longquanzheng]

What changed?
Add documentation to canary and improvements

Why?
For #4444

How did you test it?
local test:
start worker:

./cadence-canary start

Then start test case

cadence --do cadence-canary workflow start --et 10 --wt workflow.echo --tl canary-task-queue -i 0

and

cadence --do cadence-canary workflow start --et 10 --wt workflow.sanity --tl canary-task-queue -i 0

 $cadence --do cadence-canary workflow start --et 1200 --wt workflow.sanity --tl canary-task-queue -i 0
Started Workflow Id: fea35633-dc5f-482e-9751-75d42b00b0da, run Id: 7baa98da-44c2-42d3-8627-7a0b4c38b0ed
qlong@~/cadence:
(canary-imp) $cadence --do cadence-canary workflow ob -w fea35633-dc5f-482e-9751-75d42b00b0da
Progress:
  1, 2021-09-02T14:06:58-07:00, WorkflowExecutionStarted
  2, 2021-09-02T14:06:58-07:00, DecisionTaskScheduled
  3, 2021-09-02T14:06:58-07:00, DecisionTaskStarted
  4, 2021-09-02T14:06:58-07:00, DecisionTaskCompleted
  5, 2021-09-02T14:06:58-07:00, MarkerRecorded
  6, 2021-09-02T14:06:58-07:00, UpsertWorkflowSearchAttributes
  7, 2021-09-02T14:06:58-07:00, MarkerRecorded
  8, 2021-09-02T14:06:58-07:00, StartChildWorkflowExecutionInitiated
  9, 2021-09-02T14:06:58-07:00, StartChildWorkflowExecutionInitiated
  10, 2021-09-02T14:06:58-07:00, StartChildWorkflowExecutionInitiated
  11, 2021-09-02T14:06:58-07:00, StartChildWorkflowExecutionInitiated
  12, 2021-09-02T14:06:58-07:00, StartChildWorkflowExecutionInitiated
  13, 2021-09-02T14:06:58-07:00, StartChildWorkflowExecutionInitiated
  14, 2021-09-02T14:06:58-07:00, StartChildWorkflowExecutionInitiated
  15, 2021-09-02T14:06:58-07:00, StartChildWorkflowExecutionInitiated
  16, 2021-09-02T14:06:58-07:00, StartChildWorkflowExecutionInitiated
  17, 2021-09-02T14:06:58-07:00, StartChildWorkflowExecutionInitiated
  18, 2021-09-02T14:06:58-07:00, StartChildWorkflowExecutionInitiated
  19, 2021-09-02T14:06:58-07:00, ChildWorkflowExecutionStarted
  20, 2021-09-02T14:06:58-07:00, DecisionTaskScheduled
  21, 2021-09-02T14:06:58-07:00, ChildWorkflowExecutionStarted
  22, 2021-09-02T14:06:58-07:00, ChildWorkflowExecutionStarted
  23, 2021-09-02T14:06:58-07:00, ChildWorkflowExecutionStarted
  24, 2021-09-02T14:06:58-07:00, ChildWorkflowExecutionStarted
  25, 2021-09-02T14:06:58-07:00, ChildWorkflowExecutionStarted
  26, 2021-09-02T14:06:58-07:00, ChildWorkflowExecutionStarted
  27, 2021-09-02T14:06:59-07:00, ChildWorkflowExecutionStarted
  28, 2021-09-02T14:06:59-07:00, ChildWorkflowExecutionStarted
  29, 2021-09-02T14:06:59-07:00, ChildWorkflowExecutionStarted
  30, 2021-09-02T14:06:59-07:00, ChildWorkflowExecutionStarted
  31, 2021-09-02T14:06:59-07:00, ChildWorkflowExecutionCompleted
  32, 2021-09-02T14:06:59-07:00, DecisionTaskStarted
  33, 2021-09-02T14:06:59-07:00, DecisionTaskCompleted
  34, 2021-09-02T14:06:59-07:00, ChildWorkflowExecutionCompleted
  35, 2021-09-02T14:06:59-07:00, DecisionTaskScheduled
  36, 2021-09-02T14:06:59-07:00, DecisionTaskStarted
  37, 2021-09-02T14:06:59-07:00, DecisionTaskCompleted
  38, 2021-09-02T14:06:59-07:00, ChildWorkflowExecutionCompleted
  39, 2021-09-02T14:06:59-07:00, DecisionTaskScheduled
  40, 2021-09-02T14:06:59-07:00, DecisionTaskStarted
  41, 2021-09-02T14:06:59-07:00, DecisionTaskCompleted
  42, 2021-09-02T14:07:00-07:00, ChildWorkflowExecutionCompleted
  43, 2021-09-02T14:07:00-07:00, DecisionTaskScheduled
  44, 2021-09-02T14:07:00-07:00, DecisionTaskStarted
  45, 2021-09-02T14:07:00-07:00, DecisionTaskCompleted
  46, 2021-09-02T14:07:00-07:00, ChildWorkflowExecutionCompleted
  47, 2021-09-02T14:07:00-07:00, DecisionTaskScheduled
  48, 2021-09-02T14:07:00-07:00, DecisionTaskStarted
  49, 2021-09-02T14:07:00-07:00, DecisionTaskCompleted
  50, 2021-09-02T14:07:01-07:00, ChildWorkflowExecutionCompleted
  51, 2021-09-02T14:07:01-07:00, DecisionTaskScheduled
  52, 2021-09-02T14:07:01-07:00, DecisionTaskStarted
  53, 2021-09-02T14:07:01-07:00, DecisionTaskCompleted
  54, 2021-09-02T14:07:01-07:00, ChildWorkflowExecutionCompleted
  55, 2021-09-02T14:07:01-07:00, DecisionTaskScheduled
  56, 2021-09-02T14:07:01-07:00, DecisionTaskStarted
  57, 2021-09-02T14:07:01-07:00, DecisionTaskCompleted
  58, 2021-09-02T14:07:02-07:00, ChildWorkflowExecutionCompleted
  59, 2021-09-02T14:07:02-07:00, DecisionTaskScheduled
  60, 2021-09-02T14:07:02-07:00, DecisionTaskStarted
  61, 2021-09-02T14:07:02-07:00, DecisionTaskCompleted
  62, 2021-09-02T14:07:05-07:00, ChildWorkflowExecutionCompleted
  63, 2021-09-02T14:07:05-07:00, DecisionTaskScheduled
  64, 2021-09-02T14:07:05-07:00, DecisionTaskStarted
  65, 2021-09-02T14:07:05-07:00, DecisionTaskCompleted
  66, 2021-09-02T14:07:29-07:00, ChildWorkflowExecutionCompleted
  67, 2021-09-02T14:07:29-07:00, DecisionTaskScheduled
  68, 2021-09-02T14:07:29-07:00, DecisionTaskStarted
  69, 2021-09-02T14:07:29-07:00, DecisionTaskCompleted
  70, 2021-09-02T14:08:01-07:00, ChildWorkflowExecutionCompleted
  71, 2021-09-02T14:08:01-07:00, DecisionTaskScheduled
  72, 2021-09-02T14:08:01-07:00, DecisionTaskStarted
  73, 2021-09-02T14:08:01-07:00, DecisionTaskCompleted
  74, 2021-09-02T14:08:01-07:00, WorkflowExecutionCompleted

Result:
  Run Time: 54 seconds
  Status: COMPLETED
  Output:

Potential risks

Release notes

Documentation Changes

[coveralls]

Pull Request Test Coverage Report for Build 754bb119-f84a-431b-8f74-7bd83c3b1763

• 0 of 0 changed or added relevant lines in 0 files are covered.
• 15 unchanged lines in 6 files lost coverage.
• Overall coverage increased (+0.06%) to 56.476%

---

Files with Coverage Reduction	New Missed Lines	%
common/task/weightedRoundRobinTaskScheduler.go	2	89.64%
service/history/queue/timer_queue_processor.go	2	59.33%
service/history/task/transfer_standby_task_executor.go	2	90.85%
service/matching/matcher.go	2	91.46%
service/matching/taskListManager.go	2	74.09%
common/task/fifoTaskScheduler.go	5	84.54%

Totals
Change from base Build 68f6408c-4c2b-464f-b348-fa8130402d23:	0.06%
Covered Lines:	79922
Relevant Lines:	141515

---

💛 - Coveralls