Skip to content

DTLE:use mapping job.json failed when test increment , the job is 'complete' #447

Closed
@yaqigithub

Description

@yaqigithub

Description
when test increment,execute mapping job.json ,the job is invalid and the job status is 'complete' .

Steps to reproduce the issue:
1.create three null schema in Src
create database test1;
create database test2;
create database test3;
2. create user in mysql_1 ,mysql-2
create user 'test1'@'%' identified by 'test1';
grant all privileges on *.* to test1@'%';
create user 'test2'@'%' identified by 'test2';
grant all privileges on *.* to test2@'%';
3. execute the job.json
curl -H "Accept:application/json" -XPOST "http://10.186.62.12:9190/v1/jobs" -d @job4.json -s | jq
curl -H "Accept:application/json" -XPOST "http://10.186.62.12:9190/v1/jobs" -d @newtest.json -s | jq
3. View the job status
curl -XGET "10.186.62.12:9190/v1/jobs" -s | jq '.[] | .ID, .Status'

Describe the results you received:
job4.json is normal ,the mapping job newtest.json is 'complete'
image

Describe the results you expected:
the mapping job newtest.json is 'running'
Output of ./dtle version:

Dtle 9.9.9.9 (git: master 41b2d5b60f82d38f616436f90806420ed4805eb8)

Additional information you deem important (e.g. issue happens only occasionally):

Additional details (log, config, job config etc):

  1. job.json
    job4.json.txt
    newtest.json.txt

2019/05/22 11:14:58.833291 [ERR] [jobid:309d4597-daf6-3a6d-811e-1ffeadd9ccd2] mysql.reader error GetEvent. err: Sync was closed 
2019/05/22 11:14:58.833488 [INFO] [jobid:309d4597-daf6-3a6d-811e-1ffeadd9ccd2] mysql.extractor: Shutting down 
2019/05/22 11:14:58.833507 [DEBUG] setState killTask 2 
2019/05/22 11:14:58.833518 [DEBUG] setState.SaveState 
2019/05/22 11:14:58.833668 [DEBUG] Worker.SaveState: lock: 0xc00065d110, 0xc000aa5fc0 
2019/05/22 11:14:58.833678 [DEBUG] Worker.SaveState: after lock: 0xc00065d110 
2019/05/22 11:14:58.833688 [DEBUG] Worker.SaveState: after unlock: 0xc00065d110 
2019/05/22 11:14:58.833695 [DEBUG] updater 
2019/05/22 11:16:23.236009 [DEBUG] http: Request /v1/jobs (3.212023ms) 
2019/05/22 11:16:23.236105 [DEBUG] worker: Dequeued evaluation 44e6950b-1967-1347-c8d2-79fe7da1bae3 
2019/05/22 11:16:23.236238 [DEBUG] sched: <Eval '44e6950b-1967-1347-c8d2-79fe7da1bae3' JobID: '0da0d066-88ee-f534-4c4c-930f650c35fd'>: allocs: (p
lace 2) (update 0) (migrate 0) (resume 0) (pause 0) (stop 0) (ignore 0) (lost 0) 
2019/05/22 11:16:23.236288 [ERR] sched: <Eval '44e6950b-1967-1347-c8d2-79fe7da1bae3' JobID: '0da0d066-88ee-f534-4c4c-930f650c35fd'>: sched: Can't
 find preferred node e6dc47c3-cc58-545f-dd62-9952bf9e1a7e 
2019/05/22 11:16:23.236368 [DEBUG] worker: nack for evaluation 44e6950b-1967-1347-c8d2-79fe7da1bae3 
2019/05/22 11:16:23.236419 [DEBUG] worker: Dequeued evaluation 44e6950b-1967-1347-c8d2-79fe7da1bae3 
2019/05/22 11:16:23.236452 [DEBUG] sched: <Eval '44e6950b-1967-1347-c8d2-79fe7da1bae3' JobID: '0da0d066-88ee-f534-4c4c-930f650c35fd'>: allocs: (p
lace 2) (update 0) (migrate 0) (resume 0) (pause 0) (stop 0) (ignore 0) (lost 0) 
2019/05/22 11:16:23.236474 [ERR] sched: <Eval '44e6950b-1967-1347-c8d2-79fe7da1bae3' JobID: '0da0d066-88ee-f534-4c4c-930f650c35fd'>: sched: Can't
 find preferred node e6dc47c3-cc58-545f-dd62-9952bf9e1a7e 
2019/05/22 11:16:23.236500 [DEBUG] worker: nack for evaluation 44e6950b-1967-1347-c8d2-79fe7da1bae3 
2019/05/22 11:16:23.236531 [DEBUG] worker: Dequeued evaluation 44e6950b-1967-1347-c8d2-79fe7da1bae3 
2019/05/22 11:16:23.236557 [DEBUG] sched: <Eval '44e6950b-1967-1347-c8d2-79fe7da1bae3' JobID: '0da0d066-88ee-f534-4c4c-930f650c35fd'>: allocs: (p
lace 2) (update 0) (migrate 0) (resume 0) (pause 0) (stop 0) (ignore 0) (lost 0) 
2019/05/22 11:16:23.236571 [ERR] sched: <Eval '44e6950b-1967-1347-c8d2-79fe7da1bae3' JobID: '0da0d066-88ee-f534-4c4c-930f650c35fd'>: sched: Can't
 find preferred node e6dc47c3-cc58-545f-dd62-9952bf9e1a7e 


Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions