Skip to content

Commit

Permalink
Ignore incomplete jobs with reason 'quit'
Browse files Browse the repository at this point in the history
In this case the worker has been restarted within a reasonable
time (systemd had not had to kill it). This usually happens during
deployment or when the worker is restarted/stopped for other
reasons. I suppose we can ignore these incompletes.

Note that more than 50 % of the incomplete jobs on o3 within the
last 24 hours have the reason 'quit'.
  • Loading branch information
Martchus committed Feb 7, 2020
1 parent b2157e3 commit 8358f71
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion openqa-monitor-incompletes
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ host="${host:-"openqa.opensuse.org"}"
ssh_host="${ssh_host:-"$host"}"
scheme="${scheme:-"https"}"
failed_since="${failed_since:-"(NOW() - interval '24 hour')"}"
query="${query:-"select id,test from jobs where (result='incomplete' and t_finished >= $failed_since and id not in (select job_id from comments where job_id is not null));"}"
query="${query:-"select id,test from jobs where (result='incomplete' and reason!='quit' and t_finished >= $failed_since and id not in (select job_id from comments where job_id is not null));"}"
for i in $(ssh "$ssh_host" "cd /tmp; sudo -u geekotest psql --no-align --tuples-only --command=\"$query\" openqa"); do
url="$scheme://$host/tests/${i%|*}"
details="${i#*|}"
Expand Down

0 comments on commit 8358f71

Please sign in to comment.