Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Integration tests failing intermittently in GH runners #304

Open
i-chvets opened this issue Sep 18, 2023 · 0 comments
Open

Integration tests failing intermittently in GH runners #304

i-chvets opened this issue Sep 18, 2023 · 0 comments
Labels
bug Something isn't working

Comments

@i-chvets
Copy link
Contributor

i-chvets commented Sep 18, 2023

Bug Description

When executing integration tests bundle tests fail intermittently.

  • In one case failure was due to admission-webhook failure. See relevent logs secion for more details

Failed run:
https://github.com/canonical/notebook-operators/actions/runs/6221726919/job/16884245612

Successful run:
https://github.com/canonical/notebook-operators/actions/runs/6221726919

After re-run of on pull request CI integration test are passing.

To Reproduce

Trigger pull request workflow.

Environment

GH runners

Relevant log output

# admission-webhook failed to deploy
unit-admission-webhook-0: 11:45:47 ERROR unit.admission-webhook/0.juju-log Traceback (most recent call last):
  File "/var/lib/juju/agents/unit-admission-webhook-0/charm/venv/charmed_kubeflow_chisme/pebble/_update_layer.py", line 31, in update_layer
    container.replan()
  File "/var/lib/juju/agents/unit-admission-webhook-0/charm/venv/ops/model.py", line 1915, in replan
    self._pebble.replan_services()
  File "/var/lib/juju/agents/unit-admission-webhook-0/charm/venv/ops/pebble.py", line 1680, in replan_services
    return self._services_action('replan', [], timeout, delay)
  File "/var/lib/juju/agents/unit-admission-webhook-0/charm/venv/ops/pebble.py", line 1761, in _services_action
    raise ChangeError(change.err, change)
ops.pebble.ChangeError: cannot perform the following tasks:
- Start service "admission-webhook" (cannot start service: exited quickly with code 255)
----- Logs from task 0 -----
2023-09-18T11:45:47Z INFO Most recent service output:
    F0918 11:45:47.428138      13 config.go:46] config=main.Config{CertFile:"/etc/webhook/certs/cert.pem", KeyFile:"/etc/webhook/certs/key.pem"} Error: open /etc/webhook/certs/cert.pem: no such file or directory
2023-09-18T11:45:47Z ERROR cannot start service: exited quickly with code 255
-----
unit-admission-webhook-0: 11:45:47 ERROR unit.admission-webhook/0.juju-log Failed to handle <ConfigChangedEvent via AdmissionWebhookCharm/on/config_changed[11]> with error: Failed to replan

Additional context

No response

@i-chvets i-chvets added the bug Something isn't working label Sep 18, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
Status: Labeled
Development

No branches or pull requests

1 participant