Skip to content

[CI]: Kube failure on commit + save #4106

Closed
@apostasie

Description

@apostasie

Description

On the Kube environment, commit followed by save regularly fails as save fails to find the image that was just committed before.

Possible explanations could be:

  • commit in certain cases fails silently
  • commit is not synchronous and needs time before the image is available

Steps to reproduce the issue

No response

Describe the results you received and expected

container_commit_linux_test.go:56: 
        
        +------------------------------------------------------------------------------------------------------------+
        | ➡️      | ⚙️ /usr/local/bin/nerdctl commit 7f7746cf8c7564a54931510722958e1c93420d37abfde5873cb9a70d1d707b3 |
        |         | e testcommitsave                                                                                 |
        +------------------------------------------------------------------------------------------------------------+
        |         | 🟢 sha256:215b46f8895be6203d3ad1fae24a934591b78286b6687c60ad8a9810f4f81e31                       |
        +------------------------------------------------------------------------------------------------------------+
        |         | 🟠 time="2025-04-15T17:50:30Z" level=warning msg="Image lacks label \"nerdctl/platform\", assumi |
        |         | ng the platform to be \"linux/amd64\""                                                           |
        +------------------------------------------------------------------------------------------------------------+
        | Limit   | 3m0s                                                                                             |
        +------------------------------------------------------------------------------------------------------------+
        | Environ | HOSTNAME=nerdctl-test-control-plane                                                              |
        |         | container=docker                                                                                 |
        |         | HOME=/root                                                                                       |
        |         | TMPDIR=/root/tmp                                                                                 |
        |         | TERM=xterm                                                                                       |
        |         | NO_PROXY=                                                                                        |
        |         | SHLVL=0                                                                                          |
        |         | HTTPS_PROXY=                                                                                     |
        |         | HTTP_PROXY=                                                                                      |
        |         | KUBECONFIG=/etc/kubernetes/admin.conf                                                            |
        |         | OLDPWD=/                                                                                         |
        |         | _=/usr/local/go/bin/go                                                                           |
        |         | PATH=/usr/local/go/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin              |
        |         | ***                                                        |
        |         | DOCKER_CONFIG=/root/tmp/TestKubeCommitSave[485](https://github.com/containerd/nerdctl/actions/runs/14476010264/job/40601679904?pr=4052#step:3:486)706328/001                                          |
        |         | NERDCTL_TOML=/root/tmp/TestKubeCommitSave485706328/001/nerdctl.toml                              |
        +------------------------------------------------------------------------------------------------------------+
        
    container_commit_linux_test.go:62: 
        
        +============================================================================================================+
        | 🚀      | "TestKubeCommitSave": starting test!                                                             |
        +============================================================================================================+
        | cwd     | /root/tmp/TestKubeCommitSave485706328/001                                                        |
        +============================================================================================================+
        | config  | {                                                                                                |
        |         |   "KubeTest": "Only",                                                                            |
        |         |   "Namespace": "k8s.io",                                                                         |
        |         |   "PrivateMode": ""                                                                              |
        |         | }                                                                                                |
        +============================================================================================================+
        | data    | {                                                                                                |
        |         |   "containerID": "7f7746cf8c7564a5[493](https://github.com/containerd/nerdctl/actions/runs/14476010264/job/40601679904?pr=4052#step:3:494)1510722958e1c93420d37abfde5873cb9a70d1d707b3e"              |
        |         | }                                                                                                |
        +============================================================================================================+
        
    container_commit_linux_test.go:62: 
        
        +------------------------------------------------------------------------------------------------------------+
        | ➡️      | ⚙️ /usr/local/bin/nerdctl save testcommitsave                                                    |
        +------------------------------------------------------------------------------------------------------------+
        |         | 🚫 command returned a non-zero exit code                                                         |
        +------------------------------------------------------------------------------------------------------------+
        |         | ⚠️ 1                                                                                             |
        +------------------------------------------------------------------------------------------------------------+
        |         | 🟠 docker.io/library/testcommitsave:latest: resolving      |--------------------------- |
        |         | -----------|                                                                                     |
        |         | elapsed: 0.1 s                           total:   0.0 B (0.0 B/s)                                |
        |         |                                                                                                  |
        |         | docker.io/library/testcommitsave:latest: resolving      |------------------------------ |
        |         | --------|                                                                                        |
        |         | elapsed: 0.2 s                           total:   0.0 B (0.0 B/s)                                |
        |         |                                                                                                  |
        |         | docker.io/library/testcommitsave:latest: resolving      |------------------------------ |
        |         | --------|                                                                                        |
        |         | elapsed: 0.3 s                           total:   0.0 B (0.0 B/s)                                |
        |         |                                                                                                  |
        |         | docker.io/library/testcommitsave:latest: resolving      |------------------------------ |
        |         | --------|                                                                                        |
        |         | elapsed: 0.4 s                           total:   0.0 B (0.0 B/s)                                |
        |         |                                                                                                  |
        |         | time="2025-04-15T17:50:31Z" level=info msg="fetch failed" error="pull access denied, repository  |
        |         | does not exist or may require authorization: server message: insufficient_scope: authorization f |
        |         | ailed" host=registry-1.docker.io                                                                 |
        |         | time="2025-04-15T17:50:31Z" level=fatal msg="failed to resolve reference \"docker.io/library/tes |
        |         | tcommitsave:latest\": pull access denied, repository does not exist or may require authorization |
        |         | : server message: insufficient_scope: authorization failed"                                      |
        +------------------------------------------------------------------------------------------------------------+
        | Limit   | 3m0s                                                                                             |
        +------------------------------------------------------------------------------------------------------------+
        | Environ | HOSTNAME=nerdctl-test-control-plane                                                              |
        |         | container=docker                                                                                 |
        |         | HOME=/root                                                                                       |
        |         | TMPDIR=/root/tmp                                                                                 |
        |         | TERM=xterm                                                                                       |
        |         | NO_PROXY=                                                                                        |
        |         | SHLVL=0                                                                                          |
        |         | HTTPS_PROXY=                                                                                     |
        |         | HTTP_PROXY=                                                                                      |
        |         | KUBECONFIG=/etc/kubernetes/admin.conf                                                            |
        |         | OLDPWD=/                                                                                         |
        |         | _=/usr/local/go/bin/go                                                                           |
        |         | PATH=/usr/local/go/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin              |
        |         | ***                                                        |
        |         | DOCKER_CONFIG=/root/tmp/TestKubeCommitSave485706328/001                                          |
        |         | NERDCTL_TOML=/root/tmp/TestKubeCommitSave485706328/001/nerdctl.toml                              |
        +------------------------------------------------------------------------------------------------------------+
        
    container_commit_linux_test.go:62: 	🔗 
        
        <<<<<<<<<<<<<<<<<<<<
        	🖊️ Command should succeed
        	👀 testing:		`command returned a non-zero exit code`
        	❌ FAILED!		is `<nil>`
        >>>>>>>>>>>>>>>>>>>>

What version of nerdctl are you using?

main

Are you using a variant of nerdctl? (e.g., Rancher Desktop)

None

Host information

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    area/cie.g., CI failurebugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions