Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] TestFuseOperationFailureMetrics fails on ARM64 #1168

Closed
sondavidb opened this issue Apr 9, 2024 · 1 comment
Closed

[Bug] TestFuseOperationFailureMetrics fails on ARM64 #1168

sondavidb opened this issue Apr 9, 2024 · 1 comment
Labels
bug Something isn't working

Comments

@sondavidb
Copy link
Contributor

Description

Seeing some pretty consistent failures on ARM64 machines for TestFuseOperationFailureMetrics/image_with_valid-formatted_but_invalid-data_ztocs_causes_a_fuse_failure.

{"level":"debug","msg":"FUSE operation","operation":"node.Lookup","path":"var/lib","time":"2024-04-08T23:32:54.407861163Z"}
{"level":"debug","msg":"FUSE operation","operation":"node.Lookup","path":"var/lib","time":"2024-04-08T23:32:54.408042352Z"}
time="2024-04-08T23:32:54Z" level=fatal msg="failed to copy xattrs: failed to list xattrs on /tmp/initialA0000000000/var/lib/rabbitmq: operation not supported"

Will look into trying to root-cause this.

Steps to reproduce the bug

Run GO_TEST_FLAGS="-run TestFuseOperationFailureMetrics" make integration.

The last test (image_with_valid-formatted_but_invalid-data_ztocs_causes_a_fuse_failure) will fail.

Describe the results you expected

Tests pass

Host information

  1. OS: Ubuntu 22.04 ARM64
  2. Snapshotter Version: tip of main (ee1b7c2528b9b72a315966b9dd23e23b97c6b37f)
  3. Containerd Version: 1.6.30

Any additional context or information about the bug

No response

@sondavidb
Copy link
Contributor Author

We root-caused this to #1314. TL;DR disabling xattrs on a volume-mounted layer will cause the container to not create, which is what was happening in the pinnedRabbitmqImage. This is an issue because of #1133, which disables xattrs automatically on layers that don't have xattrs or whiteout/opaque dirs.

We reverted that change, which fixed this issue, so we can close this now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant