Skip to content

Many "Failed to delete key from cache on callback" messages #2009

Description

@rejuvenile

I see a large number of these, but my caches are big and not so heavily used, so they seem a bit out of place.

025-10-26T17:13:38.579944Z  INFO nativelink_store::existence_cache_store: Failed to delete key from cache on callback, store_key: Digest(DigestInfo("f54f8dd70fc6b2f99bac1a5ef868f454fd9619c837e2b1077f61cb100d56b5ac-197"))
at nativelink-store/src/existence_cache_store.rs:81
in nativelink_store::filesystem_store::filesystem_store_emplace_file
in nativelink_service::bytestream_server::inner_write with digest: DigestInfo("f31a04270c78a5c0313f140affb15804aa803500f8f8a53acda9af254b16ae38-87654143"), stream: WriteRequestStreamWrapper { resource_info: ResourceInfo { instance_name: ">
in nativelink_service::bytestream_server::bytestream_write
in nativelink_service::bytestream_server::write with request: Streaming
in nativelink_util::task::http_executor
in nativelink::services::http_connection with remote_addr: 192.168.191.220:64842, socket_addr: 0.0.0.0:50051

Activity

  1. MarcusSorealheis commented on Oct 27, 2025

    @MarcusSorealheis
    Member

    That's strange. @rejuvenile which version are you? I have suspicions.

    Are you using Buck2, Reclient, or Bazel?

    We will look into it this week.

  2. rejuvenile commented on Oct 27, 2025

    @rejuvenile
    Author

    Bazel 8.4.2 and Nativelink v0.7.4.

  3. MarcusSorealheis commented on Oct 30, 2025

    @MarcusSorealheis
    Member

    i'm trying to reproduce this now. I have not discovered what the cause was. It might be helpful if the two of us could get on a call @rejuvenile

  4. MarcusSorealheis commented on Oct 31, 2025

    @MarcusSorealheis
    Member

    do you have your config @rejuvenile

  5. MarcusSorealheis commented on Oct 31, 2025

    @MarcusSorealheis
    Member

    I'm taking a look at this PR to see if it is the culprit: #1947

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions