You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
Today, Parquet queryable shard cache caches Parquet file shard inmemory. It is a simple LRU cache where eviction is based on a configured cache size on number of cached items only.
As an inmemory cache, it doesn't support TTL so cached parquet shard is never cleaned up and stays in memory forever if never getting evicted.
Describe the solution you'd like
Add TTL for each parquet cache shard and record last access time. Remove the cached shard if idle more than TTL time.