Skip to content

Fix: Evict unused parquet file after exporting cache data#290

Merged
kokokuo merged 1 commit into
developfrom
feature/evict-expired-parquet-files
Aug 30, 2023
Merged

Fix: Evict unused parquet file after exporting cache data#290
kokokuo merged 1 commit into
developfrom
feature/evict-expired-parquet-files

Conversation

@onlyjackfrost
Copy link
Copy Markdown
Contributor

@onlyjackfrost onlyjackfrost commented Aug 29, 2023

Description

Remove the dormant Parquet files to free up hardware storage as these files are no longer required.

Test

Using playground to test, under the tmp/artist-artist/canner/lineitem folder, the elder parquet files were evict after exporting data successfully.
image

@vercel
Copy link
Copy Markdown

vercel Bot commented Aug 29, 2023

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
vulcan-sql-document ✅ Ready (Inspect) Visit Preview 💬 Add feedback Aug 29, 2023 6:57am

@codecov-commenter
Copy link
Copy Markdown

codecov-commenter commented Aug 29, 2023

Codecov Report

Patch coverage is 100.00% of modified lines.

❗ Your organization is not using the GitHub App Integration. As a result you may experience degraded service beginning May 15th. Please install the Github App Integration for your organization. Read more.

Files Changed Coverage
...kages/core/src/lib/cache-layer/cacheLayerLoader.ts 100.00%

📢 Thoughts on this report? Let us know!.

Copy link
Copy Markdown
Contributor

@kokokuo kokokuo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Perfect ! LGTM 👍

@kokokuo kokokuo merged commit c60ab59 into develop Aug 30, 2023
@kokokuo kokokuo deleted the feature/evict-expired-parquet-files branch August 30, 2023 07:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants