Skip to content
This repository has been archived by the owner on Apr 26, 2024. It is now read-only.

received_transactions table can accumulate millions of records despite being cleared monthly #6437

Open
turt2live opened this issue Nov 28, 2019 · 6 comments
Labels
A-Disk-Space things which fill up the disk T-Enhancement New features, changes in functionality, improvements in performance, or user-facing enhancements. z-bug (Deprecated Label)

Comments

@turt2live
Copy link
Member

Are there any side effects to just clearing it weekly instead? Mine has 21.6 million records in it, accumulating to about 24 GB of space.

@turt2live turt2live added z-bug (Deprecated Label) A-Disk-Space things which fill up the disk labels Nov 28, 2019
@turt2live
Copy link
Member Author

also the index on this table feels way too slow, but that's probably a function of the number of records.

@richvdh
Copy link
Member

richvdh commented Nov 29, 2019

daily, even

@richvdh
Copy link
Member

richvdh commented Nov 29, 2019

also the index on this table feels way too slow

I think postgres does not handle a large churn of rows particularly well.

@turt2live
Copy link
Member Author

it sounds like it's relatively safe to clear this more often then? I think the largest side effect is if a server decides to send you the same transaction twice you'll waste some CPU time realizing that you've already processed it? That also shouldn't happen after 24+ hours though...

@turt2live
Copy link
Member Author

also the index on this table feels way too slow, but that's probably a function of the number of records.

This was actually because the index on that table was corrupted. The table is now at 31gb.

@Routhinator
Copy link

also the index on this table feels way too slow

I think postgres does not handle a large churn of rows particularly well.

If this truncate was run nightly and then a reindex of the table was called, with a vaccum afterwards, it would be fine.

@reivilibre reivilibre added the T-Enhancement New features, changes in functionality, improvements in performance, or user-facing enhancements. label May 23, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
A-Disk-Space things which fill up the disk T-Enhancement New features, changes in functionality, improvements in performance, or user-facing enhancements. z-bug (Deprecated Label)
Projects
None yet
Development

No branches or pull requests

4 participants