feat(propdefs-v2): inline batch writes when any batch bucket is full

[eli-r-ph]

Problem

Seeing some problems with v2 batch writes in prod-us at high event volume, even using larger batches, with the internal queue backing up. I think this is a result of passing along all the batches to tokio::spawn before awaiting any handles to complete.

Changes

• Inline writes of any full batches in the batching loop

Just to see how it behaves in next deploy test. Next thing to try: inline all (most?) batch writes in the main thread.

Does this work well for both Cloud and self-hosted?

Yes

How did you test this code?

Locally and in CI; once merged, in deploy test and observation

[greptile-apps]

PR Summary

This PR updates the v2 batch ingestion logic to perform inline flushes of full batch buckets during the update loop, aiming to reduce internal queue buildup under high load.

• Inline full batch writes immediately in rust/property-defs-rs/src/v2_batch_ingestion.rs instead of deferring with tokio::spawn.
• Maintains existing retry and error handling logic for failed updates.
• Notes potential throughput impact if the main thread pauses due to DB latency.

_{1 file(s) reviewed, no comment(s)
Edit PR Review Bot Settings | Greptile}