Add support to configure min GC intervals for soft and hard limits

[bogdandrutu]

When servers are in a high memory usage mode, the amount of times GC is called creates a high CPU usage which combined with a high ingest rate limits capability to offload existing queued data.

Configuring the minimum interval even for hard limit, allows the system to spend some CPU cycles between GCs to offload old data from queues/batch processor. The most amount of data I've seen accumulated are blocked in the batch processor queue (incoming channel) not in the exporter queue.

[codecov]

Codecov Report

Attention: Patch coverage is 88.88889% with 5 lines in your changes missing coverage. Please review.

Project coverage is 92.19%. Comparing base (cffb7b6) to head (1254bcb).
Report is 2 commits behind head on main.

Files with missing lines	Patch %	Lines
internal/memorylimiter/config.go	42.85%	4 Missing ⚠️
internal/memorylimiter/memorylimiter.go	97.22%	1 Missing ⚠️

❌ Your patch status has failed because the patch coverage (88.88%) is below the target coverage (95.00%). You can increase the patch coverage or adjust the target coverage.

Additional details and impacted files

@@            Coverage Diff             @@
##             main   #12450      +/-   ##
==========================================
+ Coverage   92.10%   92.19%   +0.09%     
==========================================
  Files         465      465              
  Lines       25180    25194      +14     
==========================================
+ Hits        23191    23228      +37     
+ Misses       1592     1570      -22     
+ Partials      397      396       -1     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[atoulme]

This PR addresses a very interesting problem. Note GC kicks in whenever memory doubles, so it can be punitive right now to run in a high throughput environment. In our case, we leaned on the GOGC environment variable. We found that after removing the memory ballast extension, our GC would kick too often. We have set GOGC to 400 as result.

It looks like this change addresses the same issue.