Caching improvement

[kleeedolinux]

Summary

This pull request introduces significant improvements to the caching system in Discordrb, enhancing performance and reliability when interacting with Discord's API. The changes implement TTL-based caching and rate-limiting mechanisms to prevent API throttling while optimizing memory usage.

These improvements will help applications maintain better performance while staying within Discord's API limits.

Added

• TTL-based caching system for API requests
• Rate-limiting mechanism for API calls
• Thread-safe caching operations
• Memory optimization features

Changed

• Modified API request handling to use new caching system
• Updated cache storage implementation
• Improved request queueing system
• Enhanced error handling for cached requests
• Optimized memory usage patterns

Deprecated

• N/A

Removed

• N/A

Fixed

• Memory leak issues in cache storage
• Rate-limiting violations
• Thread safety issues in concurrent operations
• Cache staleness problems
• Performance bottlenecks in API requests

[swarley]

Hey! I don't think I'm going to be merging this because the caching of these values for an arbitrary amount of time is unexpected at this layer and it's confusing to me that some of the interaction based things are being cached at all. If you've got a problem that this solves I would be happy to discuss it with you though