chore: define local cache size and memory limits

[thecristen]

Scope

Inspired by an earlier OutOfMemory error briefly impacting prod this morning, and the discussions which arose from it.

Implementation

As per Nebulex's documentation we can adjust the local cache configuration (which caches data in-memory). This change adds two values which were previously unset (the default value for each is nil which meant the cleanup check to release memory was not performed)

• :allocated_memory - For reference, our containers have 17_179_900_000 bytes so we could probably increase our allocation a bit, but I kind of what to see what happens here...
• :max_size is the maximum number of cached entries

How to test

🚀 ???