Optimizing the cache hit rate
Stellate's Automatic Cache Invalidation, the Purging API made available based on your schema, and fine-grained Cache Rules ensure our customers get the highest cache hit rate possible. We usually see cache hit rates ranging from 50% to 95% depending on the use case.
There are some reasons beyond the configuration and purging that affect the cache hit rate:
- Authenticated users: Query results that differ between authenticated users should be cached separately with Scopes.
- Multiple locations: Every one of Stellate's 60 worldwide locations has its own local cache.
- Query size and other limits: If you respond with large amounts of data (133mb+), we might not be able to cache it.
- LRU caching: Finally, we use an LRU (least-recently-used) cache, so uncommonly requested data might be evicted before the
maxAgeorswrtime expires.
We also recommend taking a look at our caching metrics guide to understand how you can use these metrics to improve your cache hit rate.
If necessary, contact us at support@stellate.co to talk through specific strategies to optimize your cache hit rate.