Types of Cache

Written by Nick Otter.

Contents

• Introduction
  
• Alex Xu
  

Introduction

This post from Alex Xu is a great breakdown of Cache Scenarios, Techniques, Algorithms and Key Metrics.

Alex Xu

Caching is one of the 𝐦𝐨𝐬𝐭 𝐜𝐨𝐦𝐦𝐨𝐧𝐥𝐲 used techniques when building fast online systems. When using a cache, here are the top 5 things to consider:

The first version of the cheatsheet was written by guest author Love Sharma.

𝐒𝐮𝐢𝐭𝐚𝐛𝐥𝐞 𝐒𝐜𝐞𝐧𝐚𝐫𝐢𝐨𝐬:

• In-memory solution
• Read heavy system
• Data is not frequently updated

𝐂𝐚𝐜𝐡𝐢𝐧𝐠 𝐓𝐞𝐜𝐡𝐧𝐢𝐪𝐮𝐞𝐬:

• Cache aside
• Write-through
• Read-through
• Write-around
• Write-back

𝐂𝐚𝐜𝐡𝐞 𝐄𝐯𝐢𝐜𝐭𝐢𝐨𝐧 𝐀𝐥𝐠𝐨𝐫𝐢𝐭𝐡𝐦𝐬:

• Least Recently Used (LRU)
• Least Frequently Used (LFU)
• First-in First-out (FIFO)
• Random Replacement (RR)

𝐊𝐞𝐲 𝐌𝐞𝐭𝐫𝐢𝐜𝐬:

• Cache Hit Ratio
• Latency
• Throughput
• Invalidation Rate
• Memory Usage
• CPU usage
• Network usage

𝐎𝐭𝐡𝐞𝐫 𝐢𝐬𝐬𝐮𝐞𝐬:

• Thunder herd on cold start
• Time-to-live (TTL)

Where Is Cache Used

• Client-side cache
• Load balancer cache
• CDN cache
• CPU, RAM, Disk cache
• Message broker cache
• Database cache

---

Thanks. This was written by Nick Otter.