How Is Kafka So Fast If It Writes to Disk?
Most people think disks are slow. So how does Apache Kafka — a system that persists data to disk — handle millions of messages per second? The trick is not that Kafka avoids disk. The trick is how it uses the operating system and disk I/O patterns efficiently.