Lattice
Lattice · distributed cache
Keys Group platform
EU region · 4 nodes

Nodes

Each node owns a slice of the token ring and a replica of its neighbour's slice. Losing one node costs latency, not data.

Detail

NodeUptimeMemoryConnsRepl lagEvictions/min
eu-a147d171 / 192 GB2 1400 ms1 820
eu-a247d164 / 192 GB2 0062 ms1 640
eu-a347d159 / 192 GB1 9541 ms1 588
eu-b12h118 / 192 GB1 102340 ms2 470

What the states mean

serving
owns its ranges, answers reads and writes
rejoining
streaming ranges in, answers writes, partial reads
draining
handing ranges off before a planned stop
lost
missed three gossip rounds, ranges reassigned
Nodes are never removed automatically. A lost node keeps its tokens until an operator releases them, so a flapping link does not reshuffle the ring.

Connections

Clients hold one long-lived connection per node and multiplex every request over it. A pool of 2 000 connections on a node means roughly 2 000 client processes, not 2 000 concurrent requests — concurrency lives inside the connection.