Cloudflare previews Meerkat, an internal consensus service for global control-plane data

Cloudflare Research has introduced Meerkat, an experimental internal consensus service aimed at a hard problem for large distributed systems: keeping small pieces of control-plane state strongly consistent while operating across a global network. The company says the project is still in development and not deployed to production, but it has already been tested in proofs of concept with as many as 50 replicas spread around the world.

The target use case is not a general-purpose database. Cloudflare describes Meerkat as infrastructure for low-volume but high-importance control-plane data, such as which machine is allowed to lead a replicated database or where a resource such as an AI model instance is placed. Those values need to be readable and writable from many locations without services seeing conflicting answers.

Why Cloudflare is trying a different consensus path

Cloudflare says many of its internal services run across more than 330 data centers, where links can degrade, queues can fill and machines can fail. Traditional leader-based consensus systems such as Raft can deliver strong consistency, but Cloudflare argues they are awkward for wide-area networks because write availability depends on a leader. If that leader fails or becomes slow, systems can pause until another leader is elected, and tuning election timeouts is difficult when latency changes unpredictably.

Meerkat is built around QuePaxa, a consensus algorithm published in 2023 by EPFL researchers. Cloudflare's explanation emphasizes a key operational distinction: any replica can accept writes, while a leader remains useful only as a faster path rather than a hard requirement. The company says that design should let clients keep making progress as long as they can reach a healthy replica connected to a majority of the cluster.

What comes next

For now, the announcement is best read as a research and infrastructure preview rather than a product launch. Cloudflare says Meerkat will remain internal in the immediate future, with future posts planned on QuePaxa, formal verification work in Rust, cluster management, replica placement and simulation testing. The company also says it is preparing a manuscript for peer review.

The work matters because global platforms increasingly need consistent coordination for distributed databases, AI infrastructure and edge services. If Meerkat performs as Cloudflare hopes, it could reduce a class of reliability failures where a single degraded leader slows or blocks control-plane changes across a global system.

Sources

• blog.cloudflare.com

Cover photo by Brett Sayles on Pexels, used under the Pexels License.