🔥Perplexity Ditches DynamoDB for CobbleDB, Cuts Latency and Costs
Perplexity's new key-value store slashes costs and latency
TL;DR
Perplexity replaced Amazon DynamoDB with CobbleDB, a Rust-based key-value store, reducing batch-read latencies by fivefold and cutting storage costs by 20%. This move addresses unique AI query patterns and high traffic demands.
Perplexity has swapped out Amazon DynamoDB for CobbleDB, an internally developed distributed key-value store in Rust. The move was driven by severe latency and cost issues, with DynamoDB's usage-based pricing becoming unsustainable at 200,000 requests per second. CobbleDB slashes batch-read latency from 31.4ms to 5.6ms and reduces storage costs by 20%. This is a big deal for teams dealing with high-traffic, AI-driven query patterns. Perplexity's new system is optimized for batched lookups, with each query generating 100-120 target page keys, split into 10-20 key batches for parallel retrieval. The architecture incurs trade-offs, including complex node management and partition rebalancing.
Key Points
Perplexity replaced DynamoDB with CobbleDB, a Rust-based key-value store, addressing latency and cost issues.
CobbleDB reduces batch-read latency from 31.4ms to 5.6ms, a fivefold improvement over DynamoDB.
Storage costs are cut by at least 20% with CobbleDB, addressing high-traffic demands over 200,000 requests/s.
Each query generates 100-120 target page keys, split into 10-20 key batches for parallel retrieval.
CobbleDB supports payloads up to 50KB, with synthetic benchmarks confirming throughput up to 500,000 requests/s.
Why It Matters
If you're running a high-traffic AI query system, Perplexity's switch to CobbleDB could save you a fortune. The new system reduces latency by fivefold and cuts storage costs by 20%, making it a game-changer for teams dealing with complex, batch-driven queries. However, the trade-offs in node management and partition rebalancing mean it's not a one-size-fits-all solution.
Comments
Be the first to comment
Enjoyed this article?
Get it daily. 7am. Free. Reads in 5 minutes.
Join 3,507 builders reading daily.