Qdrant Beats Elastic’s DiskBBQ at 2x Throughput, Half the Latency, and 1/3 the Compute

· Source: Qdrant Blog on Qdrant - Vector Search Engine · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Data Science & Analytics, Cloud Computing & IT Infrastructure · Depth: Intermediate, medium

Summary

Qdrant recently published a benchmark refuting Elastic's claims that its proprietary DiskBBQ index offers up to 7x higher throughput than Qdrant for disk-based vector search. Qdrant's re-evaluation, using the same wiki_dpr_e5 dataset of 21 million 768-dimensional embeddings, demonstrated significantly superior performance. By correctly configuring Qdrant with TurboQuant 4-bit, two-stage retrieval, and async disk scoring, Qdrant achieved 2.1x higher throughput and 51% lower latency at a recall@100 of approximately 0.96. This was accomplished on three m6g.large instances (2 vCPU / 8 GiB RAM each), representing roughly one-third of the per-node CPU and RAM used by Elastic's n4-standard-8 nodes (7 vCPU / 26 GB RAM each). Elastic's original benchmark, which reported 32.4 QPS at 122.6 ms latency for DiskBBQ, was surpassed by Qdrant's 67.2 QPS at 59.5 ms latency on smaller hardware.

Key takeaway

For MLOps Engineers evaluating vector database solutions for large-scale, disk-based search, you should critically review benchmark methodologies and ensure proper configuration. Qdrant's demonstrated performance, achieving 2x throughput and half the latency on one-third the compute compared to Elastic's DiskBBQ, suggests significant cost savings and efficiency gains. Consider Qdrant's two-stage retrieval with TurboQuant 4-bit and async disk scoring to optimize your resource footprint and performance for similar workloads.

Key insights

Proper configuration of vector databases is crucial for optimal disk-based search performance and resource efficiency.

Principles

Method

Implement two-stage retrieval by prefetching quantized vectors, then rescoring a bounded set with full-precision vectors from disk.

In practice

Topics

Code references

Best for: CTO, VP of Engineering/Data, Director of AI/ML, Machine Learning Engineer, AI Engineer, MLOps Engineer

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Qdrant Blog on Qdrant - Vector Search Engine.