If you've been building LLM-powered applications, you've inevitably encountered the vector database question. Traditional relational databases excel at exact lookups; vector databases excel at approximate similarity search—which is exactly what retrieval-augmented generation (RAG) pipelines need.
A vector database stores high-dimensional numerical embeddings and indexes them for fast approximate nearest neighbor (ANN) search. When a user submits a query, the application embeds it using the same model that embedded the corpus, then retrieves the k most semantically similar chunks from the vector store.
Pinecone is the fully managed option—zero operational overhead, generous free tier, and a clean SDK. The trade-off is cost at scale and vendor lock-in. It suits teams that want to ship fast and revisit infrastructure later.
Weaviate is open-source and self-hostable with a rich GraphQL API, built-in vectorization modules, and support for hybrid search (keyword + vector). The operational complexity is higher but the flexibility is significant.
pgvector extends PostgreSQL with a vector column type and ANN indexes. If you're already on Postgres, the operational simplicity of keeping one fewer data store often outweighs the performance gap versus specialized engines.
Qdrant is a pure-play ANN database written in Rust with excellent performance benchmarks and a straightforward REST API. It's a strong choice for teams that need self-hosted performance without the broader ecosystem of Weaviate.