quickwit README

The project's README from github.com/quickwit-oss/quickwit. As one markdown file: README.md.

CI codecov OpenSSF Scorecard Contributor Covenant License: Apache 2.0 Twitter Follow Discord



Quickwit Cloud-Native Search Engine Quickwit Cloud-Native Search Engine

Open-source search engine for observability (logs, traces, and soon metrics!).

Quickstart | Docs | Tutorials | Chat | Download


We just released Quickwit 0.8! Read the blog post to learn about the latest powerful features!

Quickwit is the fastest search engine on cloud storage. It's the perfect fit for observability use cases

🚀 Quickstart



💡 Features

Enterprise ready

📑 Architecture overview

Quickwit Distributed TracingQuickwit Distributed Tracing

📕 Documentation

📚 Resources

🙋 FAQ

How can I switch from Elasticsearch or OpenSearch to Quickwit?

Quickwit supports a large subset of Elasticsearch/OpenSearch API.

For instance, it has an ES-compatible ingest API to make it easier to migrate your log shippers (Vector, Fluent Bit, Syslog, ...) to Quickwit.

On the search side, the most popular Elasticsearch endpoints, query DSL, and even aggregations are supported.

The list of available endpoints and queries is available here, while the list of supported aggregations is available here.

Let us know if part of the API you are using is missing!

If the client you are using is refusing to connect to Quickwit due to missing headers, you can use the extra_headers option in the node configuration to impersonate any compatible version of Elasticsearch or OpenSearch.

How is Quickwit different from traditional search engines like Elasticsearch or Solr?

The core difference and advantage of Quickwit is its architecture built from the ground to search on cloud storage. We optimized IO paths, revamped the index data structures and made search stateless and sub-second on cloud storage.

How does Quickwit compare to Elastic in terms of cost?

We estimate that Quickwit can be up to 10x cheaper on average than Elastic. To understand how, check out our blog post about searching the web on AWS S3.

What license does Quickwit use?

Quickwit is open-source under the Apache License, Version 2.0 - Apache-2.0.

Is it possible to set up Quickwit for a High Availability (HA)?

HA is available for search, for indexing it's available only with a Kafka source.

🤝 Contribute and spread the word

We are always thrilled to receive contributions: code, documentation, issues, or feedback. Here's how you can help us build the future of log management:

✨ After your contributions are accepted, don't forget to claim your swag by emailing us at [email protected]. Thank you for contributing!

💬 Join Our Community

We welcome everyone to our community! Whether you're contributing code or just saying hello, we'd love to hear from you. Here's how you can connect with us:

quickwit (quickwit-oss/quickwit)

distributed-tracing
Searching Database…

11.7K ·GitHub
Quickwit
What is this?Quickwit is an open-source, cloud-native search engine built for observability - log management and distributed tracing - that runs sub-second search directly on cloud storage like S3.
Is this a database, a search engine, or something else?It is a standalone search engine server with decoupled compute and storage, stateless indexers and searchers, exposed through a RESTful API and an Elasticsearch-compatible API.
How do I get it running?Follow the Quickstart guide to search and analyze a Stack Overflow dataset, or try trace analytics with Grafana or Jaeger; a Docker image and docker-compose setup are also provided.
Do I need Kafka or a cloud storage account to use it?Not strictly - it works with any object storage (S3, Azure Blob, GCS) for search, but high-availability indexing specifically requires a Kafka data source.
Is high availability fully supported for indexing too?No - HA is available for search, but HA indexing currently only works when using a Kafka source.
Can I just point my existing Elasticsearch/OpenSearch tooling at it?Yes, Quickwit supports a large subset of the Elasticsearch/OpenSearch API, including an ES-compatible ingest API, so log shippers like Vector, Fluent Bit, and Syslog can be redirected to it with minimal changes.
How does Quickwit differ architecturally from Elasticsearch or Solr?Quickwit was built from the ground up to search directly on cloud storage, with optimized IO paths and revamped index data structures that make search stateless and sub-second, unlike traditional engines designed around local disk.
How much cheaper is Quickwit compared to Elastic?Quickwit estimates it can be up to 10x cheaper on average than Elastic, mainly due to its cloud-storage-native architecture that decouples compute from storage.
What data sources can feed into Quickwit?It natively supports multiple data sources including Kafka, Kinesis, and Pulsar for ingestion, plus OTEL-native ingestion for logs and traces and Jaeger-native support.
Does Quickwit support multi-tenancy and data retention policies?Yes, it offers multi-tenancy via indexing with many indexes and partitioning, configurable retention policies, and delete tasks for GDPR compliance use cases.
What are similar projects?openobserve, OpenSearch, vector, elasticsearch, signoz, xerj, encore, qdrant
Which topics is it in?distributed-tracing, logs, cloud-storage, elasticsearch, search-engine, big-data, gpl, aws, cloud-native, observability, kubernetes, rest-api
Creator
quickwit-oss
Size
88.5 MB
Stars
11.7K
Updated
CommitOct 16Releasev0.9.2Oct 16
Age
5y
Commits · 90 Days