quickwit README

The project's README from github.com/quickwit-oss/quickwit. As one markdown file: README.md.

CI codecov OpenSSF Scorecard Contributor Covenant License: Apache 2.0 Twitter Follow Discord



Quickwit Cloud-Native Search Engine Quickwit Cloud-Native Search Engine

Open-source search engine for observability (logs, traces, and soon metrics!).

Quickstart | Docs | Tutorials | Chat | Download


We just released Quickwit 0.8! Read the blog post to learn about the latest powerful features!

Quickwit is the fastest search engine on cloud storage. It's the perfect fit for observability use cases

🚀 Quickstart



💡 Features

Enterprise ready

📑 Architecture overview

Quickwit Distributed TracingQuickwit Distributed Tracing

📕 Documentation

📚 Resources

🙋 FAQ

How can I switch from Elasticsearch or OpenSearch to Quickwit?

Quickwit supports a large subset of Elasticsearch/OpenSearch API.

For instance, it has an ES-compatible ingest API to make it easier to migrate your log shippers (Vector, Fluent Bit, Syslog, ...) to Quickwit.

On the search side, the most popular Elasticsearch endpoints, query DSL, and even aggregations are supported.

The list of available endpoints and queries is available here, while the list of supported aggregations is available here.

Let us know if part of the API you are using is missing!

If the client you are using is refusing to connect to Quickwit due to missing headers, you can use the extra_headers option in the node configuration to impersonate any compatible version of Elasticsearch or OpenSearch.

How is Quickwit different from traditional search engines like Elasticsearch or Solr?

The core difference and advantage of Quickwit is its architecture built from the ground to search on cloud storage. We optimized IO paths, revamped the index data structures and made search stateless and sub-second on cloud storage.

How does Quickwit compare to Elastic in terms of cost?

We estimate that Quickwit can be up to 10x cheaper on average than Elastic. To understand how, check out our blog post about searching the web on AWS S3.

What license does Quickwit use?

Quickwit is open-source under the Apache License, Version 2.0 - Apache-2.0.

Is it possible to set up Quickwit for a High Availability (HA)?

HA is available for search, for indexing it's available only with a Kafka source.

🤝 Contribute and spread the word

We are always thrilled to receive contributions: code, documentation, issues, or feedback. Here's how you can help us build the future of log management:

✨ After your contributions are accepted, don't forget to claim your swag by emailing us at [email protected]. Thank you for contributing!

💬 Join Our Community

We welcome everyone to our community! Whether you're contributing code or just saying hello, we'd love to hear from you. Here's how you can connect with us:

quickwit (quickwit-oss/quickwit)

Searching Database…

11.7K ·GitHub
这是什么?Quickwit 是一款开源的云原生搜索引擎,专为可观测性(包括日志管理和分布式追踪)而构建,可直接在 S3 等云存储上实现亚秒级搜索。
这是数据库、搜索引擎,还是别的什么?它是一个独立的搜索引擎服务器,计算与存储分离,索引器和搜索节点均为无状态,通过 RESTful API 和兼容 Elasticsearch 的 API 对外提供服务。
我该怎么把它跑起来?可以按照快速入门指南搜索并分析 Stack Overflow 数据集,也可以结合 Grafana 或 Jaeger 尝试追踪分析;同时提供 Docker 镜像和 docker-compose 部署配置。
使用它一定要有 Kafka 或云存储账户吗?不一定。搜索时可以使用任何对象存储(S3、Azure Blob、GCS),但高可用索引必须使用 Kafka 数据源。
索引功能也完全支持高可用吗?不支持。搜索支持高可用,但高可用索引目前仅在使用 Kafka 数据源时可用。
我能不能直接把现有的 Elasticsearch/OpenSearch 工具指向它?可以。Quickwit 支持 Elasticsearch/OpenSearch API 的大部分功能,包括兼容 ES 的 ingest API,因此 Vector、Fluent Bit、Syslog 等日志采集工具只需少量修改,就能改为把数据发送到 Quickwit。
Quickwit 在架构上与 Elasticsearch 或 Solr 有什么不同?Quickwit 从一开始就是为直接在云存储上搜索而设计的,采用了优化的 IO 路径和重新设计的索引数据结构,使搜索变得无状态且达到亚秒级。传统引擎则是围绕本地磁盘设计的,这一点与之不同。
Quickwit 比 Elastic 便宜多少?Quickwit 估计,平均而言其成本最多可比 Elastic 低 10 倍,这主要得益于其云存储原生架构,将计算与存储解耦。
哪些数据源可以接入 Quickwit?它原生支持多种数据源,用于数据摄入的包括 Kafka、Kinesis 和 Pulsar,此外还支持面向日志和追踪的 OTEL 原生摄入,以及 Jaeger 原生支持。
Quickwit 支持多租户和数据保留策略吗?支持。它通过创建多个索引并进行分区来实现多租户,支持可配置的保留策略,并提供面向 GDPR 合规场景的删除任务。
Size
88.5 MB
Stars
11.7K
Age
5y
Commits · 90 Days