elasticsearch README

The project's README from github.com/elastic/elasticsearch. As one markdown file: README.md.

= Elasticsearch

Elasticsearch is a distributed search and analytics engine, scalable data store and vector database optimized for speed and relevance on production-scale workloads. Elasticsearch is the foundation of Elastic's open Stack platform. Search in near real-time over massive datasets, perform vector searches, integrate with generative AI applications, and much more.

Use cases enabled by Elasticsearch include:

... and more!

To learn more about Elasticsearch's features and capabilities, see our https://www.elastic.co/products/elasticsearch[product page].

To access information on https://www.elastic.co/search-labs/blog/categories/ml-research[machine learning innovations] and the latest https://www.elastic.co/search-labs/blog/categories/lucene[Lucene contributions from Elastic], more information can be found in https://www.elastic.co/search-labs[Search Labs].

[[get-started]] == Get started

The simplest way to set up Elasticsearch is to create a managed deployment with https://www.elastic.co/cloud/as-a-service[Elasticsearch Service on Elastic Cloud].

If you prefer to install and manage Elasticsearch yourself, you can download the latest version from https://www.elastic.co/downloads/elasticsearch[elastic.co/downloads/elasticsearch].

=== Run Elasticsearch locally

//// IMPORTANT: This content is replicated in the Elasticsearch repo. See run-elasticsearch-locally.asciidoc. Ensure both files are in sync.

https://github.com/elastic/start-local is the source of truth. ////

[WARNING]

DO NOT USE THESE INSTRUCTIONS FOR PRODUCTION DEPLOYMENTS.

This setup is intended for local development and testing only.

Quickly set up Elasticsearch and Kibana in Docker for local development or testing, using the https://github.com/elastic/start-local?tab=readme-ov-file#-try-elasticsearch-and-kibana-locally[`start-local` script].

ℹ️ For more detailed information about the start-local setup, refer to the https://github.com/elastic/start-local[README on GitHub].

==== Prerequisites

==== Trial license This setup comes with a one-month trial license that includes all Elastic features.

After the trial period, the license reverts to Free and open - Basic. Refer to https://www.elastic.co/subscriptions[Elastic subscriptions] for more information.

==== Run start-local

To set up Elasticsearch and Kibana locally, run the start-local script:

[source,sh]

curl -fsSL https://elastic.co/start-local | sh

// NOTCONSOLE

This script creates an elastic-start-local folder containing configuration files and starts both Elasticsearch and Kibana using Docker.

After running the script, you can access Elastic services at the following endpoints:

The script generates a random password for the elastic user, which is displayed at the end of the installation and stored in the .env file.

[CAUTION]

This setup is for local testing only. HTTPS is disabled, and Basic authentication is used for Elasticsearch. For security, Elasticsearch and Kibana are accessible only through localhost.

==== API access

An API key for Elasticsearch is generated and stored in the .env file as ES_LOCAL_API_KEY. Use this key to connect to Elasticsearch with a https://www.elastic.co/guide/en/elasticsearch/client/index.html[programming language client] or the https://www.elastic.co/guide/en/elasticsearch/reference/current/rest-apis.html[REST API].

From the elastic-start-local folder, check the connection to Elasticsearch using curl:

[source,sh]

source .env curl $ES_LOCAL_URL -H "Authorization: ApiKey ${ES_LOCAL_API_KEY}"

To use the password for the elastic user, set and export the ES_LOCAL_PASSWORD environment variable. For example:

[source,sh]

source .env export ES_LOCAL_PASSWORD

// NOTCONSOLE

=== Send requests to Elasticsearch

You send data and other requests to Elasticsearch through REST APIs. You can interact with Elasticsearch using any client that sends HTTP requests, such as the https://www.elastic.co/guide/en/elasticsearch/client/index.html[Elasticsearch language clients] and https://curl.se[curl].

==== Using curl

Here's an example curl command to create a new Elasticsearch index, using basic auth:

[source,sh]

curl -u elastic:$ES_LOCAL_PASSWORD
-X PUT
http://localhost:9200/my-new-index
-H 'Content-Type: application/json'

// NOTCONSOLE

==== Using a language client

To connect to your local dev Elasticsearch cluster with a language client, you can use basic authentication with the elastic username and the password stored in the ES_LOCAL_PASSWORD environment variable.

You'll use the following connection details:

For example, to connect with the Python elasticsearch client:

[source,python]

import os from elasticsearch import Elasticsearch

username = 'elastic' password = os.getenv('ES_LOCAL_PASSWORD') # Value you set in the environment variable

client = Elasticsearch( "http://localhost:9200", basic_auth=(username, password) )

print(client.info())

==== Using the Dev Tools Console

Kibana's developer console provides an easy way to experiment and test requests. To access the console, open Kibana, then go to Management > Dev Tools.

Add data

You index data into Elasticsearch by sending JSON objects (documents) through the REST APIs. Whether you have structured or unstructured text, numerical data, or geospatial data, Elasticsearch efficiently stores and indexes it in a way that supports fast searches.

For timestamped data such as logs and metrics, you typically add documents to a data stream made up of multiple auto-generated backing indices.

To add a single document to an index, submit an HTTP post request that targets the index.


POST /customer/_doc/1 { "firstname": "Jennifer", "lastname": "Walters" }

This request automatically creates the customer index if it doesn't exist, adds a new document that has an ID of 1, and stores and indexes the firstname and lastname fields.

The new document is available immediately from any node in the cluster. You can retrieve it with a GET request that specifies its document ID:


GET /customer/_doc/1

To add multiple documents in one request, use the _bulk API. Bulk data must be newline-delimited JSON (NDJSON). Each line must end in a newline character (\n), including the last line.


PUT customer/_bulk { "create": { } } { "firstname": "Monica","lastname":"Rambeau"} { "create": { } } { "firstname": "Carol","lastname":"Danvers"} { "create": { } } { "firstname": "Wanda","lastname":"Maximoff"} { "create": { } } { "firstname": "Jennifer","lastname":"Takeda"}

Search

Indexed documents are available for search in near real-time. The following search matches all customers with a first name of Jennifer in the customer index.


GET customer/_search { "query" : { "match" : { "firstname": "Jennifer" } }

}

Explore

You can use Discover in Kibana to interactively search and filter your data. From there, you can start creating visualizations and building and sharing dashboards.

To get started, create a data view that connects to one or more Elasticsearch indices, data streams, or index aliases.

. Go to Management > Stack Management > Kibana > Data Views. . Select Create data view. . Enter a name for the data view and a pattern that matches one or more indices, such as customer. . Select Save data view to Kibana.

To start exploring, go to Analytics > Discover.

[[upgrade]] == Upgrade

To upgrade from an earlier version of Elasticsearch, see the https://www.elastic.co/guide/en/elasticsearch/reference/current/setup-upgrade.html[Elasticsearch upgrade documentation].

[[build-source]] == Build from source

Elasticsearch uses https://gradle.org[Gradle] for its build system.

To build a distribution for your local OS and print its output location upon completion, run:

./gradlew localDistro

./gradlew :distribution:archives:linux-tar:assemble ./gradlew :distribution:archives:darwin-tar:assemble ./gradlew :distribution:archives:windows-zip:assemble

Distributions are output to distribution/archives.

To run the test suite, see xref:TESTING.asciidoc[TESTING].

[[docs]] == Documentation

For the complete Elasticsearch documentation visit https://www.elastic.co/guide/en/elasticsearch/reference/current/index.html[elastic.co].

For information about our documentation processes, see the xref:https://github.com/elastic/elasticsearch/blob/main/docs/README.md[docs README].

[[examples]] == Examples and guides

The https://github.com/elastic/elasticsearch-labs[`elasticsearch-labs`] repo contains executable Python notebooks, sample apps, and resources to test out Elasticsearch for vector search, hybrid search and generative AI use cases.

[[contribute]] == Contribute

For contribution guidelines, see xref:CONTRIBUTING.md[CONTRIBUTING].

[[questions]] == Questions? Problems? Suggestions?

elasticsearch (elastic/elasticsearch)

Searching Database…

这是什么?Elasticsearch 是一个分布式搜索和分析引擎,同时也是可扩展的数据存储和向量数据库。它面向生产规模的数据,支持近实时全文搜索、向量搜索,以及生成式 AI(RAG)应用场景,是 Elastic Stack 平台的核心。
这是我要导入的代码库,还是需要运行的服务器?它是一个需要部署为集群的服务器/数据存储,而不是代码库。你通过 REST API 与它交互,发送和查询 JSON 文档即可。
如何在本地测试时运行 Elasticsearch?用 curl 通过管道交给 sh 运行 'start-local' 脚本。它会创建一个包含配置文件的文件夹,并在 Docker 中同时启动 Elasticsearch 和 Kibana,同时生成随机密码和 API 密钥,保存在 .env 文件中。
运行前需要先安装 Docker 吗?需要。本地快速启动需要 Docker Desktop;如果你使用 Windows,还需要安装 WSL(Windows Subsystem for Linux,适用于 Linux 的 Windows 子系统)。
这种本地 Docker 部署可以用于生产环境吗?不可以。README 明确警告不要这样做:HTTPS 被禁用,集群仅由 Basic 认证保护,并且只能通过 localhost 访问。此外,它附带一个为期一个月的试用许可证,之后会回退到免费的 Basic 版本。
生产环境推荐怎么运行?Elastic 推荐使用 Elastic Cloud 进行托管部署,或者自行下载并管理 Elasticsearch 发行版(提供 Linux、macOS 和 Windows 版本)。
运行起来之后,我该如何添加和搜索数据?你可以通过 REST 向某个索引发送 POST 请求提交 JSON 文档(一次 POST 会自动创建索引和文档);也可以使用 bulk API,以换行分隔的 JSON 一次索引大量文档。然后用 GET 请求配合 match 查询进行搜索。
除了普通搜索,还能用它做什么?借助内置的向量数据库和向量搜索能力,它可以用于日志、指标、应用性能监控(APM)、安全分析,以及为生成式 AI 应用提供检索增强生成(RAG)。
Kibana 在这套环境中扮演什么角色?Kibana 是 Elastic 配套的图形界面,会随 start-local 脚本与 Elasticsearch 一起启动。它提供 Dev Tools 控制台用于交互式运行查询,还提供用于创建数据视图、可视化图表和仪表板的工具。
Creator
elastic
Size
1.7 GB
Stars
78.3K
Age
16y
Commits · 90 Days