Topics / #information-retrieval
Information-retrieval projects on GitHub
Searching and ranking relevant documents and answers
As of , the most-starred Information-retrieval projects on GitHub are PageIndex (39.2K stars), searxng (38.5K stars) and onyx (32.5K stars). GitHub.Locker tracks 15 Information-retrieval repositories with 266K stars combined. The fastest-growing on October 16 was PageIndex, with +75 stars in a day.
Hot right now
Most stars gained in a day · Oct 16
PageIndex
VectifyAI/PageIndex · ★ 39.2KPageIndex is a vectorless, reasoning-based RAG (Retrieval-Augmented Generation) engine. Instead of a vector database and chunking, it builds a hierarchical tree index that mirrors a document's structure and lets an LLM reason its way through that tree to find relevant sections, the way a human expert flips to the right part of a report.
+40searxng
searxng/searxng · ★ 38.5KSearXNG is a free internet metasearch engine: it aggregates results from various search services and databases into one results page, and users are neither tracked nor profiled.
+28onyx
onyx-dot-app/onyx · ★ 32.5KOnyx is an open source AI platform that gives you a full-featured chat interface on top of any LLM, with built-in RAG, web search, agents, and more.
+12haystack
deepset-ai/haystack · ★ 26.8KAn open-source AI orchestration framework for building production-ready LLM applications in Python: modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation.
The all-time top
15 projects · by stars
- 39.2K
#1 · VectifyAI/PageIndex
PageIndex
PageIndex is a vectorless, reasoning-based RAG (Retrieval-Augmented Generation) engine. Instead of a vector database and chunking, it builds a hierarchical tree index that mirrors a document's structure and lets an LLM reason its way through that tree to find relevant sections, the way a human expert flips to the right part of a report.
- 38.5K
#2 · searxng/searxngsearxng
SearXNG is a free internet metasearch engine: it aggregates results from various search services and databases into one results page, and users are neither tracked nor profiled.
- 32.5K
#3 · onyx-dot-app/onyxonyx
Onyx is an open source AI platform that gives you a full-featured chat interface on top of any LLM, with built-in RAG, web search, agents, and more.
- 4

EasyOCR
30.1KJaidedAI/EasyOCR · PythonA ready-to-use, open-source OCR library for Python: it detects and reads text in images across 80+ languages and popular writing scripts — Latin, Chinese, Arabic, Devanagari, Cyrillic and more.
- 5

haystack
26.8Kdeepset-ai/haystack · PythonAn open-source AI orchestration framework for building production-ready LLM applications in Python: modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation.
- 6
DocsGPT
18.3Karc53/DocsGPT · PythonDocsGPT is a private, self-hosted AI platform for building agents, assistants, and enterprise search tools, with a built-in Agent Builder, document analysis, deep research mode, and support for multiple LLM providers.
- 7

weaviate
16.9Kweaviate/weaviate · GoWeaviate is an open-source, cloud-native vector database: it stores objects and vectors together and lets you combine vector search with structured filtering for semantic search at scale.
- 8

gensim
16.5Kpiskvorky/gensim · PythonGensim is a Python library for topic modelling, document indexing and similarity retrieval with large corpora, aimed at the natural language processing (NLP) and information retrieval (IR) community.
- 9

unstructured
15.6KUnstructured-IO/unstructured · HTMLUnstructured is an open-source ETL toolkit that converts complex documents like PDFs, Word docs, HTML and images into clean, structured data (JSON) ready for LLMs, RAG pipelines and vector databases.
- 10

txtai
13Kneuml/txtai · Pythontxtai is an all-in-one AI framework for semantic search, LLM orchestration and language model workflows. Its core is an embeddings database that combines vector indexes, graph networks and relational databases to power search or serve as a knowledge source for LLM apps.
- 11

FlagEmbedding
12.3KFlagOpen/FlagEmbedding · PythonFlagEmbedding (BGE) is a one-stop toolkit from BAAI for retrieval and retrieval-augmented LLMs, providing embedding models, rerankers, finetuning scripts, and evaluation tools for search and RAG.
- 12

sutskever-30-implementations
5.2Kpageman/sutskever-30-implementations · Jupyter NotebookIt is a from-scratch NumPy implementation suite covering all 30 deep learning papers from Ilya Sutskever's famous reading list, the one he told John Carmack would teach '90% of what matters' in the field.
- 13
SkillCorpus
686EverMind-AI/SkillCorpus · PythonSkillCorpus is EverMind's open-source pipeline that aggregates scattered SKILL.md files from public repos, applies safety/license/quality gates, and exports a curated, retrieval-ready corpus plus two fine-tuned retrieval models so agents can fetch the right skill at answer time.
- 14
sgrep
307context-dot-dev/sgrep · Pythonsgrep is a local search tool that finds code and document passages using plain-English intent, combining semantic embeddings with ripgrep-style lexical matching, without any account or hosted index.
- 15

LLMSearchRecommender
124alopatenko/LLMSearchRecommenderA curated compendium of research papers, surveys, and industry engineering practices on using Generative AI and LLMs to build search engines, recommender systems, personalization engines, and question-answering systems.
Related topics
Often tagged together
- python2,383
- rag292
- semantic-search114
- ai1,955
- llm1,483
- machine-learning916
- server1,459
- vector-search74
- docker1,660
- embeddings135
- linux4,184
- open-source5,666
- nlp214
- apache-2.01,434
- benchmark431
- research764
- retrieval-augmented-generation56
- search-engine53
- self-hosted1,929
- agents422
- ai-agents1,289
- deep-learning737
- huggingface362
- library1,587