Topics / #web-search
Web-search projects on GitHub
Search engines, web scraping search and search-enabled agents.
As of , the most-starred Web-search projects on GitHub are firecrawl (192.8K stars), odysseus (93.9K stars) and last30days-skill (64.7K stars). GitHub.Locker tracks 28 Web-search repositories with 640.5K stars combined. The fastest-growing on October 17 was firecrawl, with +311 stars in a day.
Hot right now
Most stars gained in a day · Oct 17
+311firecrawl
firecrawl/firecrawl · ★ 192.8KFirecrawl turns any website into clean, LLM-ready data by crawling, scraping, and searching the web, delivering markdown, structured JSON, or screenshots that AI agents can consume directly.
+108odysseus
odysseus-dev/odysseus · ★ 93.9KOdysseus is a self-hosted AI workspace that bundles chat, agents, deep research, a document editor, email, notes, tasks, and calendar around local or API models.
+88last30days-skill
mvanhorn/last30days-skill · ★ 64.7KIt is an AI agent skill that researches any topic across Reddit, X, YouTube, Hacker News, Polymarket, TikTok, Instagram, GitHub, arXiv, Techmeme, LinkedIn and more in parallel, then has an AI judge synthesize the results into one grounded brief ranked by real engagement (upvotes, likes, betting odds) instead of SEO.
LibreChat
LibreChat-AI/LibreChat · ★ 45.9KLibreChat is a self-hosted AI chat platform that unifies all major AI providers (OpenAI, Anthropic, Google, AWS Bedrock, Azure, Mistral, OpenRouter and more) in a single ChatGPT-like interface, with Agents, MCP support, Code Interpreter and Artifacts built in.
The all-time top
28 projects · by stars
- 192.8K
#1 · firecrawl/firecrawlfirecrawl
Firecrawl turns any website into clean, LLM-ready data by crawling, scraping, and searching the web, delivering markdown, structured JSON, or screenshots that AI agents can consume directly.
- 93.9K
#2 · odysseus-dev/odysseusodysseus
Odysseus is a self-hosted AI workspace that bundles chat, agents, deep research, a document editor, email, notes, tasks, and calendar around local or API models.
- 64.7K
#3 · mvanhorn/last30days-skilllast30days-skill
It is an AI agent skill that researches any topic across Reddit, X, YouTube, Hacker News, Polymarket, TikTok, Instagram, GitHub, arXiv, Techmeme, LinkedIn and more in parallel, then has an AI judge synthesize the results into one grounded brief ranked by real engagement (upvotes, likes, betting odds) instead of SEO.
- 4
LibreChat
45.9KLibreChat-AI/LibreChat · TypeScriptLibreChat is a self-hosted AI chat platform that unifies all major AI providers (OpenAI, Anthropic, Google, AWS Bedrock, Azure, Mistral, OpenRouter and more) in a single ChatGPT-like interface, with Agents, MCP support, Code Interpreter and Artifacts built in.
- 5

onyx
32.6Konyx-dot-app/onyx · PythonOnyx is an open source AI platform that gives you a full-featured chat interface on top of any LLM, with built-in RAG, web search, agents, and more.
- 6

Scrapegraph-ai
31.9KScrapeGraphAI/Scrapegraph-ai · PythonScrapeGraphAI is a Python web scraping library that uses LLMs and direct graph logic to build scraping pipelines for websites and local documents (XML, HTML, JSON, Markdown). You just say which information you want to extract and it does the rest.
- 7
gpt-researcher
30.2Kassafelovic/gpt-researcher · PythonAn open-source autonomous agent that runs deep research on any task across the web and your local documents, producing detailed, factual research reports with citations.
- 8
claude-code
22.9Kclaude-code-best/claude-code · TypeScriptClaude Code Best (CCB) is a full open-source engineering reconstruction of Anthropic's official Claude Code CLI agent — buildable, runnable and debuggable — extended with extra features like goal-driven workflows, multi-agent orchestration, voice input and computer/browser control, while keeping full compatibility with the original Claude Code configuration.
- 9

DeepResearch
20.1KAlibaba-NLP/DeepResearch · PythonTongyi DeepResearch — an open-source agentic LLM from Alibaba's Tongyi Lab, built for long-horizon, deep information-seeking on the web. This repo ships the model weights plus Python inference and benchmark evaluation scripts.
- 10

gemini-fullstack-langgraph-quickstart
18.3Kgoogle-gemini/gemini-fullstack-langgraph-quickstart · Jupyter NotebookGoogle's fullstack quickstart for building research agents: a React frontend over a LangGraph backend powered by Gemini, which searches the web, reflects on gaps and returns answers with citations.
- 11

maxun
17.9Kgetmaxun/maxun · TypeScriptMaxun is an open-source no-code web data platform that turns any website into structured, reliable data: it handles extraction, crawling, scraping, search and AI-powered data extraction.
- 12
open_deep_research
12.7Klangchain-ai/open_deep_research · PythonOpen Deep Research is a simple, configurable, fully open-source deep research agent that can research a topic across the web and MCP servers and write a report, working with many different LLM providers and search tools.
- 13

kimi-cli
11.4KMoonshotAI/kimi-cli · PythonKimi CLI is an AI agent that runs in the terminal, helping you read and edit code, execute shell commands, search and fetch web pages, and autonomously plan and adjust actions while completing software development tasks.
- 14

opensquilla
7.1KTokenRhythm/opensquilla · PythonOpenSquilla is a token-efficient, microkernel AI agent that uses a local model router to send each conversation turn to the cheapest model that can handle it, while sharing memory, a sandbox, and web search across its CLI, Web UI, and chat-channel interfaces.
- 15

anysearch-skill
6.6Kanysearch-ai/anysearch-skill · PythonAnySearch is a skill you install into an AI agent that turns it into a real-time web researcher: on demand, the agent can run web searches and pull full-page content from URLs.
- 16

MathModelAgent
6.2Kjihe520/MathModelAgent · TeXAn open-source AI agent for mathematical modeling competitions: it analyzes the problem, builds the model, writes and debugs the code, and produces a formatted paper ready for submission.
- 17

wigolo
5.5KKnockOutEZ/wigolo · TypeScriptwigolo is a local-first web toolkit for AI coding agents: one surface for search, fetch, crawl, extraction, caching, find-similar, and research, served over MCP, REST, SDKs, and a CLI. No API keys, no cloud, $0 per query.
- 18
mgrep
4.4Kmixedbread-ai/mgrep · TypeScriptmgrep is a CLI tool that lets you semantically search your code, PDFs, images, and text using natural language, instead of relying on exact grep-style patterns.
- 19

skills
4.2Kdavidondrej/skills · ShellA collection of reusable Agent Skills - focused workflow packages for AI coding, research, and workflow agents, covering things like agent orchestration, skill authoring, web research, documentation, and dev-ops setup.
- 20

surf
3.6Kdeta/surf · TypeScriptDeta Surf is a personal AI notebook that brings your files and webpages into one place and lets you generate AI-written notes from them, so research and writing happen in the same stream instead of jumping between apps.
- 21

modelcontextprotocol
2.6Kperplexityai/modelcontextprotocol · TypeScriptIt's the official MCP server for the Perplexity API Platform, giving AI assistants real-time web search, reasoning, and research tools through Perplexity's Agent API and Search API.
- 22

open-glean
1.6Khydra-db/open-glean · TypeScriptOpen Glean is an open-source AI workspace built on Hydra DB: a 'second brain' you ask questions across your memories, files, and connected apps, with answers written from retrieved context and cited sources.
- 23
chatbot-template
1.2Kshadcn-ui/chatbot-template · TypeScriptA minimal chatbot template built with Next.js, the AI SDK, and shadcn/ui, wired up to run on the Vercel AI Gateway.
- 24
anysearch-dsh
534anysearch-team/anysearch-dsh · TypeScriptIt's a plugin that connects the AnySearch search API to DeepSeek Harness (DSH), giving agents real-time web search, cleaned page content extraction, vertical/specialized search, and concurrent batch search.
- 25

whirl
509whirlchat/whirl · TypeScriptWhirl is a full-stack AI chat app built on Next.js and Convex. It is the open-source code behind whirl.chat, routing conversations through OpenRouter to top models while adding memory, living documents, and tool integrations.
- 26

dsh-free-search
483DDDMUC/dsh-free-search · JavaScriptdsh-free-search is a plugin for DeepSeek Harness (dsh) that adds multiple free web search providers (DuckDuckGo, Bing, SearXNG and more) so agents can search the web without the official paid DeepSeek API key.
- 27

dsh-commandcode-provider
409Mars-Sea/dsh-commandcode-provider · TypeScriptThis is an unofficial plugin that adds Command Code as an LLM provider inside DeepSeek Harness (dsh), giving dsh access to Command Code's live model catalog, plan-aware model selection, reasoning effort control, image input, web search, and multi-account support.
- 28

Rikkahub-Revised
217YaeNovin/Rikkahub-Revised · KotlinRikkahub Revised is an Android AI chat client for talking to LLM providers - an independent, community-maintained modified distribution of RikkaHub, currently at release 2.4.8-revised.7.
Related topics
Often tagged together