Topics / #web-search

Web-search projects on GitHub

Search engines, web scraping search and search-enabled agents.

As of , the most-starred Web-search projects on GitHub are firecrawl (192.8K stars), odysseus (93.9K stars) and last30days-skill (64.7K stars). GitHub.Locker tracks 28 Web-search repositories with 640.5K stars combined. The fastest-growing on October 17 was firecrawl, with +311 stars in a day.

28Projects
640.5KStars in total
+801Stars in a day

Hot right now

Most stars gained in a day · Oct 17

The all-time top

28 projects · by stars

  1. #1 · firecrawl/firecrawl

    firecrawl

    Firecrawl turns any website into clean, LLM-ready data by crawling, scraping, and searching the web, delivering markdown, structured JSON, or screenshots that AI agents can consume directly.

    192.8K
  2. #2 · odysseus-dev/odysseus

    odysseus

    Odysseus is a self-hosted AI workspace that bundles chat, agents, deep research, a document editor, email, notes, tasks, and calendar around local or API models.

    93.9K
  3. #3 · mvanhorn/last30days-skill

    last30days-skill

    It is an AI agent skill that researches any topic across Reddit, X, YouTube, Hacker News, Polymarket, TikTok, Instagram, GitHub, arXiv, Techmeme, LinkedIn and more in parallel, then has an AI judge synthesize the results into one grounded brief ranked by real engagement (upvotes, likes, betting odds) instead of SEO.

    64.7K
  1. 4

    LibreChat

    45.9KLibreChat-AI/LibreChat · TypeScript

    LibreChat is a self-hosted AI chat platform that unifies all major AI providers (OpenAI, Anthropic, Google, AWS Bedrock, Azure, Mistral, OpenRouter and more) in a single ChatGPT-like interface, with Agents, MCP support, Code Interpreter and Artifacts built in.

  2. 5

    onyx

    32.6Konyx-dot-app/onyx · Python

    Onyx is an open source AI platform that gives you a full-featured chat interface on top of any LLM, with built-in RAG, web search, agents, and more.

  3. 6

    Scrapegraph-ai

    31.9KScrapeGraphAI/Scrapegraph-ai · Python

    ScrapeGraphAI is a Python web scraping library that uses LLMs and direct graph logic to build scraping pipelines for websites and local documents (XML, HTML, JSON, Markdown). You just say which information you want to extract and it does the rest.

  4. 7

    gpt-researcher

    30.2Kassafelovic/gpt-researcher · Python

    An open-source autonomous agent that runs deep research on any task across the web and your local documents, producing detailed, factual research reports with citations.

  5. 8

    claude-code

    22.9Kclaude-code-best/claude-code · TypeScript

    Claude Code Best (CCB) is a full open-source engineering reconstruction of Anthropic's official Claude Code CLI agent — buildable, runnable and debuggable — extended with extra features like goal-driven workflows, multi-agent orchestration, voice input and computer/browser control, while keeping full compatibility with the original Claude Code configuration.

  6. 9

    DeepResearch

    20.1KAlibaba-NLP/DeepResearch · Python

    Tongyi DeepResearch — an open-source agentic LLM from Alibaba's Tongyi Lab, built for long-horizon, deep information-seeking on the web. This repo ships the model weights plus Python inference and benchmark evaluation scripts.

  7. 10

    gemini-fullstack-langgraph-quickstart

    18.3Kgoogle-gemini/gemini-fullstack-langgraph-quickstart · Jupyter Notebook

    Google's fullstack quickstart for building research agents: a React frontend over a LangGraph backend powered by Gemini, which searches the web, reflects on gaps and returns answers with citations.

  8. 11

    maxun

    17.9Kgetmaxun/maxun · TypeScript

    Maxun is an open-source no-code web data platform that turns any website into structured, reliable data: it handles extraction, crawling, scraping, search and AI-powered data extraction.

  9. 12

    open_deep_research

    12.7Klangchain-ai/open_deep_research · Python

    Open Deep Research is a simple, configurable, fully open-source deep research agent that can research a topic across the web and MCP servers and write a report, working with many different LLM providers and search tools.

  10. 13

    kimi-cli

    11.4KMoonshotAI/kimi-cli · Python

    Kimi CLI is an AI agent that runs in the terminal, helping you read and edit code, execute shell commands, search and fetch web pages, and autonomously plan and adjust actions while completing software development tasks.

  11. 14

    opensquilla

    7.1KTokenRhythm/opensquilla · Python

    OpenSquilla is a token-efficient, microkernel AI agent that uses a local model router to send each conversation turn to the cheapest model that can handle it, while sharing memory, a sandbox, and web search across its CLI, Web UI, and chat-channel interfaces.

  12. 15

    anysearch-skill

    6.6Kanysearch-ai/anysearch-skill · Python

    AnySearch is a skill you install into an AI agent that turns it into a real-time web researcher: on demand, the agent can run web searches and pull full-page content from URLs.

  13. 16

    MathModelAgent

    6.2Kjihe520/MathModelAgent · TeX

    An open-source AI agent for mathematical modeling competitions: it analyzes the problem, builds the model, writes and debugs the code, and produces a formatted paper ready for submission.

  14. 17

    wigolo

    5.5KKnockOutEZ/wigolo · TypeScript

    wigolo is a local-first web toolkit for AI coding agents: one surface for search, fetch, crawl, extraction, caching, find-similar, and research, served over MCP, REST, SDKs, and a CLI. No API keys, no cloud, $0 per query.

  15. 18

    mgrep

    4.4Kmixedbread-ai/mgrep · TypeScript

    mgrep is a CLI tool that lets you semantically search your code, PDFs, images, and text using natural language, instead of relying on exact grep-style patterns.

  16. 19

    skills

    4.2Kdavidondrej/skills · Shell

    A collection of reusable Agent Skills - focused workflow packages for AI coding, research, and workflow agents, covering things like agent orchestration, skill authoring, web research, documentation, and dev-ops setup.

  17. 20

    surf

    3.6Kdeta/surf · TypeScript

    Deta Surf is a personal AI notebook that brings your files and webpages into one place and lets you generate AI-written notes from them, so research and writing happen in the same stream instead of jumping between apps.

  18. 21

    modelcontextprotocol

    2.6Kperplexityai/modelcontextprotocol · TypeScript

    It's the official MCP server for the Perplexity API Platform, giving AI assistants real-time web search, reasoning, and research tools through Perplexity's Agent API and Search API.

  19. 22

    open-glean

    1.6Khydra-db/open-glean · TypeScript

    Open Glean is an open-source AI workspace built on Hydra DB: a 'second brain' you ask questions across your memories, files, and connected apps, with answers written from retrieved context and cited sources.

  20. 23

    chatbot-template

    1.2Kshadcn-ui/chatbot-template · TypeScript

    A minimal chatbot template built with Next.js, the AI SDK, and shadcn/ui, wired up to run on the Vercel AI Gateway.

  21. 24

    anysearch-dsh

    534anysearch-team/anysearch-dsh · TypeScript

    It's a plugin that connects the AnySearch search API to DeepSeek Harness (DSH), giving agents real-time web search, cleaned page content extraction, vertical/specialized search, and concurrent batch search.

  22. 25

    whirl

    509whirlchat/whirl · TypeScript

    Whirl is a full-stack AI chat app built on Next.js and Convex. It is the open-source code behind whirl.chat, routing conversations through OpenRouter to top models while adding memory, living documents, and tool integrations.

  23. 26

    dsh-free-search

    483DDDMUC/dsh-free-search · JavaScript

    dsh-free-search is a plugin for DeepSeek Harness (dsh) that adds multiple free web search providers (DuckDuckGo, Bing, SearXNG and more) so agents can search the web without the official paid DeepSeek API key.

  24. 27

    dsh-commandcode-provider

    409Mars-Sea/dsh-commandcode-provider · TypeScript

    This is an unofficial plugin that adds Command Code as an LLM provider inside DeepSeek Harness (dsh), giving dsh access to Command Code's live model catalog, plan-aware model selection, reasoning effort control, image input, web search, and multi-account support.

  25. 28

    Rikkahub-Revised

    217YaeNovin/Rikkahub-Revised · Kotlin

    Rikkahub Revised is an Android AI chat client for talking to LLM providers - an independent, community-maintained modified distribution of RikkaHub, currently at release 2.4.8-revised.7.

Often tagged together