Topics / #caching

Caching projects on GitHub

Caching layers and in-memory stores that speed up applications and pipelines.

As of , the most-starred Caching projects on GitHub are system-design-101 (90.5K stars), rtk (83.7K stars) and redis (76.9K stars). GitHub.Locker tracks 90 Caching repositories with 1.9M stars combined. The fastest-growing on October 16 was awesome-system-design-resources, with +161 stars in a day.

90Projects
1.9MStars in total
+1.1KStars in a day
Browse in the catalog →github.com/topics/caching ↗

Hot right now

Most stars gained in a day · Oct 16

+161

awesome-system-design-resources

ashishps1/awesome-system-design-resources · ★ 42.4K

A free, curated collection of System Design resources: core concepts, networking and API fundamentals, database and caching basics, distributed systems patterns, and a huge list of interview problems, books, courses, and papers — all aimed at prepping for System Design interviews.

+149

solo_jev

0814wdwd/solo_jev · ★ 622

SOLO reorders the rows and fields of a dataset so an LLM decision backend with prefix caching can reuse computation across requests, running a natural-language decision over every row while returning results in the original row order.

+144

billion-context

ranxianglei/billion-context · ★ 1.5K

billion-context is a context-compression proxy that sits between any coding agent and its model API, rewriting Anthropic/OpenAI streams so a 100K context window is enough and a single session can run for months across billions of tokens.

+118

rtk

rtk-ai/rtk · ★ 83.7K

rtk is a CLI proxy that filters and compresses command outputs before they reach your LLM context, cutting 60-90% of the bash output your coding agent reads and lowering token costs.

The all-time top

90 projects · by stars

  1. #1 · ByteByteGoHq/system-design-101

    system-design-101

    A free, visual collection of short explainers and cheat sheets covering core system design concepts (APIs, databases, caching, message queues, real-world company architectures) to help you understand how production systems work and prepare for system design interviews.

    90.5K
  2. #2 · rtk-ai/rtk

    rtk

    rtk is a CLI proxy that filters and compresses command outputs before they reach your LLM context, cutting 60-90% of the bash output your coding agent reads and lowering token costs.

    83.7K
  3. #3 · redis/redis

    redis

    Redis is an in-memory server used as a cache, data structure store, and document/vector query engine for building real-time, data-driven applications.

    76.9K
  1. 4

    headroom

    75.5Kheadroomlabs-ai/headroom · Python

    Headroom compresses everything an AI agent reads - tool outputs, logs, RAG chunks, files, and conversation history - before it reaches the LLM, cutting tokens while keeping the same answers. It ships as a library, a local proxy, and an MCP server.

  2. 5

    superset

    75.2Kapache/superset · Python

    Apache Superset is a modern, enterprise-ready business intelligence web application for data exploration and visualization: build dashboards, charts, and query data with a built-in SQL editor.

  3. 6

    awesome-scalability

    74.8Kbinhnguyennus/awesome-scalability

    A curated, continuously updated reading list of articles, case studies, and talks from engineers at companies like Netflix, Uber, Facebook, and Amazon, showing concrete patterns for building scalable, reliable, and performant large-scale systems.

  4. 7

    architect-awesome

    60.8Kxingshaocheng/architect-awesome

    A curated technical roadmap in Chinese for backend engineers aiming to become architects, mapping out data structures, algorithms, concurrency, databases, middleware, and system design.

  5. 8

    awesome-system-design-resources

    42.4Kashishps1/awesome-system-design-resources · Java

    A free, curated collection of System Design resources: core concepts, networking and API fundamentals, database and caching basics, distributed systems patterns, and a huge list of interview problems, books, courses, and papers — all aimed at prepping for System Design interviews.

  6. 9

    yarn

    41.5Kyarnpkg/yarn · JavaScript

    Yarn 1.x is a fast, reliable and secure dependency manager for JavaScript projects — a command-line tool that installs your project's packages as an alternative to npm.

  7. 10

    glide

    35Kbumptech/glide · Java

    A fast, efficient open source media management and image loading framework for Android: it wraps media decoding, memory and disk caching, and resource pooling behind a simple interface.

  8. 11

    czkawka

    34.3Kqarmin/czkawka · Fluent

    Czkawka is a multi-functional Rust app for finding and cleaning duplicate files, empty folders, similar images/videos/music, broken files, temporary files and more on your disk.

  9. 12

    awesome-php

    32.8Kziadoz/awesome-php

    A curated list of amazingly awesome PHP libraries, resources, frameworks and tools, organized by category.

  10. 13

    agent-skills

    32.5Kvercel-labs/agent-skills · JavaScript

    This is Vercel's official collection of reusable 'skills' - packaged instructions and scripts - that give AI coding agents expertise on specific tasks like Vercel cost/performance audits, React and Next.js best practices, UI design review, writing style review, and claimable Vercel deployments.

  11. 14

    TradingAgents-CN

    32.3Khsliuping/TradingAgents-CN · Python

    TradingAgents-CN is a Chinese-enhanced learning and research platform built on a multi-agent LLM trading framework, helping Chinese-speaking users systematically study stock analysis using multiple AI agents for A-share, Hong Kong, and US markets. It explicitly does not issue real trading orders and is positioned for education and research only.

  12. 15

    nginx

    31.9Knginx/nginx · C

    NGINX ('engine x') is a free, open source web server, load balancer, reverse proxy, API gateway and content cache — described as the world's most popular web server.

  13. 16

    dragonfly

    31.8Kdragonflydb/dragonfly · C++

    An in-memory data store built as a modern replacement for Redis and Memcached — fully compatible with both APIs, so no code changes needed; it claims 25X more throughput on up to 80% fewer resources.

  14. 17

    turborepo

    31.2Kvercel/turborepo · Rust

    Turborepo is a high-performance build system for JavaScript and TypeScript codebases (especially monorepos), written in Rust — its README now introduces it as 'the build system for coding agents'.

  15. 18

    spring-boot-examples

    30.5Kityouknow/spring-boot-examples · Java

    A collection of small, standalone Spring Boot 3.0 example projects covering common integrations like web, WebFlux, JPA, MyBatis, RabbitMQ, MongoDB, Redis, mail, file upload, and Docker.

  16. 19

    hutool

    30.2Kchinabugotech/hutool · Java

    Hutool calls itself 'a set of tools that keep Java sweet': a rich, easy-to-use Java utility library whose tool classes help you get everyday development tasks done quickly.

  17. 20

    nx

    29.4Knrwl/nx · TypeScript

    Nx is a monorepo platform for TypeScript and polyglot codebases. It caches what didn't change, runs only the tasks affected by your edits, and comes with an integrated CI solution; the core is built with Rust for performance.

  18. 21

    nginxconfig.io

    28.3Kdigitalocean/nginxconfig.io · JavaScript

    A free web-based NGINX configuration generator by DigitalOcean: you pick what your server needs and it produces a tuned config for your use case.

  19. 22

    pingora

    27.6Kcloudflare/pingora · Rust

    Pingora is a Rust framework by Cloudflare for building fast, reliable, and programmable network services and proxies. It is battle-tested, having served more than 40 million internet requests per second for years.

  20. 23

    valkey

    27.4Kvalkey-io/valkey · C

    Valkey is an open-source, high-performance data structure server for key/value workloads like caching and other realtime use cases. It ships a wide range of native structures plus a plugin system for adding new ones.

  21. 24

    SDWebImage

    25.6KSDWebImage/SDWebImage · Objective-C

    SDWebImage is an asynchronous image downloader with memory and disk caching for Apple apps, integrated as a category on UI elements like UIImageView and UIButton — you give it a URL and it loads, caches and displays the image.

  22. 25

    colly

    25.6Kgocolly/colly · Go

    Colly is a scraping and crawling framework for Go: a clean interface for writing any kind of crawler, scraper or spider that extracts structured data from websites, for things like data mining, processing or archiving.

  23. 26

    Kingfisher

    24.4Konevcat/Kingfisher · Swift

    A lightweight, pure-Swift library for downloading and caching images from the web in iOS, macOS, tvOS, watchOS and visionOS apps — you give it a URL and it fetches, caches and displays the image.

  24. 27

    omlx

    22.9Kjundot/omlx · Python

    oMLX is a local LLM inference server for Apple Silicon Macs. It serves text LLMs, vision models, OCR, embeddings and rerankers with continuous batching and a tiered KV cache, managed from the macOS menu bar.

  25. 28

    go-redis

    22.3Kredis/go-redis · Go

    The official Redis client library for Go: you import it into your Go program to talk to Redis servers. It targets the last three Redis releases and speaks both RESP2 and RESP3.

  26. 29

    datasets

    22.1Khuggingface/datasets · Python

    A lightweight Python library from Hugging Face that gives one-line dataloaders for a huge catalog of ready-to-use public datasets on the HF Hub, plus fast, reproducible preprocessing for Hub and local data.

  27. 30

    lazy.nvim

    21.7Kfolke/lazy.nvim · Lua

    lazy.nvim is a modern plugin manager for Neovim. It installs and updates your plugins, shows them in a built-in UI, and keeps startup fast through automatic caching, bytecode compilation and lazy-loading.

  28. 31

    GSYVideoPlayer

    21.5KCarGuo/GSYVideoPlayer · Java

    GSYVideoPlayer is an open-source Android video player library that wraps several playback kernels — IJKPlayer, Media3 (ExoPlayer2), MediaPlayer and AliPlayer — behind one API, with caching, danmaku, subtitles, filters and ad support built in.

  29. 32

    cube

    21Kcube-js/cube · Rust

    An open-source semantic layer: define metrics, dimensions, joins and access rules once in code, and it serves them through SQL, REST and GraphQL APIs to BI tools, custom apps and AI agents.

  30. 33

    apollo-client

    19.8Kapollographql/apollo-client · TypeScript

    Apollo Client is a GraphQL client library for JavaScript and TypeScript apps, providing caching, data fetching, and state management for apps built with React, Vue, Angular, or vanilla JS.

  31. 34

    reselect

    19Kreduxjs/reselect · TypeScript

    A small library for creating memoized selector functions that derive computed data from your state. Best known with Redux, where it lets the store keep the minimal possible state, but it works with any plain JS immutable data too.

  32. 35

    picasso

    18.8Ksquare/picasso · Kotlin

    Picasso is an image downloading and caching library for Android, built by Square to simplify loading images from network, resources, or disk into views.

  33. 36

    system-design-resources

    18.5KInterviewReady/system-design-resources

    A curated collection of the best System Design resources on the Internet — one README that organizes engineering writeups, papers and talks into a topic-by-topic reading list.

  34. 37

    dxvk

    18.3Kdoitsujin/dxvk · C++

    DXVK is a Vulkan-based translation layer for Direct3D 8, 9, 10 and 11. It lets 3D applications and games run on Linux under Wine by translating D3D calls to Vulkan instead of using Wine's built-in wined3d.

  35. 38

    verdaccio

    17.9Kverdaccio/verdaccio · TypeScript

    A lightweight, zero-config private npm registry that you host yourself. It ships with its own tiny built-in database and can proxy and cache other registries such as npmjs.org.

  36. 39

    caffeine

    17.9Kben-manes/caffeine · Java

    Caffeine is a high-performance, near-optimal in-memory caching library for Java with a Guava-inspired API.

  37. 40

    node-redis

    17.6Kredis/node-redis · TypeScript

    Node-Redis is a modern, high performance Redis client for Node.js — the library your JavaScript or TypeScript app uses to talk to a Redis server, with support for Redis Stack modules like JSON, Search and Time-Series.

  38. 41

    fresco

    17.2Kfacebook/fresco · Kotlin

    Fresco is an Android library that handles loading and displaying images, including network, local storage, and local resource images, while managing the memory they consume.

  39. 42

    7days-golang

    17Kgeektutu/7days-golang · Go

    A learning repository that walks you through rebuilding four Go projects from scratch in seven days each: a gin-like web framework (Gee), a groupcache-like distributed cache (GeeCache), a gorm/xorm-like ORM (GeeORM), and a net/rpc-like RPC framework (GeeRPC), plus some Go WebAssembly demos.

  40. 43

    Android-Universal-Image-Loader

    16.8Knostra13/Android-Universal-Image-Loader · Java

    Universal Image Loader (UIL) is a Java library for Android that loads, caches and displays images. It offers lots of configuration options and fine control over the loading and caching process.

  41. 44

    dagger

    16.3Kdagger/dagger · Go

    Dagger is an open-source engine for automating software delivery: it builds, tests and ships any codebase, reliably and at scale.

  42. 45

    router

    15.2KTanStack/router · TypeScript

    TanStack Router is a modern router for the web built around end-to-end type safety — routes, params, loaders and search params are all checked. The repo also hosts TanStack Start, a full-stack framework built on top of the router.

  43. 46

    got

    15Ksindresorhus/got · TypeScript

    Got is a human-friendly and powerful HTTP request library for Node.js, offering a Promise API, streams, pagination, caching, retries, hooks and more.

  44. 47

    pansou

    14.9Kfish2018/pansou · Go

    PanSou is a high-performance API service for searching netdisk (cloud drive) share links. It concurrently searches Telegram channels and custom plugins, then classifies and ranks the results by drive type.

  45. 48

    hapi

    14.8Khapijs/hapi · JavaScript

    hapi (@hapi/hapi) is a Node.js web framework for building powerful, scalable applications with minimal overhead and full out-of-the-box functionality — 'your code, your way'.

  46. 49

    juicefs

    14.5Kjuicedata/juicefs · Go

    JuiceFS is a distributed POSIX file system that stores data in object storage (like S3) and metadata in a database engine (like Redis), letting you use massive cloud storage as if it were a local disk.

  47. 50

    cheatsheets

    14.5Krstacruz/cheatsheets · TypeScript

    Devhints is a big collection of cheatsheets for web developers, published as a website at devhints.io - it calls itself 'TL;DR for developer documentation'.

  48. 51

    memcached

    14.3Kmemcached/memcached · C

    Memcached is a high-performance, multithreaded, event-based key/value cache store designed for use in distributed systems.

  49. 52

    YYKit

    14Kibireme/YYKit · Objective-C

    YYKit is a large collection of iOS components, bundling several independent libraries for high-performance model mapping, caching, image loading/decoding, rich text rendering, keyboard tracking and async drawing.

  50. 53

    redis-py

    13.7Kredis/redis-py · Python

    redis-py is the official Python client for the Redis key-value store — the interface your Python code uses to talk to a Redis server.

  51. 54

    dataloader

    13.4Kgraphql/dataloader · JavaScript

    DataLoader is a generic utility for a Node.js application's data fetching layer that batches and caches requests to backends (like databases or web services), reducing the number of round-trips needed.

  52. 55

    groupcache

    13.3Kgolang/groupcache · Go

    groupcache is a distributed caching and cache-filling library for Go, built as a replacement for a pool of memcached nodes in many cases.

  53. 56

    codis

    13.2KCodisLabs/codis · Go

    Codis is a proxy-based, high-performance Redis cluster solution written in Go — it sits between your application and a pool of Redis servers. It is production-ready and widely used at wandoujia.com and many other companies.

  54. 57

    gateway

    13.2KPortkey-AI/gateway · TypeScript

    An open-source AI gateway that routes your requests to 1,600+ language, vision, audio and image models across 45+ providers through one fast, friendly API, with guardrails, caching, retries and fallbacks built in.

  55. 58

    htaccess

    13.2Kphanan/htaccess

    A curated collection of useful .htaccess snippets for Apache, covering rewrites/redirects, security, performance, and miscellaneous tricks.

  56. 59

    workbox

    13KGoogleChrome/workbox · JavaScript

    Workbox is a collection of JavaScript libraries for Progressive Web Apps: it provides tools and strategies for caching web assets, managing service workers, and handling offline scenarios.

  57. 60

    claude-relay-service

    12.7KWei-Shaw/claude-relay-service · JavaScript

    Claude Relay Service (CRS) is a self-hosted relay/proxy you run yourself to access Claude (plus OpenAI/Codex, Gemini CLI, and Droid) through your own server, letting you manage multiple accounts and share subscription costs with friends.

  58. 61

    jedis

    12.4Kredis/jedis · Java

    Jedis is a Java client library for Redis, built for performance and ease of use so Java applications can talk to Redis servers, clusters, or Redis Enterprise deployments.

  59. 62

    LMCache

    12.1KLMCache/LMCache · Python

    LMCache is a KV cache management layer for LLM inference that turns the KV cache from a temporary, per-process state into reusable, persistent 'AI-native knowledge' that can be shared across serving engines, reducing time-to-first-token and boosting throughput for long-context, multi-turn, and RAG workloads.

  60. 63

    garnet

    12.1Kmicrosoft/garnet · C#

    Garnet is a remote cache-store from Microsoft Research: a key-value server that existing Redis clients can talk to, built for high throughput, low latency, persistence, and cluster sharding.

  61. 64

    VasSonic

    11.8KTencent/VasSonic · Java

    VasSonic (Sonic for short) is a lightweight, high-performance hybrid framework from Tencent's VAS team that speeds up the first screen of websites loaded in hybrid apps on Android and iOS.

  62. 65

    awesome-software-architecture

    11.7Kmehdihadeli/awesome-software-architecture · TypeScript

    A curated catalog of articles, videos, courses, books, and other resources for learning and practicing software architecture, patterns, and principles, covering everything from design patterns and DDD to cloud, distributed systems, and AI engineering.

  63. 66

    nitro

    11.3Knitrojs/nitro · TypeScript

    Nitro is a server toolkit that extends your Vite app with a production-ready server you can add routes to and deploy anywhere.

  64. 67

    thumbor

    10.5Kthumbor/thumbor · Python

    Thumbor is an open-source HTTP image service that crops, resizes, transforms and optimizes photos on-demand, using AI for smart face/feature-based cropping.

  65. 68

    practical-aspnetcore

    10.4Kdodyg/practical-aspnetcore · C#

    A very large collection of small, runnable ASP.NET Core sample projects covering versions 2.1 through 11, organized by feature (MVC, Minimal API, Blazor, gRPC, SignalR, etc.) with README explanations for each.

  66. 69

    buildkit

    10.3Kmoby/buildkit · Go

    BuildKit is a Go toolkit for turning source code into build artifacts efficiently and repeatably — concurrent, cache-efficient and Dockerfile-agnostic. It is the engine docker build uses by default since Docker Engine 23.0.

  67. 70

    phpredis

    10.2Kphpredis/phpredis · C

    A PHP extension that gives PHP a fast API for talking to the Redis key-value store. It also works with Valkey, Dragonfly, and KeyDB, and is released under the PHP License 3.01.

  68. 71

    DnsServer

    10.1KTechnitiumSoftware/DnsServer · C#

    Technitium DNS Server is an open source, self-hosted DNS server that works as both an authoritative server and a recursive resolver. Its headline use is blocking ads and malware at the DNS level for an entire home or organization network, with configuration done in a web console.

  69. 72

    production-agentic-rag-course

    9.8Kjamwithai/production-agentic-rag-course · Python

    This is a hands-on, week-by-week course that teaches you to build 'arXiv Paper Curator', a production-grade Retrieval-Augmented Generation (RAG) system that fetches academic papers, indexes them, and answers research questions about them.

  70. 73

    bifrost

    8.9Kmaximhq/bifrost · Go

    An open-source, high-performance AI gateway that unifies 23+ LLM providers behind a single OpenAI-compatible API, with automatic failover, load balancing, semantic caching, and budget controls built in.

  71. 74

    The-Accidental-CTO

    3.9Ksubhashchy/The-Accidental-CTO · TypeScript

    This is 'The Accidental CTO', a story-driven system design handbook by Subhash Choudhary about scaling the Dukaan e-commerce platform from zero to over a million stores without a formal CS degree.

  72. 75

    vista

    2.3KMantitup-Org/vista · TypeScript

    Vista.js is a React 19 web framework with App Router style file conventions, React Server Components and streaming SSR, similar in spirit to Next.js but with a dual-engine build system.

  73. 76

    open-compute

    2Kelliothux/open-compute · Rust

    open-compute is a self-hosted platform that runs Cloudflare Workers code unchanged on hardware you control, reimplementing Workers, KV, D1, R2, Durable Objects, Queues, Workflows, Cron, Cache, Images, Vectorize and AI Search as a single Rust binary.

  74. 77

    Smartstore

    1.7Ksmartstore/Smartstore · C#

    Smartstore is a modular, open-source all-in-one eCommerce platform built on ASP.NET Core 10, offering a full storefront plus backend for managing a multi-language, multi-store, multi-currency online shop.

  75. 78

    billion-context

    1.5Kranxianglei/billion-context · TypeScript

    billion-context is a context-compression proxy that sits between any coding agent and its model API, rewriting Anthropic/OpenAI streams so a 100K context window is enough and a single session can run for months across billions of tokens.

  76. 79

    kache

    1.2Kkunobi-ninja/kache · Rust

    Kache is a compiler cache for Rust, C/C++, and CUDA. It keys every build by the content of its inputs, so code compiled once is restored instead of rebuilt in your next worktree, branch, or CI run.

  77. 80

    ai-system-design

    672amitshekhariitbhu/ai-system-design · Markdown

    A free, open-source guide that teaches AI System Design step by step: how to combine GPUs, inference servers, caches, vector databases, AI agents, guardrails, and evals into one system that is fast, cheap, reliable, and safe.

  78. 81

    solo_jev

    6220814wdwd/solo_jev · Python

    SOLO reorders the rows and fields of a dataset so an LLM decision backend with prefix caching can reuse computation across requests, running a natural-language decision over every row while returning results in the original row order.

  79. 82

    mr-boxington

    517jdx/mr-boxington · Rust

    mbx is a build cache for Rust projects. Cargo still resolves dependencies, plans builds and runs your tools; mbx restores matching compiler outputs from one shared store and only compiles the rest.

  80. 83

    dsh-free-search

    443DDDMUC/dsh-free-search · JavaScript

    dsh-free-search is a plugin for DeepSeek Harness (dsh) that adds multiple free web search providers (DuckDuckGo, Bing, SearXNG and more) so agents can search the web without the official paid DeepSeek API key.

  81. 84

    llm-inference-engineering

    344amitshekhariitbhu/llm-inference-engineering · Markdown

    A free, continuously growing blog series that teaches LLM inference engineering step by step, covering KV cache, PagedAttention, continuous batching, speculative decoding, and serving engines like vLLM, SGLang, TensorRT-LLM, and GGUF.

  82. 85

    3d-asset-server

    313arielshad/3d-asset-server · TypeScript

    3d-asset-server searches 19 different 3D asset sites at once (Poly Haven, ambientCG, BlenderKit, Kenney, and more) and downloads whatever you pick, ready to drop into a game or website.

  83. 86

    win11-storage-governance-kit

    188Nongfsq/win11-storage-governance-kit · Python

    A Codex Skills kit that turns a practical Windows 11 C-drive cleanup workflow into a reusable agent skill and reference runbook for governing storage (not just deleting files).

  84. 87

    morphnext

    179KickNext/morphnext · Dart

    morphnext is a Flutter library that turns built-in IconData glyphs into interruptible, spring-driven vector morphs between icons, without needing separate animation assets for each icon pair.

  85. 88

    toolrush

    157OnlyTerp/toolrush · Python

    ToolRush is a low-overhead execution layer plugin for Hermes Agent (Nous Research's agent harness) that eliminates the latency overhead of tool calls like file reads, searches, and terminal commands while keeping the same tools, outputs, and safety gates.

  86. 89

    omnibin

    145fzakaria/omnibin · Python

    omnibin is a FUSE-based lazy filesystem that puts every binary ever published across 13+ years of nixpkgs on your PATH, fetching each package's bytes from cache.nixos.org only when a file inside it is actually read.

  87. 90

    jevlint

    126codegirl-007/jevlint · Go

    Jevlint is a CLI linter that checks code against plain-language rules: it uses Tree-sitter to extract code units (functions, types, comments, fields, statements), then asks a configured AI decision backend called Jev whether each one passes.

Often tagged together