PocketFlow README

The project's README from github.com/The-Pocket/PocketFlow. As one markdown file: README.md.

Pocket Flow – 100-line minimalist LLM framework

English | 中文 | Español | 日本語 | Deutsch | Русский | Português | Français | 한국어

License: MIT Docs

Pocket Flow is a 100-line minimalist LLM framework

Get started with Pocket Flow:

Why Pocket Flow?

Current LLM frameworks are bloated... You only need 100 lines for LLM Framework!

Abstraction App-Specific Wrappers Vendor-Specific Wrappers Lines Size
LangChain Agent, Chain Many
(e.g., QA, Summarization)
Many
(e.g., OpenAI, Pinecone, etc.)
405K +166MB
CrewAI Agent, Chain Many
(e.g., FileReadTool, SerperDevTool)
Many
(e.g., OpenAI, Anthropic, Pinecone, etc.)
18K +173MB
SmolAgent Agent Some
(e.g., CodeAgent, VisitWebTool)
Some
(e.g., DuckDuckGo, Hugging Face, etc.)
8K +198MB
LangGraph Agent, Graph Some
(e.g., Semantic Search)
Some
(e.g., PostgresStore, SqliteSaver, etc.)
37K +51MB
AutoGen Agent Some
(e.g., Tool Agent, Chat Agent)
Many [Optional]
(e.g., OpenAI, Pinecone, etc.)
7K
(core-only)
+26MB
(core-only)
PocketFlow Graph None None 100 +56KB

How does Pocket Flow work?

The 100 lines capture the core abstraction of LLM frameworks: Graph!


From there, it's easy to implement popular design patterns like (Multi-)Agents, Workflow, RAG, etc.


✨ Below are basic tutorials:
Name Difficulty Description
Chat ☆☆☆ Dummy A basic chat bot with conversation history
Structured Output ☆☆☆ Dummy Extracting structured data from resumes by prompting
Workflow ☆☆☆ Dummy A writing workflow that outlines, writes content, and applies styling
Agent ☆☆☆ Dummy A research agent that can search the web and answer questions
RAG ☆☆☆ Dummy A simple Retrieval-augmented Generation process
Batch ☆☆☆ Dummy A batch processor that translates markdown into multiple languages
Streaming ☆☆☆ Dummy A real-time LLM streaming demo with user interrupt capability
Chat Guardrail ☆☆☆ Dummy A travel advisor chatbot that only processes travel-related queries
Majority Vote ☆☆☆ Dummy Improve reasoning accuracy by aggregating multiple solution attempts
Map-Reduce ☆☆☆ Dummy Batch resume qualification using map-reduce pattern
CLI HITL ☆☆☆ Dummy A command-line joke generator with human-in-the-loop feedback
Multi-Agent ★☆☆ Beginner A Taboo word game for async communication between 2 agents
Supervisor ★☆☆ Beginner Research agent is getting unreliable... Let's build a supervision process
Parallel ★☆☆ Beginner A parallel execution demo that shows 3x speedup
Parallel Flow ★☆☆ Beginner A parallel image processing showing 8x speedup
Thinking ★☆☆ Beginner Solve complex reasoning problems through Chain-of-Thought
Memory ★☆☆ Beginner A chat bot with short-term and long-term memory
Text2SQL ★☆☆ Beginner Convert natural language to SQL queries with an auto-debug loop
Code Generator ★☆☆ Beginner Generate test cases, implement solutions, and iteratively improve code
MCP ★☆☆ Beginner Agent using Model Context Protocol for numerical operations
Agent Skills ★☆☆ Beginner Route requests to reusable markdown skills and apply them in an agent flow
A2A ★☆☆ Beginner Agent wrapped with A2A protocol for inter-agent communication
Streamlit FSM ★☆☆ Beginner Streamlit app with finite state machine for HITL image generation
FastAPI WebSocket ★☆☆ Beginner Real-time chat interface with streaming LLM responses via WebSocket
FastAPI Background ★☆☆ Beginner FastAPI app with background jobs and real-time progress via SSE
Voice Chat ★☆☆ Beginner An interactive voice chat application with VAD, STT, LLM, and TTS.
Judge ★☆☆ Beginner LLM-as-Judge evaluator-optimizer loop for iterative content refinement
Debate ★☆☆ Beginner Adversarial reasoning with two advocates and an impartial judge
Agentic RAG ★☆☆ Beginner Agent-driven RAG that decides which documents to read
Self-Healing Mermaid ★☆☆ Beginner Generate Mermaid diagrams with automatic error recovery
Heartbeat ★☆☆ Beginner ClawBot-like always-on periodic monitoring with nested flows
Lead Generation ★★☆ Intermediate Sales pipeline: scrape, enrich, score, and personalize emails
Newsletter ★★☆ Intermediate AI newsletter curation: search, filter, summarize, and format
Invoice Processing ★★☆ Intermediate Extract and validate invoice data from PDFs using vision
NotebookLM ★★☆ Intermediate Turn documents into a podcast with two AI hosts
Deep Research ★★☆ Intermediate Recursive map-reduce research with iterative refinement
Coding Agent ★★★ Advanced Production coding agent with 6 tools, memory, and patch-as-subflow

👀 Want to see other tutorials for dummies? Create an issue!

How to Use Pocket Flow?

🚀 Through Agentic Coding—the fastest LLM App development paradigm-where humans design and agents code!


IMAGE ALT TEXT

✨ Below are examples of more complex LLM Apps:

App Name Difficulty Topics Human Design Agent Code
Website Chatbot
Turn your website into a 24/7 customer support genius
★★☆
Medium
Agent
RAG
Design Doc Flow Code
Danganronpa Simulator
Forget the Turing test. Danganronpa, the ultimate AI experiment!
★★★
Advanced
Workflow
Agent
Design Doc Flow Code
Codebase Knowledge Builder
Life's too short to stare at others' code in confusion
★★☆
Medium
Workflow Design Doc Flow Code
Build Cursor with Cursor
We'll reach the singularity soon ...
★★★
Advanced
Agent Design Doc Flow Code
Ask AI Paul Graham
Ask AI Paul Graham, in case you don't get in
★★☆
Medium
RAG
Map Reduce
TTS
Design Doc Flow Code
Youtube Summarizer
Explain YouTube Videos to you like you're 5
★☆☆
Beginner
Map Reduce Design Doc Flow Code
Cold Opener Generator
Instant icebreakers that turn cold leads hot
★☆☆
Beginner
Map Reduce
Web Search
Design Doc Flow Code

PocketFlow (The-Pocket/PocketFlow)

workflow-engine
Searching Database…

What is this?Pocket Flow is a minimalist 100-line LLM framework built around a single Graph abstraction, letting you build agents, workflows, and RAG pipelines without heavy dependencies or vendor lock-in.
Is it a full-blown LLM framework like LangChain, or something leaner?It's a bare-bones framework, not an app: the entire engine is 100 lines of code implementing one Graph abstraction, zero bloat and zero dependencies, versus LangChain's 405K lines or CrewAI's +173MB footprint shown in the project's own comparison table.
How do I add it to a project?Install it, or just copy the 100-line source file straight into your codebase - there's no real package to configure since the core is small enough to vendor directly.
Do I need any other LLM libraries to use it?No, PocketFlow has zero dependencies by design; you bring your own LLM client calls and plug them into the Graph yourself.
Does it come with ready-made app or vendor wrappers like other frameworks?No, the project's own comparison table shows PocketFlow has no app-specific wrappers (e.g., QA, Summarization) and no vendor-specific wrappers (OpenAI, Pinecone, etc.), unlike LangChain or CrewAI, so you implement those patterns yourself on top of the Graph abstraction.
What is 'Agentic Coding'?It's PocketFlow's intended workflow where humans design the system via a Design Doc and AI coding agents like Cursor AI write the actual flow code, aiming for a stated 10x productivity boost.
Is PocketFlow only usable from Python?The core framework is Python, but the project also maintains ports in TypeScript, Java, C++, Go, Rust, and PHP.
What can I build with it out of the box?The repo ships dozens of tutorials and example apps covering chatbots, RAG, multi-agent games, map-reduce batch jobs, text-to-SQL, voice chat, and production coding agents, ranging from Dummy to Advanced difficulty.
Is there a community around it?Yes, there's a Discord server for developers building with PocketFlow and a YouTube channel showing how several example apps were built using agentic coding.
Creator
The-Pocket
Size
50.6 MB
Stars
11.3K
Updated
CommitJul 26
Age
1y
Commits · 90 Days