8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.
Global
A high-throughput and memory-efficient inference and serving engine for LLMs
#181 · +242 · 1d ·GitHub
JiuwenSwarm is an intelligent AI Agent built on openJiuwen. It extends the powerful capabilities of large language models directly to your fingertips through various communication apps you use daily.
#259 · +172 · 1d ·GitHub
《深入理解 AI Agent：设计原理与工程实践》（李博杰 著）开源主仓库：全书正文、编译版 PDF 与按章配套代码
Search your computer by what's in your files: photos, PDFs, documents, recordings, videos and code. On-device on Mac, Windows and Linux, built on Google DeepMind's EmbeddingGemma 2.
#307 · +137 · 1d ·GitHub
8B to 27B: a calibrated probability for every option in one pass, and a short thought only when unsure. cpp and MLX.
#349 · +119 · 1d ·GitHub
《动手学大模型Dive into LLMs》系列编程实践教程
RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs
PaddleOCR converts PDF documents and images into structured, LLM-ready data (JSON/Markdown) with industry-leading accuracy.
Local UI to run and train LLMs and diffusion models. 8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.
#654 · +56 · 1d ·GitHub
🔍大模型应用开发实战一：RAG 技术全栈指南，在线阅读地址：
#670 · +54 · 1d ·GitHub
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
#702 · +51 · 1d ·GitHub
md and local files. yaml only adds optional UI metadata (display name, description, default prompt) for the ChatGPT/Codex skills UI, per OpenAI's skill spec — it does not limit the skill to OpenAI agents.
#743 · +48 · 1d ·GitHub
The Claude Cookbooks provide code and guides designed to help developers build with Claude, offering copy-able code snippets that you can easily integrate into your own projects.
#756 · +47 · 1d ·GitHub
Turn an idea into a directed video prompt. 0 Skill OS is an agent skill for planning shots, binding references and continuing from an accepted clip. Your video provider handles generation and its costs.
#782 · +45 · 1d ·GitHub
Modern documents increasingly contain diverse multimodal content—text, images, tables, equations, charts, and multimedia—that traditional text-focused RAG systems cannot effectively process.
#834 · +41 · 1d ·GitHub
AnythingLLM: The all-in-one AI app you were looking for.
#858 · +40 · 1d ·GitHub
Comprehensive open-source library of AI research and engineering skills for any AI model. Package the skills and your claude code/codex/gemini agent will be an AI research agent with full horsepower. Maintained by Orchestra Research.
Open Source framework for voice agents, multimodal apps, and realtime AI. Maintained by Daily and the community.
FreeVideo is a local inference engine for MiniMax H3 on consumer GPUs, built on OpenVDN's 8-step VDN-H3 model with Video DeltaNet's hybrid attention.
#1013 · +34 · 1d ·GitHub
5: Refresh RefMods updates the current Loader/Axis dropdowns from the RefMod folders without refreshing all ComfyUI models. Selections and connected inputs are preserved. The library's Refresh also updates that loader's dropdowns.
#1033 · +33 · 1d ·GitHub
3 GB model into memory. 35 GB core and FP16 KV cache in memory, then streams only the experts needed for each token from SSD. This is what lets the model run on Macs with 8 GB of RAM.
Once production starts, the work is split across several AI agents. Different parts of the video are made at the same time, and every shot is handed to a different agent to check. If something's wrong it goes back to be fixed, so it's not a one-shot generate-and-done.
Features: - Convert PDF, PNG, and JPEG based documents into clean Markdown - Support for equations, tables, handwriting, and complex formatting - Automatically removes headers and footers - Convert into text with a natural reading order, even in the presence of figures…
简体中文 · Configuration · Troubleshooting · Security · 🔍 ModSearch (the best free web search plugin for DSH)
High-performance · Lightweight · AI Native Video workspace. 面向 AI 时代的视频创作工作台。 在画布中，和Agent一起自由连接创意、模型与素材。
MiniCPM-V and MiniCPM-o are multimodal LLM series designed for strong performance and efficient deployment on devices. MiniCPM-V focuses on efficient vision-language understanding across image, video and text inputs.
DeepEval is a simple-to-use, open-source LLM evaluation framework, for evaluating large-language model systems. It is similar to Pytest but specialized for unit testing LLM apps. , which use LLM-as-a-judge and other NLP models that run locally on your machine.
Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode.
#1206 · +27 · 1d ·GitHub
下图描述了单个监控任务从启动到完成的核心处理逻辑。主服务运行于 src.app，按用户操作或定时调度启动一个或多个任务进程。