14.9K ·GitHub
What is this?
A self-hosted monitoring system for Xianyu (闲鱼, China's largest secondhand marketplace) that scrapes listings with Playwright and uses AI to analyze and filter products in real time or on a schedule, with a full web management UI.
A self-hosted monitoring system for Xianyu (闲鱼, China's largest secondhand marketplace) that scrapes listings with Playwright and uses AI to analyze and filter products in real time or on a schedule, with a full web management UI.Is this a command-line scraper or a full web application?It's a full self-hosted web application: a FastAPI backend plus a built web frontend, with Playwright running headless in the background to scrape and analyze listings.
It's a full self-hosted web application: a FastAPI backend plus a built web frontend, with Playwright running headless in the background to scrape and analyze listings.How do I get it running?The recommended way is Docker Compose with the prebuilt image (ghcr.io/usagi-org/ai-goofish:latest), which bundles Chromium. For manual setup, run ./start.sh, which checks for Playwright/Chromium, installs dependencies, builds the frontend, and starts the FastAPI backend.
The recommended way is Docker Compose with the prebuilt image (ghcr.io/usagi-org/ai-goofish:latest), which bundles Chromium. For manual setup, run ./start.sh, which checks for Playwright/Chromium, installs dependencies, builds the frontend, and starts the FastAPI backend.Do I need an OpenAI-style API key and what else is required?Yes — you must set OPENAI_API_KEY, OPENAI_BASE_URL, and OPENAI_MODEL_NAME (a model that accepts image input) for AI analysis. For non-Docker setup you also need Python 3.10+, Node.js/npm, and the Playwright CLI with Chromium.
Yes — you must set OPENAI_API_KEY, OPENAI_BASE_URL, and OPENAI_MODEL_NAME (a model that accepts image input) for AI analysis. For non-Docker setup you also need Python 3.10+, Node.js/npm, and the Playwright CLI with Chromium.What's the catch before I can start monitoring?You first need to export your Xianyu login session as a cookie/JSON file using a Chrome extension and import it in Account Management before any task will actually run.
You first need to export your Xianyu login session as a cookie/JSON file using a Chrome extension and import it in Account Management before any task will actually run.What AI providers can I use for analysis?Any OpenAI-compatible API endpoint with a vision-capable model works, since OPENAI_BASE_URL and OPENAI_MODEL_NAME are configurable — this covers providers like OpenAI or Gemini-compatible gateways.
Any OpenAI-compatible API endpoint with a vision-capable model works, since OPENAI_BASE_URL and OPENAI_MODEL_NAME are configurable — this covers providers like OpenAI or Gemini-compatible gateways.What notification channels can alert me about matches?ntfy.sh, Bark, WeCom (企业微信), Telegram, Gotify, and generic Webhook are all supported out of the box.
ntfy.sh, Bark, WeCom (企业微信), Telegram, Gotify, and generic Webhook are all supported out of the box.Can I run multiple searches at the same time?Yes, each task has its own keywords, price range, filters, and AI prompt, and tasks can run concurrently with independent account bindings.
Yes, each task has its own keywords, price range, filters, and AI prompt, and tasks can run concurrently with independent account bindings.Does it handle proxy or account failures automatically?Yes — it supports a rotating proxy pool with retry limits and blacklist TTL, plus automatic task pausing after a configurable number of consecutive failures.
Yes — it supports a rotating proxy pool with retry limits and blacklist TTL, plus automatic task pausing after a configurable number of consecutive failures.What are similar projects?openfang, TrendRadar, PanWatch, daily_stock_analysis, evenfire, tinyagi, any-auto-register, LangBot
openfang, TrendRadar, PanWatch, daily_stock_analysis, evenfire, tinyagi, any-auto-register, LangBotWhich topics is it in?webhook, ecommerce, ai-assistant, ai-tools, fastapi, playwright, telegram, web-scraping, multimodal, openai-compatible, gemini, sqlite
webhook, ecommerce, ai-assistant, ai-tools, fastapi, playwright, telegram, web-scraping, multimodal, openai-compatible, gemini, sqlite