Outsource Your Crawlers to Gemini, Grok, and Doubao
Query eight AI search engines at once and let each platform scrape its own data silo—Douyin via Doubao, X via Grok—so you never maintain a crawler again.

What it does
AI Search Hub is an open-source Skill that treats commercial AI platforms as a distributed search fleet. You ask one question; it dispatches the query to Gemini, Grok, Doubao, Yuanbao, Kimi, and others, then returns a unified result stream to your agent or workflow. Hand it a URL and the same platforms will extract, clean, and structure the content for you.
The interesting bit
The project’s real trick is data arbitrage. Instead of writing fragile crawlers for WeChat public accounts, Douyin, or Bilibili, it simply asks Tencent’s Yuanbao or ByteDance’s Doubao to search their own backyards. The README carries a browser-driven badge, so it appears to automate the web UIs of these platforms rather than calling pristine APIs.
Key highlights
- Currently orchestrates eight providers: Gemini, Grok, Doubao, Yuanbao, LongCat, Tongyi Qianwen, MiniMax, and Kimi.
- Maps each platform to its home-turf data: Grok for X/Twitter, Doubao for Douyin, Yuanbao for WeChat, MiniMax for Bilibili.
- Designed as a plug-in Skill for agent frameworks like OpenClaw, Claude Code, and Cursor.
- Also ingests arbitrary links and delegates reading, de-noising, and structuring to the platforms.
- Future slots reserved for Perplexity, Claude, and Wenxin Yiyan.
Caveats
- The “browser-driven” badge suggests it relies on web UI automation, which trades one kind of fragility for another.
- Several headline platforms (Perplexity, Claude, Wenxin Yiyan) are listed as “Future” and not yet wired up.
- The README pitches this as “free” data access, but the long-term viability depends on the tolerance of automated browser sessions by each platform.
Verdict Worth a look if you’re building agents that need Chinese social data or cross-platform sentiment without maintaining a crawler farm. Skip it if you need guaranteed API stability or deep result merging logic beyond simple aggregation.
Frequently asked
- What is minsight-ai-info/AI-Search-Hub?
- Query eight AI search engines at once and let each platform scrape its own data silo—Douyin via Doubao, X via Grok—so you never maintain a crawler again.
- Is AI-Search-Hub open source?
- Yes — minsight-ai-info/AI-Search-Hub is an open-source project tracked on heatdrop.
- What language is AI-Search-Hub written in?
- minsight-ai-info/AI-Search-Hub is primarily written in Python.
- How popular is AI-Search-Hub?
- minsight-ai-info/AI-Search-Hub has 1.2k stars on GitHub.
- Where can I find AI-Search-Hub?
- minsight-ai-info/AI-Search-Hub is on GitHub at https://github.com/minsight-ai-info/AI-Search-Hub.