← all repositories

lucasjinreal/weibo_terminater

A Weibo web scraper that collects posts, comments, and followers to build NLP training corpora.

2.3k stars Python Data Tooling
weibo_terminater
Not currently ranked — collecting fresh signals.
star history

This repository provides a Python-based scraper for Weibo (Chinese social media platform) that collects posts, comments, user followers, and other content. It is described as an NLP corpus preparation tool, intended to gather text data for natural language processing research. The tool uses Selenium with Firefox geckodriver to navigate Weibo pages and extract content. While the author has moved to autonomous driving work, they maintain the project for corpus collection purposes.

Frequently asked

What is lucasjinreal/weibo_terminater?
A Weibo web scraper that collects posts, comments, and followers to build NLP training corpora.
Is weibo_terminater open source?
Yes — lucasjinreal/weibo_terminater is an open-source project tracked on heatdrop.
What language is weibo_terminater written in?
lucasjinreal/weibo_terminater is primarily written in Python.
How popular is weibo_terminater?
lucasjinreal/weibo_terminater has 2.3k stars on GitHub.
Where can I find weibo_terminater?
lucasjinreal/weibo_terminater is on GitHub at https://github.com/lucasjinreal/weibo_terminater.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.