A virtual companion with long-term memory and a Bilibili stream key

What it does

VirtualWife is a virtual digital human system that wraps a large language model inside a customizable VRM avatar. It supports long-term and short-term memory backed by Milvus, text-driven facial expressions and body movements, Chinese voice synthesis via Edge or Bert-VITS2, and can broadcast the interaction live on Bilibili. The author describes it as an incubation-stage project aimed at creating an AI companion that can act as a friend, counselor, or dating coach.

The interesting bit

The roadmap reveals ambitions beyond simple chat: planned features include associative memory with a forgetting mechanism, LoRA fine-tuning of RWKV for specific personality archetypes like tsundere or mature lady, and a reflection module that lets the character self-upgrade through planning. It is unclear how much of this is implemented versus aspirational, but the memory module and emotional emergence sections suggest the author is thinking in terms of cognitive architecture rather than just prompt engineering.

Key highlights

• Swappable VRM models from the Vroid marketplace give the avatar its visual identity.
• Memory stack uses Milvus for long-term storage, with streaming responses for lower latency.
• Supports multiple LLM backends, including OpenAI and the local option Ollama.
• Voice pipeline supports both Microsoft Edge TTS and Bert-VITS2 for Chinese dialogue.
• Ships with Docker-based deployment and Bilibili live-streaming support.

Caveats

• The README labels the project as incubation-stage and admits there is plenty left to optimize.
• Several roadmap features—including associative memory, tone and speed control, and LoRA-based personality fine-tuning—are either pending or crossed out, so the current feature set is narrower than the vision.

Verdict

Developers curious about embodied AI, VTuber pipelines, or Chinese-language LLM companions should take a look; anyone needing a polished, production-ready agent framework should wait for the incubation dust to settle.