The Open-Source Quest to Bottle a Neuro-sama in Your Browser

Project AIRI is an open-source 'soul container' that uses web-native technologies to let users own, run, and interact with AI-driven virtual characters across browsers, desktops, and mobile devices.
The Ghost of Neuro-sama
Neuro-sama, the AI VTuber who plays games, chats, and streams, proved that a synthetic personality could hold an audience. But she is a black box: when the stream ends, the entity vanishes. Project AIRI exists to solve that disappearance. Its explicit mission is to recreate that experience as an ownable, always-available “soul container” — a cyber waifu or digital pet that lives on your devices, not on someone else’s server schedule.

This is not merely a chatbot with a pretty face. The project frames itself as a response to the limitations of Character.ai, SillyTavern, and JanitorAI: they handle roleplay, but they do not play Minecraft with you, watch your screen, or sit in a Discord voice channel while you code. The hype spike is easy to trace. The rise of Neuro-sama created a demand for personal, autonomous digital companions that can game, chat, and perceive. A HuggingFace discussion thread on replicating such a “streaming buddy” notes that the core difficulty lies not in finding models, but in software engineering: real-time pipelines, model integration, and network processing. AIRI arrives as one of the most ambitious attempts to package that entire pipeline into something a user can actually download and run.
A Web-Native Soul
What genuinely distinguishes AIRI from the crowded field of open-source AI VTubers is its architectural bet: it is web-native from the ground up. While projects like Open-LLM-VTuber build on traditional desktop stacks, AIRI constructed its body from WebGPU, WebAudio, Web Workers, WebAssembly, and WebSockets. The result is a virtual character that can render in a modern browser tab, run as a PWA on a phone, and still masquerade as a desktop application.
This choice is less about fashion and more about distribution. The browser is the only truly universal runtime. By building the graphics layer, layout engine, and animation system on web technologies, AIRI achieves cross-platform reach — Windows, macOS, Linux, mobile — without maintaining separate UI codebases for each. The project even distributes through winget, Scoop, Homebrew Cask, and Nix, but the underlying artifact is essentially a webview with teeth.
The obvious objection is performance. Web tech carries overhead, and AI workloads are greedy. AIRI’s answer is a hybrid: the desktop build delegates heavy inference to native GPU backends, using HuggingFace’s candle framework to tap NVIDIA CUDA and Apple Metal directly, without the dependency hell that often accompanies local ML. The browser handles the face — Live2D and VRM models, auto-blinking, idle eye movement — while the metal handles the mind. It is a pragmatic split: web for portability and presentation, native for compute.
When Your Companion Can Play Factorio
Where AIRI pushes beyond the typical “talking head” VTuber is in its agentic capabilities. The project does not want to be a chat interface; it wants to be a participant. It already ships with the ability to play Minecraft and Factorio, with Kerbal Space Program support announced and Helldivers 2 co-play in progress. It can join Discord and Telegram voice channels, perform client-side speech recognition, and synthesize voice through ElevenLabs.
This is the “digital human” pitch in practice. The entity has ears, a mouth, a body, and a brain that can reason about game state via LLM providers. The supported provider list is vast — OpenAI, Anthropic, DeepSeek, vLLM, Ollama, Groq, and dozens more — powered by the project’s own xsai SDK, a lightweight alternative to the Vercel AI SDK. The ambition is to make the character an interface to your digital life, not just a conversational ornament.
The sub-projects reveal the scope of the vision: unspeech acts as a proxy layer for ASR and TTS endpoints; Velin uses Vue SFC and Markdown to manage stateful prompts; and an MCP Launcher aims to make tool-use servers as easy to spin up as Ollama models. This is platform thinking, not just character engineering.
Early Days and Rough Edges
For all its architectural ambition, AIRI is candid about its immaturity. The documentation carries a warning that the project is in an early stage. Several headline features are checked off only partially or marked WIP. Pure in-browser local inference via WebGPU remains unfinished. The long-term memory system, branded “Memory Alaya,” is a work in progress; current memory relies on DuckDB WASM or pglite in the browser, which is a start but not a persistent, reflective memory architecture. Co-play for Helldivers 2 is not yet ready. Even some LLM provider integrations are awaiting community pull requests.
Compared to Open-LLM-VTuber, which offers mature offline operation, long-term memory via Letta, visual perception through camera and screen recording, and live-streaming integration with BiliBili, AIRI’s current feature surface is thinner in places. Open-LLM-VTuber’s documentation describes a desktop pet mode with transparent background and global top-most presence — a polished user experience that AIRI has not yet fully matched. AIRI’s advantage is its web-first portability and gaming agent integration, but it is still assembling its pieces.
The Outlook: A Container, Not a Character
Project AIRI’s most interesting bet is that the future of AI companions is not a single character, but a container for many. The “soul container” framing suggests a runtime where different personalities, games, and platforms plug into the same substrate. The web-tech foundation supports this: a browser-based engine can be extended with new stages, new UI components, and new server-side agents without rebuilding the binary.
The project is aggressively recruiting across disciplines — Live2D modellers, VRM designers, computer vision researchers, reinforcement learning engineers, speech specialists. It has built a multilingual community and a translation project on Crowdin. The presence on ProductHunt and Trendshift indicates an awareness that it is competing for attention in a space that includes corporate offerings and better-established open-source rivals.
Whether AIRI succeeds depends on whether it can close the gap between its architectural promise and its current feature checklist. The web-native approach is genuinely distinctive, but distinctive architecture does not stream games by itself. If the team can deliver on local WebGPU inference, a robust memory system, and the plugin ecosystem they are sketching out, they will have built something more than a Neuro-sama tribute: a general-purpose runtime for autonomous digital beings. For now, it is one of the more structurally inventive attempts in a field that is still figuring out how to keep a digital soul online after the stream ends.
Sources
- AIRI - Association of Independent Research Institutes
- An AI streaming "buddy" like Neuro-sama - Beginners
- voicechat2 - An open source, fast, fully local AI voicechat using WebSockets
- AIRI Institute
- Open-LLM-VTuber
- Self-hosted Voice AI
- Running Open-LLM-VTuber: Interactive AI Avatar on Minimum ...
- I Built a Voice-Controlled AI Assistant on My Phone — No APIs Required
- AIRI
- Project Overview | Open LLM Vtuber
- Knovuapp: Self-Hosted Voice AI Agents for Your Business | Ultravox ...
- Momoi Airi | Project SEKAI Wiki - Fandom