Desktop AI Companion with Eyes, Ears, and Mood Swings

What it does

LingChat is a Rust-based desktop companion that fronts GPT-style conversations with animated characters, voice synthesis, and a persistent memory system tied to individual save slots. You supply your own LLM and optional vision API keys; the app renders replies through a visual-novel-style UI with mood-aware bubbles, outfits, and click-to-interact touches. It also bundles a pomodoro timer, schedule, and to-do list that the AI can reference when reminding you what you should be doing.

The interesting bit

The developer trained a custom 18-class emotion classifier that sits between the LLM and the frontend, so the avatar’s expressions, animations, and sound effects shift with the AI’s detected mood. More unusually, an optional vision mode lets the AI periodically capture your screen to guess whether you are working, gaming, or idle—giving the bot ambient awareness of your actual desktop activity.

Key highlights

• Self-trained model classifies 18 emotional states to drive real-time changes in visuals, animations, and audio cues.
• Optional VITS-based voice synthesis; GPU generates clips in about a second, while integrated or old CPUs can take a minute each.
• Supports custom characters, multi-role scripted scenes, per-save persistent memory, and outfit swapping.
• Vision mode allows the AI to “peek” at your screen on demand or proactively to comment on your activity.
• Runs on 32-bit Windows 7 and aging CPUs, though the README notes an Intel Atom Z540 can need seven to nine minutes just to start.

Caveats

• Windows Defender frequently quarantines the executable as a false positive.
• The built-in loader can hang indefinitely, forcing you to open the app via localhost:8765 in a browser instead.
• Restarting requires manually killing both the frontend and backend; otherwise characters may vanish and saves can corrupt.
• Without a discrete GPU, voice synthesis is slow enough to be impractical, and P3-gamut monitors render the UI with a gray cast.

Verdict

A niche fit for developers who want a hackable, highly customizable AI desktop pet and can tolerate BYOK API wrangling and occasional process hunts. Everyone looking for a polished, zero-config consumer app should keep scrolling.