Record your screen and make Copilot write the playbook

What it does

Skill Recorder is an Electron desktop app that captures your screen, window switches, browser URLs, clipboard snippets, and optional voice narration while you work. When you choose to analyze a session, it sends the timeline to GitHub Copilot, which reconstructs your actions as a clear intent plus an ordered list of steps. From there, you can generate a reusable SKILL.md or a scheduled Automation for Microsoft Scout, Copilot Cowork, or Copilot Studio.

The interesting bit

Instead of replaying clicks like brittle RPA, Copilot generalizes the recording into native tool calls—using the gh CLI or web_fetch where possible—so one recorded form submission can teach an agent to handle all of them. Recording, storage, and on-device Whisper transcription stay local; only the analysis step hits GitHub’s cloud.

Key highlights

• Local-first capture: screen video, app tracking, and optional narration transcription (via a one-time ~252 MB Whisper model download) happen entirely on your machine.
• Intent extraction: Copilot reconstructs an overall intent and step list from the raw activity timeline, preferring native tools over UI automation.
• Generalizes from one example: a single session becomes a reusable Skill or a trigger-based Automation.
• Global hotkeys: toggle recording from anywhere with ⌘⇧R or Ctrl+Shift+R.
• macOS is the primary target; Windows 11 x64 and ARM64 are also supported.

Caveats

• You need an active GitHub Copilot subscription; the CLI ships with the app, but analysis requires cloud access.
• It ships as a source release that builds on your machine rather than a polished binary, and macOS is the primary target.
• The README warns explicitly to keep passwords, tokens, and secrets out of recordings because choosing Analyze sends your timeline and screen images to GitHub.

Verdict

Try it if you are building agent workflows and want to bootstrap procedures by simply doing the task once. Look elsewhere if you need a turnkey binary or do not have Copilot access.