skill-recorder README

The project's README from github.com/microsoft/skill-recorder. As one markdown file: README.md.

Skill Recorder

Record yourself doing a task once, then turn it into a skill your AI agent can repeat.

Skill Recorder captures a real work session on your screen: the clicks, the app and window switches, the pages you visit, and (if you want) your spoken narration. It then uses the GitHub Copilot CLI to reconstruct what you actually did as a clear intent plus an ordered list of steps. From there, one step turns that single run into something an agent can reuse:

Both prefer the agent's native tools (like the gh CLI or web_fetch) over replaying UI clicks, and generalize from your one example, so recording yourself submitting one form can teach the agent to submit all of them.

Skill Recorder capture window: a record button, timer, an optional narration toggle with language and microphone settings, and readiness checks    Skill Recorder sessions view: recorded sessions on the left, the reconstructed intent and ordered steps on the right

How it works

  1. 🔴 Record. Hit record (or ⌘⇧R / Ctrl+Shift+R from anywhere) and just do your task. Skill Recorder captures your screen and activity locally, in the background.
  2. 🎛️ Control. While recording, a small always-on-top bar shows capture and microphone state. Mute, unmute, or switch mics on the fly, then finish, or discard (with a confirmation) if the take didn't go to plan.
  3. 🧠 Analyze. Click Analyze and GitHub Copilot reconstructs one overall intent and an ordered list of steps. Review and edit until it reads right.
  4. ✨ Create. From an approved analysis, generate a reusable Skill and/or a scheduled Automation.

Get started

Skill Recorder is published as a source release: one command downloads a pinned Node.js runtime, builds the exact release commit on your machine, and adds a Skill Recorder (Source) app you can relaunch anytime. Nothing is installed globally. You'll need a GitHub account with Copilot access; the Copilot CLI ships with the app.

macOS is the primary target. Windows 11 (x64 and ARM64) is supported too (see WINDOWS-VALIDATION.md).

Install it

Open the latest release and copy the command for your platform. Each release pins an exact commit, so the real command looks like the patterns below with <40-character-release-commit> filled in.

macOS / Ubuntu

commit="<40-character-release-commit>"; curl -fsSL "https://raw.githubusercontent.com/microsoft/skill-recorder/$commit/install.sh" | SKILL_RECORDER_COMMIT="$commit" bash

The commit pins both the downloaded script and the source it builds. To keep the app running after the terminal closes, add SKILL_RECORDER_DETACHED=1 after the pipe:

commit="<40-character-release-commit>"; curl -fsSL "https://raw.githubusercontent.com/microsoft/skill-recorder/$commit/install.sh" | SKILL_RECORDER_COMMIT="$commit" SKILL_RECORDER_DETACHED=1 bash

On macOS this adds a Skill Recorder (Source) app to ~/Applications (relaunch from Spotlight, Launchpad, or the Dock). On Ubuntu it adds a matching application entry.

Windows (PowerShell)

$commit="<40-character-release-commit>"; $env:SKILL_RECORDER_COMMIT=$commit; irm "https://raw.githubusercontent.com/microsoft/skill-recorder/$commit/install.ps1" | iex

This adds Skill Recorder (Source) shortcuts to your desktop and Start Menu.

Then record

  1. Grant Screen Recording. On first launch, macOS asks for Screen Recording permission; grant it and you're ready to record.
  2. Record, Analyze, Create. Do your task, then Analyze. The first time you Analyze, Skill Recorder offers Sign in to Copilot if you aren't signed in yet.

To inspect the script before running it, set install options, update, or uninstall, see INSTALL.md.

⚠️ Keep secrets out of your recordings. Don't record, type, paste, or narrate passwords, tokens, API keys, or other confidential info. Choosing Analyze sends recording data to GitHub's cloud. Skill Recorder reminds you before every recording. Details in What gets captured.

Everything below is for people who want the details, or want to hack on the code.

What gets captured

Recording, storage, frame extraction, and optional narration transcription all happen on your computer; nothing leaves while you record. Only when you choose Analyze does Skill Recorder send the event timeline (window/document titles, URLs, and clipboard previews), extracted screen images, and narration text to GitHub's cloud for Copilot to process.

The in-app "Records your screen and activity" panel spells out exactly what's collected:

⚠️ Please don't capture secrets. Passwords, access tokens, API keys, credentials, and other confidential information should never be recorded, typed, pasted, shown, copied, or narrated during a session.

Develop from source

Requires Node.js 24. After checking out a release revision:

npm ci
npm run compliance:licenses
npm run dev

npm run dev starts Vite and launches the Electron app with hot-reload; ⌘⇧R (macOS) / Ctrl+Shift+R (Windows) toggles recording from anywhere. Full manual setup, the build and dist scripts, and the licensing boundary between local source builds and redistributable packages are in INSTALL.md. Maintainers changing versions, dependencies, assets, or releases must follow RELEASING.md.

Evals

The Copilot describer and builders have a fixture-based eval suite; see evals/README.md.

npm run eval            # score the describer against synthetic recordings
npm run eval:builder    # score the skill/automation generalization

Documentation

Security

Please don't report security vulnerabilities through public GitHub issues. See SECURITY.md for Microsoft's coordinated-disclosure process and reporting channels.

Support

File bugs and feature requests through GitHub Issues (search existing issues first to avoid duplicates). Support is limited to the resources described in SUPPORT.md.

License

MIT

Contributing

This project welcomes contributions and suggestions. Most contributions require you to agree to a Contributor License Agreement (CLA) declaring that you have the right to, and actually do, grant us the rights to use your contribution. For details, visit Contributor License Agreements.

When you submit a pull request, a CLA bot will automatically determine whether you need to provide a CLA and decorate the PR appropriately (e.g., status check, comment). Simply follow the instructions provided by the bot. You will only need to do this once across all repos using our CLA.

This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact [email protected] with any additional questions or comments.

Trademarks

This project may contain trademarks or logos for projects, products, or services. Authorized use of Microsoft trademarks or logos is subject to and must follow Microsoft's Trademark & Brand Guidelines. Use of Microsoft trademarks or logos in modified versions of this project must not cause confusion or imply Microsoft sponsorship. Any use of third-party trademarks or logos are subject to those third-party's policies.

skill-recorder (microsoft/skill-recorder)

Searching Database…

4.2K ·GitHub
Skill-recorder
Что это?Skill Recorder — десктоп-приложение, которое записывает, как вы один раз выполняете задачу на экране, а затем с помощью GitHub Copilot CLI превращает запись в переиспользуемый Skill или запланированную Automation, которую может запустить ИИ-агент.
Это десктоп-приложение или облачный сервис?Это десктоп-приложение на Electron, которое локально записывает ваш экран, переключения окон и (по желанию) голосовые комментарии; в сеть оно обращается только когда вы явно нажмёте Analyze.
Как установить его и начать запись?Откройте последний GitHub-релиз и скопируйте команду установки для своей платформы; она скачает закреплённый рантайм Node.js, соберёт коммит этого релиза на вашей машине и добавит приложение 'Skill Recorder (Source)', которое можно перезапустить. Затем выдайте разрешение Screen Recording и жмите запись.
Нужна ли подписка GitHub Copilot для этого?Да, нужен GitHub-аккаунт с доступом к Copilot; сам Copilot CLI идёт в комплекте с приложением, отдельно устанавливать его не нужно.
Что происходит с моей записью, когда я нажимаю Analyze?Нажатие Analyze отправляет таймлайн событий (заголовки окон/документов, URL, фрагменты буфера обмена), извлечённые кадры экрана и текст голосовых комментариев в облако GitHub на обработку Copilot, поэтому никогда не записывайте пароли, токены и другие секреты.
Он работает и на Windows и на Linux, или только на Mac?Основная платформа — macOS, но Windows 11 (x64 и ARM64) полностью поддерживается, а установочный скрипт также добавляет запись приложения в Ubuntu.
Покидают ли данные с моего экрана компьютер до того, как я решу их проанализировать?Нет, захват, хранение и даже расшифровка голоса происходят полностью на устройстве; данные покидают компьютер только когда вы сами нажмёте Analyze.
В чём разница между Skill и Automation здесь?Skill — это процедура в SKILL.md, которую агент запускает по запросу, а Automation запускает ту же восстановленную процедуру по расписанию или триггеру.
Голосовой комментарий расшифровывается в облаке?Нет, голос расшифровывается на устройстве через Whisper, поддерживается 99 языков, при первом использовании однократно скачивается модель ~252 МБ.
Какие агенты Microsoft реально могут использовать созданные Skills?Созданные Skills и Automations рассчитаны на запуск в Microsoft Autopilots: Scout, Microsoft Copilot Cowork или Copilot Studio.
Как начать и остановить запись?Нажмите Cmd+Shift+R на macOS или Ctrl+Shift+R на Windows откуда угодно, либо используйте поверх всех окон панель управления во время записи, чтобы заглушить звук, сменить микрофон, завершить или отменить дубль.
What are similar projects?clawd-on-desk, skills, ClawX, vicoa, brag, awesome-copilot, LobsterAI, pi-gui
Which topics is it in?screen-recording, copilot, whisper, github-copilot, electron, skill, agent-skills, productivity, react, desktop-app, automation, ai-agents
Creator
microsoft
Size
6.2 MB
Stars
4.2K
Updated
CommitSep 21Releasev0.7.0Sep 21
Age
2mo
Commits · 90 Days