What is this?
Omi is an open-source AI that captures your screen and conversations, transcribes them in real time, and turns them into summaries, action items and a chat that remembers everything you've seen and heard. It works on desktop, phone and wearables.
Omi is an open-source AI that captures your screen and conversations, transcribes them in real time, and turns them into summaries, action items and a chat that remembers everything you've seen and heard. It works on desktop, phone and wearables.So is it an app, a gadget, or a whole platform?All three: a macOS/Windows desktop app, a Flutter mobile app for iOS and Android, a Python cloud backend, plus open-source wearable hardware — the Omi necklace and an Omi Glass dev kit on ESP32-S3 — that pair with the phone.
All three: a macOS/Windows desktop app, a Flutter mobile app for iOS and Android, a Python cloud backend, plus open-source wearable hardware — the Omi necklace and an Omi Glass dev kit on ESP32-S3 — that pair with the phone.How do I get the desktop app running on my Mac?Run the macOS Quick Start build: it compiles the app from source and launches it against Omi's cloud backend — no env files, no credentials, no local backend. You need macOS 14+, Xcode and Node.js.
Run the macOS Quick Start build: it compiles the app from source and launches it against Omi's cloud backend — no env files, no credentials, no local backend. You need macOS 14+, Xcode and Node.js.Do I need to buy the Omi necklace for any of this to work?No — the desktop app captures your screen and audio on its own. The Omi necklace or Glass add continuous 24h+ capture by pairing with the mobile app, so the hardware is an optional upgrade.
No — the desktop app captures your screen and audio on its own. The Omi necklace or Glass add continuous 24h+ capture by pairing with the mobile app, so the hardware is an optional upgrade.Can I run everything on my own backend instead of Omi's cloud?The quick-start apps are built to talk to Omi's hosted cloud backend; hosting the full backend yourself (Python, FastAPI, Firebase) is a separate local-development setup with more prerequisites to install and configure.
The quick-start apps are built to talk to Omi's hosted cloud backend; hosting the full backend yourself (Python, FastAPI, Firebase) is a separate local-development setup with more prerequisites to install and configure.I'm on Windows — is there a version for me?Yes, a Windows desktop app runs from source using the public config in .env.example; only Node.js is required.
Yes, a Windows desktop app runs from source using the public config in .env.example; only Node.js is required.What happens to all the screen and audio data it captures?The README doesn't spell out its data handling. By default the apps send captures to Omi's cloud backend, and since the entire stack is open source you can audit exactly what leaves your device.
The README doesn't spell out its data handling. By default the apps send captures to Omi's cloud backend, and since the entire stack is open source you can audit exactly what leaves your device.Can developers build their own apps or integrations on top of Omi?Yes — there are device SDKs in Python, Swift and React Native, a shared BLE protocol SDK for TS, Go, Rust, C++ and Dart, an MCP server, and example apps like GitHub and Slack integrations. Open-source AI personas are built on Next.js.
Yes — there are device SDKs in Python, Swift and React Native, a shared BLE protocol SDK for TS, Go, Rust, C++ and Dart, an MCP server, and example apps like GitHub and Slack integrations. Open-source AI personas are built on Next.js.What's inside the repo?A macOS app in Swift/SwiftUI with a Python desktop backend, a Flutter mobile app for iOS and Android, a FastAPI + Firebase backend, nRF/Zephyr firmware in C for the necklace, ESP32-S3 firmware for Omi Glass, and a Next.js personas web app.
A macOS app in Swift/SwiftUI with a Python desktop backend, a Flutter mobile app for iOS and Android, a FastAPI + Firebase backend, nRF/Zephyr firmware in C for the necklace, ESP32-S3 firmware for Omi Glass, and a Next.js personas web app.What is the Omi Glass dev kit?An ESP32-S3 board with camera and audio that you can buy or build yourself — the hardware designs are open source, and the repo includes guides for building the device and flashing its firmware.
An ESP32-S3 board with camera and audio that you can buy or build yourself — the hardware designs are open source, and the repo includes guides for building the device and flashing its firmware.What are similar projects?sonicloud_opensdk, nobodywho, openhaystack, vicoa, EnvoyMesh, OpenPocketCine, EchoMuse, nomily-app
sonicloud_opensdk, nobodywho, openhaystack, vicoa, EnvoyMesh, OpenPocketCine, EchoMuse, nomily-appWhich topics is it in?bluetooth, esp32, transcription, ai-assistant, swiftui, flutter, speech-to-text, firmware, fastapi, react-native, hardware, app
bluetooth, esp32, transcription, ai-assistant, swiftui, flutter, speech-to-text, firmware, fastapi, react-native, hardware, app