Feature map

Everything it does, and where each part stands

132 abilities, sorted under the seven verbs. This page is made from the app's own capability list, so it changes when the app does.

Capability list for build 0.15.93, 14 November 2026. "In the build" means the feature is in that build; testers have not yet checked every one on every phone. "Built" means the work is finished but has not been put into a build. "Planned" means it is on the list and not built; plans change. Ideas that are only ideas, and a few behind-the-scenes items that would mean nothing here, are not shown.

Learn

Find things out, and remember them.

11 in the build · 4 built · 7 planned

Sky and space

  • Sky and space (In the build)

    Sun, moon, planets, meteor showers, deep sky, ISS passes, satellites and dish pointing.

Ask and look up

  • How-to help (In the build)

    Step-by-step answers that fit your situation, and a YouTube search for a video.

  • Private networking guide (In the build)

    A built-in guide to Tailscale, WireGuard and other private networks.

  • Daily briefing (In the build)

    Weather, calendar and flagged items when you open Protean.

  • Help with what's on screen (In the build)

    Reads the app behind Protean and answers about it.

  • Knows its own settings (In the build)

    Reads Protean's settings and points at the right row.

  • Devices around you (In the build)

    Remembers the devices seen at a place, and names places for you.

  • What is this device? Planned

    Say "USB" to hear what's plugged in, what's on it and what Protean can do with it.

  • Deep research with sources Planned

    Longer research with sources you can check, and web search.

  • Model knowledge and usage dashboard Planned

    Model benchmarks, a warning when a setting raises cost or lowers ability, and a usage dashboard.

Notes and memory

  • Your notes (In the build)

    Search and read the notes in your vault.

  • Remember this (In the build)

    Saves what you ask it to remember, in its memory file or your notes.

  • Offer to file it (In the build)

    Offers to file a lasting fact in your vault; nothing is written until you tap.

  • Voice notes (In the build)

    Dictate a note, check it, then it files itself.

  • Locked notes Built, not in a build yet

    Encrypt chosen vault notes with a key in the phone's secure hardware.

  • Open locked notes in Obsidian Built, not in a build yet

    An Obsidian plugin that opens Protean's locked notes on your computer.

  • Saved sources Built, not in a build yet

    Keep sources and live page elements and refer back to them.

Behind the scenes

  • Data age on every card Built, not in a build yet

    Every card says how fresh its data is and where it came from.

  • Always aware Planned

    Records connects and disconnects, reads the phone's sensors, keeps a small live memory.

Knowledge base

  • Learn a topic Planned

    Learns a topic into an indexed vault knowledge base and recalls it first.

  • Learn a new device Planned

    Asks first, researches manuals and SDKs, writes a device knowledge base, then builds a panel.

  • Grows with use Planned

    Learns your routines and saves skills, measured and undone if worse.

Connect

Link it to your devices, computers, agents and accounts.

19 in the build · 12 built · 13 planned

Devices near you

  • Bluetooth gadgets (In the build)

    Find, connect and read Bluetooth LE sensors, meters and health devices.

  • Older Bluetooth devices (In the build)

    Car OBD-II adapters, GPS receivers, older meters and serial gear.

  • Headset and car audio (In the build)

    Protean talks and listens through your Bluetooth headset or car.

  • Keyboards, controllers and buttons (In the build)

    Headset, car or controller buttons start and stop talking; keys get jobs.

  • USB devices (In the build)

    See what you plugged in; button panels and USB input devices.

  • Wi-Fi and network devices (In the build)

    Smart-home hubs, ESPHome gadgets, 3D printers, printers, MQTT and Modbus.

  • NFC, UWB, IR and privileged features Planned

    The rest of the I/O stack, and Shizuku or root features with consent.

Computers and agents

  • Another Android device (In the build)

    Run commands, copy files and install apps over wireless debugging.

  • Your computer (Protean Companion) (In the build)

    Screen, mouse and keyboard, clipboard, shared folders and allowed commands.

  • Set up a computer (In the build)

    Kits for your own map server, routing, AI and Android tools on Windows, Linux or Mac.

  • Your Hermes agent (In the build)

    Hand jobs to your Hermes and read the answer; its board, profiles, models and health.

  • Agents that use Protean (In the build)

    Paired Hermes-style, MCP or OpenClaw clients use Protean's tools under the same rules.

  • Private network (In the build)

    Reach your own computers over Tailscale or another private network.

  • Deploy anywhere (In the build)

    Put Protean's parts, like your own map server, on your computer or a server.

  • Hermes and OpenClaw pass-through Built, not in a build yet

    Use your Hermes or OpenClaw as Protean's brain, through Protean.

  • SSH devices Built, not in a build yet

    A generic SSH device card with a secure key and host check; SSH for Coding with Protean.

  • Companion: KDE Connect-style extras Built, not in a build yet

    KDE Connect-style extras: Notifications, media, find my phone and more with your computer.

  • Companion: more for your computer Planned

    Power, second screen, GPU, relay, backup, tray and webcam.

  • Home Assistant add-on Planned

    A Protean add-on inside Home Assistant.

  • Several Hermes at once Planned

    Easy pairing for more than one Hermes, with an overview of them all.

Services

  • Plugins (In the build)

    Gmail, Google Calendar and Drive, Outlook, OneDrive, Notion and custom connectors.

  • Discord (In the build)

    Catch up on what Discord showed you; replies drafted for you to send.

  • Google sign-in (In the build)

    Sign in with Google for the official map account.

AI accounts

  • AI accounts (In the build)

    Bring your own key or server; pay-per-use needs your OK to bill.

  • Your own AI server (In the build)

    Use a home or local model server (Custom).

  • AI on this phone (In the build)

    Download and run a small model on the phone, with a heat guard.

  • Sign in with a plan you already have Built, not in a build yet

    All AI providers in one list; Sign in with OpenRouter; more key routes.

  • Claude through your own Claude Code Planned

    Use Claude through Claude Code on your home computer, if its terms allow.

  • Nous Portal Planned

    Nous Portal by API key, or your plan through your own Hermes.

Tools and instruments

  • Laser measures and floor plans Built, not in a build yet

    Bluetooth laser measures, a room walk and a 2D plan as PDF, SVG or DXF.

  • Thermal and inspection cameras Built, not in a build yet

    USB thermal cameras and borescopes: live view, hot spots, stills, report.

  • Electrical meters Built, not in a build yet

    Multimeter and clamp logging, readouts and a job PDF; live voltage needs your tap.

  • Car diagnostics Built, not in a build yet

    Codes in plain language, freeze frame, readiness, VIN and a report; never writes to the car.

  • GNSS and RTK receivers Built, not in a build yet

    Fix quality first, point logs, corrections and use as the phone's location.

  • Audio interfaces and MIDI Built, not in a build yet

    USB audio levels, USB and Bluetooth MIDI controllers, music app remote.

  • Health devices and Health Connect Built, not in a build yet

    Standard Bluetooth health readings saved to Health Connect; no diagnosis.

  • Boards and bench tools Built, not in a build yet

    Arduino and ESP32 with backups, SCPI supplies, GRBL and Marlin machines.

  • More OBD adapters Planned

    OBD adapters over USB serial, Bluetooth LE and Wi-Fi.

  • Chip programmers and debug probes Planned

    Read and back up first, then write and verify.

  • Logic analysers and USB scopes Planned

    Capture and decode signals.

  • Radio receivers (SDR) Planned

    Receive only; transmit stays off and legally gated.

  • Radios and buses Planned

    Mesh radio nodes, CAN, soldering irons, ham cables, lawful Flipper features.

  • Batteries and power stations Planned

    Detect a battery or power station and show it in a widget.

  • 3D scanning for printing and CNC Planned

Share

Send things out: posts, photos, reports.

2 in the build · 0 built · 4 planned

With a community

  • Protean's Discord bot (In the build)

    Your own bot: /gea commands and God's Eye alerts in your channels; you tap Post.

  • Contribute street photos (In the build)

    Send your street photos to Mapillary from Protean.

With people

  • Export an interface Planned

    Export a Protean panel and its control code as its own program.

  • Job paperwork and reports Planned

    Reports, labels and take-offs from your measurements and readings.

With the Protean project

  • Report a bug or suggest an idea Planned

    Reports go to the owner's server during the beta; asks before sending.

  • Open-source notices Planned

    Licences for the open-source parts, in Settings › About.

Map

The God's Eye map, directions, cameras, weather and fires.

13 in the build · 3 built · 11 planned

Around you

  • Nearest road camera (In the build)

    Shows the live road camera closest to you.

  • Cameras at a place (In the build)

    Up to five cameras at a city, street, intersection or landmark.

  • God's Eye view here (In the build)

    A small map of weather, cameras, fires and alerts around a spot.

  • Open your God's Eye map (In the build)

    Opens the full map you chose: your own or the official one.

  • Street photos (In the build)

    Street-level photos from Mapillary on the map, or open Google Street View.

  • Play a God's Eye scene Built, not in a build yet

    Find and replay a saved God's Eye View scene from chat.

  • Camera direction on the map Built, not in a build yet

    Each road camera's marker shows which way it looks.

Weather and fire

  • Fires near you (In the build)

    Satellite hotspots from the last day and fire outlines, each with its source.

  • How a fire has grown (In the build)

    Day-by-day fire map with growth and direction; nothing guessed between days.

  • Recent satellite pictures (In the build)

    Recent NASA pictures of an area.

  • Weather here (In the build)

    Weather now and the next hours, with a small map.

  • Weather on the real map Planned

    Radar loop, moving wind, lightning and storm shapes on the map.

Getting there

  • Directions (In the build)

    A route with road reports, cameras and weather along it; Google Maps or God's Eye (preview) guides.

  • Road ahead (In the build)

    Road reports, closures, weather and cameras along a route.

  • Call a local taxi (In the build)

    Lists local taxi companies; you press call.

  • Find-a-spot and geocaching Planned

    Remember where you parked or any spot, and geocaching tools.

On the water and in the air

  • Nautical information (In the build)

    Your position, buoys, marinas and vessels near the water.

  • Aircraft above me Planned

    Aircraft layer, what is above me, follow a plane.

  • Follow mode, ships and satellites Planned

    Follow mode, satellites on the map, Earth view, ships.

Maps and layers

  • Premium map plan (satellite and 3D) Built, switched off for now

    High-detail satellite and 3D map pictures through God's Eye View, metered.

  • Map catalogue Planned

    Every legal map kind, free and premium, in one place.

  • Plan-card map previews Planned

    See free and premium map looks before you choose.

  • Free topographic maps Planned

    Region-blended topo map layer, plus an optional self-hosted world topo.

  • Tilt, 3D buildings and terrain Planned

  • Richer answer cards and layers Planned

    Richer answer cards; fire zones with satellite layers at the right zoom.

  • Your own data as map layers Planned

    Add your own data sources as God's Eye View layers.

  • New server layers without an app update Planned

    New God's Eye View features and catalogue arrive from the server.

Interact

Talk to it and let it work the phone for you.

11 in the build · 1 built · 10 planned

Talk

  • Voice chat (In the build)

    Talk hands-free; Protean can see and work the phone with full control.

  • Choose the voice (In the build)

    Pick the voice for Grok, OpenAI or Gemini.

  • Real-time voice Planned

    Pluggable real-time voice providers.

  • Pull-down Talk tile Planned

    A quick tile that opens voice over any screen; device toggles by voice.

  • Voice and text models together Planned

    One conversation that hands off between voice and text models.

  • ElevenLabs voices Planned

    ElevenLabs text-to-speech, speech-to-text and voice agent.

Work the phone

  • Phone control (In the build)

    Taps, swipes, types and points on the screen for you.

  • Open apps (In the build)

    Opens an installed app by name.

  • Phone operator (In the build)

    Calls for you to talk, texts, emails ready to send, and bookings.

Setup and look

  • Simple or Power user settings (In the build)

    Switch how Settings looks.

  • Help me set up advanced features (In the build)

    A guided audit of what isn't set up yet.

  • Themes and icons Built, not in a build yet

    High-contrast theme, theme files and an icon library.

  • Setup wizard Planned

    First-launch setup: an AI provider and Obsidian for memory.

  • Provider-branded settings Planned

    Each provider's page in its own look with official links.

  • Beta updates Planned

    Update notice, Update button, signed and checked downloads.

How Protean behaves

  • Permission modes (In the build)

    Locked down to YOLO, by voice or in Settings, with device trust.

  • Soul and memory files (In the build)

    Who Protean is and what it remembers; edit them any time.

  • Model picker (In the build)

    Choose the model and provider; see the status card.

  • Provider usage (In the build)

    Official usage figures on each AI account's page.

  • Conversation quality and sub-agents Planned

    Personal context, a stronger thinking model when needed, sub-agents.

  • Make it yours Planned

    Rename the assistant, give it an avatar, alternate app icons, a home shortcut.

  • Personality presets and thinking level Planned

    Friendly, witty, informative; and each model's real thinking levels.

Make

Have it build panels, tools and routines for you.

2 in the build · 0 built · 4 planned

Panels and interfaces

  • Panels (In the build)

    Dials, charts, switches and live readings Protean builds for a device or job.

  • Change any interface Planned

    Change an assistant-made interface by asking or by hand.

  • Your own hardware interfaces Planned

    Build a hardware interface and let Protean assign its functions.

Code

  • Coding with Protean (In the build)

    Build software by talking: on your home system or in the phone's sandbox.

Routines and tools

  • Automations by text or speech Planned

    Build automations and workflows in plain words; reminders and schedules.

  • Make your own plugins and functions Planned

    User-made plugins, connectors and functions inside guard rails.

Aid

Safety and help when something goes wrong.

3 in the build · 0 built · 2 planned

Right now

  • Emergency Mode (In the build)

    Opt-in panic flow: evidence capture, location pin, responders, deliberate-tap dialer.

  • Nearest hospital (In the build)

    Opens the nearest hospitals in your maps app.

Warnings

  • Severe weather (In the build)

    Official alerts, tropical cyclones, tsunami messages and disaster events near you.

Away from help

  • Offline backcountry mode Planned

    Maps, tools and safety with no signal.

  • Check-in timer and SOS beacon Planned

    A home agent checks in on you; a low-signal SOS beacon.

Back to what it does Apply to test