Hyperdrift

Conversation / Hyperdrift First Officer

The dashboard that speaks first

In a recorded Cargo recovery, a spoken instruction starts the work. First Officer checks the response and reports back, with the evidence still on screen.

By Yann VR · 3 min read · Published · Updated Share article ↓
A microphone sends a command to one visible service, with a separate return signal carrying its result.
On this page

We built First Officer so we could ask about the fleet, make a decision and hear the result while the evidence stayed on screen. In the 29 September recording, “bring it back” starts recovery of Cargo, our sandbox service. The officer reports after two consecutive successful external checks.

Thirteen seconds

12.7 seconds from one spoken word to a ship back online: three frames from the recorded take, the Cargo ship going from red to amber to green

The officer is mid-sentence when you say one word: "Cargo". It stops, and tells you the ship is down. You say "bring it back". An agent restores it. The officer checks the ship twice from outside, then tells you, without being asked.

You never touch the screen. But the screen never stops following you: the ship you named comes forward, the rest step back, and every choice the officer offers appears as a button, for whoever is looking over your shoulder.

Response time in the recorded tests

Across four takes of six turns on 29 September, answers began 0.5–0.8 seconds after the generated captain’s voice ended. The longest conversational silence was 1.2 seconds. That measures response onset; the interval from the captain’s first word to the report was 12.7 seconds in the recorded take.

That pace took three decisions. The listening model hears you and calls the end of your turn on its own; the one we use was released the day we recorded, trained on real conversations with voice agents, where people say "yes", "why" and "Cargo" and expect to be understood. The officer is its own model: it decides every line before anyone asks a large model to think. And the voice is rented from the same platform, so the words are spoken the moment they are decided.

There was one wall. With the speech API we tested in September, a voice that had started a sentence could not be stopped. So when you talk over the officer, it does what a person does: it goes quiet, hangs up on itself, and picks up a fresh line while you are still speaking. You hear a pause of about a second. Underneath, a whole session ended and another began.

Rent the voice, own the judgement

AssemblyAI hears and speaks. That half is bought, and it should be; nobody should build their own ears.

We used AssemblyAI for speech recognition and speech output, and kept the operating decisions in our own code. The response path selects lines from the agenda and its evidence. Its accuracy still depends on those records and the checks behind them.

So build in that order. Write the decisions down first, with their evidence. The voice comes after, and it is the easy part.

Who it leaves out

A voice is not the door for everyone. If you cannot hear, or cannot speak, or work in a room where talking is not an option, the officer is only useful because everything it says is on the screen as well, and because you can type to it. That is not a footnote. An interface that only works for people who resemble its author has not shipped.

The next step is the same idea with less in the way: dictate straight to the tools your apps expose to agents, and let the screen be optional.

The code is open.

Which decision would you rather say than click?

Discuss your operating workflow →

The idea, at a glanceFirst Officer reports the result of a spoken instruction, with the evidence still on screen.
  1. It speaks first
  2. You cut in
  3. An agent acts
  4. It reports back
Article link

Put the idea to work

What would this look like for you?

Bring one operating decision and the evidence it needs. We'll discuss what speech could simplify.

Discuss your operating workflow →
Read nextHere’s the new deal. UI is for intel. Agents are for operating. →A peek into Traction’s 24 October release: the board shows what the Growth Manager and Builder are doing and what they delivered. The agents do the work. We decide what becomes work.

Get in touch

We’ll use these details to reply to your enquiry.