← Blog

When should your assistant speak?

Our research into an assistant that can contribute, wait, and return a decision to you without taking over the conversation.

When should your assistant speak?

The project meeting is nearly over. Someone asks whether the draft is ready. Your assistant has the answer because you asked it to pass along the update. A minute later, the conversation turns to a larger budget. It has heard enough to understand the proposal. It does not have your permission to accept it.

From the outside, these moments can look almost identical: a question, a pause, an opportunity to speak. For a personal assistant, they demand different judgments.

This is one of the questions behind our communication research at Zinley. How does an assistant contribute to a conversation in a way that is useful to the people in it? An accurate sentence is only part of the answer. The timing, the role it has been given, and the authority behind its words matter too.

A conversation has more than one kind of silence

A pause can mean someone has finished. It can also mean they are choosing their words, dealing with a weak connection, or waiting for someone else. A person saying your name may be inviting you to speak. They may simply be referring to something you said earlier.

People interpret these signals through shared experience. Even then, we interrupt each other and get the moment wrong. An AI assistant has to contend with an incomplete view: the audio it receives, the conversation it can follow, and the instructions available to it.

We want to understand the difference between having a relevant answer and having a useful reason to enter the conversation. Sometimes help means asking one clarifying question. Sometimes it means keeping a detail available until the person responsible is ready. Sometimes the right contribution is to wait.

Give the assistant a role people can understand

Consider three ordinary situations. You ask Zinley to explain something while you are on a call. You ask it to help guide a set of approved interview questions. You ask it to represent you in a conversation you cannot attend.

The same speaking behavior will not fit all three. In the first, you may want a short answer followed by space to continue. In the second, the assistant has a specific sequence to help with. In the third, other people need to know whose instructions it is following and where those instructions end.

A clear introduction is part of the work. So is a clear brief: what it should explain, what it should ask, what it may disclose, and what it must bring back to you. Those instructions guide the model. They do not prove that it will interpret every speaker, silence, or social situation correctly.

Our research starts with these distinctions because a personal assistant should be understandable to everyone affected by its participation.

Knowing the background does not grant the decision

Here is a fictional project discussion, illustrating the boundary we want to preserve:

Illustration: a project discussion
MayaAlex sent over the draft, right?
ZinleyAlex asked me to share that the draft is ready for review.
SamCan we commit to the larger budget today?
ZinleyThat needs Alex's decision. I can bring back the question and the proposed amount.

The first answer carries an authorized update. The second returns a new decision to its owner. Both require understanding the conversation; only one permits the assistant to answer on Alex's behalf.

This becomes more important as an assistant knows more about you. Remembering a preference, an earlier discussion, or a relationship can make a response more relevant. It cannot supply permission that was never given. The useful outcome may be a question with the missing context attached, ready for your judgment.

What the research still needs to prove

We explored a speech gate that could allow or withhold generated audio using conversational and acoustic signals. That gate is not enabled by default in current call paths. Current turn-taking depends on the realtime model and call surface.

We have not published a benchmark here. A convincing evaluation would have to look beyond whether the assistant answered correctly. It would examine interruptions, missed opportunities, replies to the wrong speaker, and statements that exceed the owner's instructions. It would need different languages, conversational styles, accents, background noise, and imperfect connections.

There is also a practical question after an error: can someone correct the assistant, understand what happened, and continue without rebuilding the whole conversation? That deserves as much attention as a polished demonstration.

An assistant should leave room for people

The long-term aim is an assistant whose participation you can shape. It should help you carry a conversation, preserve a detail, or move a question forward while leaving people room to think and decide.

That is a demanding kind of usefulness. It asks the system to consider the effect of speaking, not simply the possibility of generating more words. Our communication research keeps returning to a human question: did the contribution help the people who were there?