What Speech Loses When It Becomes Text: Akash Raj Komarlu on Voice Reconstruction Edge AI

A transcript can capture every word and still miss what the speaker meant. Whispp Co-founder and Chief AI Officer Akash Raj Komarlu explains why emphasis, accent, and timing matter in live communication, and how on-device Voice Reconstruction AI is designed to preserve more of what makes speech human.
"She did not say she stole his money."
Akash Raj Komarlu says the sentence twice, emphasizing a different word each time.
The transcript is identical. The listener hears a different meaning.
It is a simple demonstration of a problem that matters to anyone building AI into a live call. Speech carries information through the words and how they are spoken. Emphasis affects interpretation. Timing affects the exchange between speakers. Accent carries information about the person speaking.
"We lose a lot of information when we go from speech to text," says Akash, co-founder and Chief AI Officer at Whispp.
Whispp developed Voice Reconstruction Edge AI to work directly with that audio information. Its WhisppWAVE technology reconstructs whispered speech into voiced speech on the device, with the processing designed for live communication.
For product teams, the practical question is how much of the conversation the device can preserve when users need to speak quietly.
Live calls expose the limits of text
Akash has worked on Whispp's technology since its early development, initially focusing on whisper-to-speech research.
Communication problems are easy to run into.
Someone takes a call in an open office and does not want to speak at normal volume. A passenger on a train wants to keep a conversation discreet. Someone sharing a room wants to talk without disturbing nearby people.
Whispering solves part of the social problem. It creates a new audio problem.
Text provides another option, though it changes the interaction.
Akash points out how people compensate when they write. They use punctuation differently and add emojis. They control when the next message appears. Spoken conversation already expresses intent through delivery.
A pause can change how the next words are received. Emphasis can change a sentence's meaning.
Akash's stolen-money example makes the difference easy to hear.
"She did not say she stole his money" can carry several interpretations depending on which word receives the emphasis. A speech-to-text system can produce the same sentence every time.
"When you use text as the intermediate in the pipeline, these meanings are lost."
For a transcription service, the words may be the main output. A live call has a different requirement. The listener has to hear what the person meant at the pace of an ongoing conversation.
Whispering creates a different speech signal
Making a whisper louder does not recreate the characteristics of normal voiced speech.
Amplification increases the input level. Noise suppression can reduce unwanted sound. Both have established roles in an audio pipeline.
Whispered speech contains a different acoustic structure.
This is the technical starting point for Whispp.
Voice Reconstruction Edge AI uses information that remains in the input audio to reconstruct the characteristics needed for voiced output. The processing stays audio-to-audio, so the reconstruction model still has access to useful information from the original signal.
Akash sees accent and emphasis as important examples.
"If I intend and emphasize a certain word in a sentence, it is conveyed in the converted voice," he says.
For Private Voice, WhisppWAVE is designed to retain characteristics associated with the speaker's own voice and accent. A user can whisper into the device while the person on the other end of the call hears reconstructed speech.
For an OEM, the value is a new calling mode with a familiar user experience. Quiet input can become usable live speech inside the communication experience the customer already knows.
Processing speed affects the exchange between speakers
Akash talks about latency in terms of what it does to a conversation.
A delay affects when the listener responds. That response determines when the first speaker continues. As delay increases, the rhythm between both people changes.
"It has to be fast so that it does not hamper conversation flow," he says.
WhisppWAVE runs its reconstruction models on the device. Current product configurations use CPU and NPU resources and don't require a cloud-processing round trip for reconstruction.
Whispp's current public product information describes total AI latency below approximately 120 milliseconds on supported configurations. Performance depends on the target hardware and implementation.
For an OEM or platform team, the evaluation covers latency alongside fit with the target device and its audio path, and an acceptable experience during a real two-way call.
That is where on-device execution becomes both a product consideration and an AI architecture decision.
Language independence fits the way people actually speak
Akash also points to multilingual conversation.
People switch languages during calls. In multilingual households and workplaces, a speaker may use a phrase from another language halfway through a sentence, and it can happen without anyone noticing.
Whispp describes its reconstruction architecture as language-independent. The system doesn't need speech recognition to determine the linguistic content before reconstructing the audio.
Akash sees this as part of keeping the speaker's existing communication style intact.
Accent matters for the same reason.
"We are not changing aspects of the person that are important to their identity, like accent," he says.
Language, accent, and speaking-style performance still need evaluation for the intended implementation. The underlying architecture is designed to work without a language-specific transcription stage.
Personal voice has been part of the work from the beginning
Whispp's technology originated in work with people facing serious voice challenges. That history remains part of the company's mission, while the current WhisppWAVE product is positioned for non-medical communication use cases.
Akash remembers an early user who lost his voice after surgery and later heard a reconstruction based on his previous voice.
"It was such an emotional moment for him that he started crying," Akash says.
He also recalls a user whose speech was difficult to carry through standard communication software. Reconstruction allowed her to have a spoken video conversation with a friend.
Akash does not present the earlier technology as finished.
"The version was not perfect. There's still a long way to go," he said during the interview.
Those experiences helped establish a principle that remains relevant to Private Voice today: reconstructed speech should retain characteristics that connect the output to the person speaking.
WhisppWAVE is currently a non-medical communications technology. Assistive applications remain part of Whispp's longer-term mission and require the appropriate medical validation.
Voice Reconstruction Edge AI as a product capability
WhisppWAVE brings this processing into mobile, PC, and wearable communication experiences.
On mobile and PC, Whispp currently positions the technology through SDK integration into existing audio and calling pipelines. Wearable architectures can place the processing on the wearable or a companion device, depending on the product design.
Private Voice gives a direct example of the experience.
The user speaks quietly into the device. Voice Reconstruction Edge AI processes the input locally. The remote participant receives reconstructed speech.
This creates a feature OEM teams can evaluate in familiar situations such as office calls, public transport, and shared spaces.
WhisppWAVE also supports Safe Voice, a separate use case in which the output is reconstructed into a different voice to reduce exposure of the user's natural vocal identity.
Both applications use Voice Reconstruction Edge AI inside an existing communication experience. The desired output differs by use case.
From a voice demo to a product evaluation
Akash's emphasis example is useful because it exposes the product requirement in a few seconds.
The words alone are not enough to reproduce the original speech.
A live voice feature also has to account for the information carried in the audio, the processing time available during a call, and the hardware the model will run on.
OEM and platform teams can test those requirements on the intended product rather than discuss them in the abstract.
WhisppWAVE is currently positioned for Android and Windows SDK integration, with additional wearable architectures depending on the target device. A technical evaluation can focus on the intended calling scenario, audio path, hardware configuration, and expected user experience.
If your team is evaluating a new live voice feature for mobile, PC, or wearables, book a WhisppWAVE technical demo and bring the device and calling scenario you want to test.
About Akash Raj Komarlu
Akash Raj Komarlu is co-founder and Chief AI Officer at Whispp. He has worked on Whispp's Voice Reconstruction Edge AI technology since its early development, beginning with research into whisper-to-speech conversion.
Whispp develops Real-Time Voice Reconstruction Edge AI for integration into mobile, PC, and wearable communication experiences.
.jpg)