We have designed and implemented a voice and touch-based error tolerant
multi-modal text editing and correcting system
VT supports both text editing and error correction. This video shows how each technique works
underline
highlight this sentence
your assistance
First, we demonstrate how text editing works which is carried out in either single command mode
or compound command mode. In the single command mode, the user says a single command
and selects the text to which the command will be applied.
The user can speak the command before during or after selecting the text. If the voice input occurs
before the selection, the user taps the microphone button to indicate the start of voice input.
highlight
bold
highlight
We can use the single command mode for the following six commands.
Cut, copy, paste, highlight, bold, and underline.
underline
copy
paste
cut
paste
For the compound command mode, the voice input includes both the command name and the operation scope.
VT supports the operations at word, sentence, and paragraph levels.
cut two paragraphs
paste
underline this sentence
highlight three words
Besides editing text, VT also supports error correction.
To correct errors, the user approximately indicates the error location with touch
and says a new content that will be used to correct errors.
The spoken text could include existing text to help to identify the error location.
In this example, the user inserts the word 'better' to the editing sentence.
better
A user can also say some context words to help to locate the insertion location.
some better news
In this example, the user substitutes the two error words with 'it was'.
it was
The touch location can be approximate.
it was very
A user can use the multi-modal text editing and correction together to edit and correct text.
attached document
cut this paragraph
paste
bold
highlight this sentence
your assistance
Please read the paper for more details. Thank you!