Voice commands guide

Voice commands supported by default

The following is a summary list of the main voice commands grouped by their purpose.

User assistance

The following commands could be invoked in order to know the available actions.

CommandDescription
help Displays a the list of available commands
help bar Displays a the list of available commands in a right side bar
exit Leaves the current session

Open a website

In order to be able to load a website, the command "open" could be spoken followed of the desired site name.

CommandDescription
open Requests the website name to load

Click something

A left click could be simulated over a website element invoking the command "click".

CommandDescription
click After requesting the selected element reference it performs a left click over the pointed component

Select something

An element present of a website could be selected in order to be able to execute actions related with it.

CommandDescription
select After requesting the selected element reference it shows the possible actions related with the pointed element.

Scroll a page

Scroll down or up a page could be done after invoke the following commands.

CommandDescription
down Move down the content of a website
up Move up the content of a website
scroll down Move down the content of a website
scroll up Move up the content of a website
auto scroll Continue scroll down of a website
arrow down Move down one line the content of a website
scroll up Move up one line the content of a website
scroll to the top Move up the content of a website to the beginning of it
scroll to the bottom Move down the content of a website to the end of it

Zoom

Increase or decrease the size of the website content could be done after invoking the following commands.

CommandDescription
zoom out Zooms out the current tab
zoom in Zooms in the current tab
reset zoom Restore the zoom to the default level

Enter Text

After performing a "click" over a text box a text could be dictated by the user.

CommandDescription
keyboard Shows a virtual keyboard
remove Removes the last word
remove line Removes the last line
clean up Removes the entire text
paste Pastes copied text
undo Undoes the last action
redo Does the reverted action
submit Submits the current form

Play media content

After select a video or a music player you can control the media content invoking the following commands.

CommandDescription
play Plays media content
pause Pauses media content
stop Stops media content
rewind [time] Rewinds the media content
forward [time] Forwards the media content
mute Mutes media
volume up Increases volume level
volume down Decreases volume level

Tab management

The browser tabs could be managed with the following commands.

CommandDescription
new tab Opens a new tab
close tab Closes the current tab
next tab Switches to the following tab
previous tab Switches to the previous tab

Downloads management

The downloads could be managed with the following commands.

CommandDescription
downloads Opens the downloaded file list

History management

The browser history could be managed with the following commands.

CommandDescription
history Opens the accessed website list

Bookmarks management

The bookmarks could be managed with the following commands.

CommandDescription
add bookmark Saves the current page as a bookmark
bookmarks Opens bookmark list

Top site list

A most frequented website list could be opened invoking the following command.

CommandDescription
top sites Opens the most frequented site list

Image actions

When an image is selected the following actions could be performed

CommandDescription
copy address Copies the address of the selected image
open in new tab Opens the selected image address in a new tab
download Downloads the selected image

Text actions

When a text is selected the following actions could be performed

CommandDescription
copy Copies the selected text

Fill out form inputs

After performorming a "click" over any form input, the element could be filled with the desired value.

All the form inputs are supported.

About this tool

Javier Perez UNLP Unigranrio

The extension Handsfree for Web was built by Javier Pérez in order to bring a handsfree web navigation alternative.

The app was presented as an implementation of a handsfree web navigation model described into the final work Handsfree browsing driven by voice commands for the degree Computer Science at Universidad Nacional de La Plata.

Contributors

Students of the Unigranrio University have submitted the portuguese version of the extension.
Special thanks go to:

  • Matheus Freitas
  • João Victor Plessim
  • Gabriel Francisco
  • Guilherme Cabral
  • Lucas Hermida