Examples of Desired Tracking Behaviour

A dialogue box

In this dialogue box from Internet Explorer 4, the vocabulary would be something like the following: General, Security, Content, Connection, Programs, Advanced Navigate to the appropriate tab of the dialogue box OK, Cancel, Apply, Advanced Press the appropriate button (if available) "Access the Internet using a proxy server" , "Bypass proxy server for local (Intranet) addresses" Toggle the appropriate tickbox Address Move focus to the text entry box and switch into a recognition mode appropriate for entering machine names. Port Move focus into the text entry box and switch into a recognition mode appropriate for entering only numbers.

A Motif application

This is dxcalendar, a DEC Motif application. The speech recognition system would be able to "see" the five menus and add their names to the currently active vocabulary so that the user can activate them simply by speaking their titles.
When activated, a menu presents its options, and the speech system should let the user activate these simply by saying them, too.