CHAPTER THREE Performing Mobile Speak/Magnifier Smartphone Commands for version 2.0. Adapted and formatted from Code Factory’s Quick Start Guide by Mark Taylor, CANDLE SHORE INC on Friday, January 29, 2008. Every Smartphone based on the Standard Edition of the Windows Mobile operating system has a five-way navigation key to perform the function of the Up, Down, Left and Right arrow keys, as well as Enter when the center of the button is pressed. In addition to the Dial/Send key and the Hang Up/End Call key, there are Left and Right Softkeys that activate whichever control is assigned to them in any given window. When reading soft key assignments, Mobile Speak Smartphone refers to the left soft key as "Left Soft" and the right soft key as "Right Soft". Further, Smartphones have two keys called Back and Home. The Back key can be used to exit windows, menus, and dialogs like the Escape key on a Windows PC, to move up a directory level in a tree view or to the window previously in focus, and to delete the character to the left of the cursor like the Backspace key in Windows. When MSS or MMS is not running, the Home key places the focus on the Today (or Home) Screen. Note that with MSS or MMS running, however, this function is performed by pressing the Hang-up key. Mobile Speak and Mobile Magnifier commands on Windows Mobile Smartphones consist of the Home key as a modifier. This means that you need to press and release the Home key first, and Then press a different key to perform the assigned command, or press the Home key again to toggle the modifier off. Note that some commands require that you press and hold the other key for half a second before releasing it, in order to perform a function different from when that key is pressed and released immediately. Most commands turn off the modifier after they are executed. But for commands that can be used repeatedly to cycle through possible values or options, e.g., the command to change the speech rate and to cycle through the last five previously spoken text, the Windows key remains toggled on for three seconds during which the other key in the command can be pressed to repeat the function it performs. A beep will indicate that the modifier has turned off. On the other hand, to indicate that the Home key is enabled, MSS will say "Home" when it is pressed. Some Smartphones have a standard phone keypad with four rows of three keys: 1, 2, 3 in the first; 4, 5, 6 in the second; 7, 8, 9 in the third; and *, 0, # in the last. This keypad is used to dial numbers and input text. Other Smartphones feature a QWERTY keyboard with a numeric keypad area activated by pressing a function key before any key in a set of twelve that may be considered THE KEYS IN A STANDARD PHONE KEYPAD. For example, this numeric area may consist of 'w', 'e', 'r' for 1, 2, 3; 's', 'd', 'f' for 4, 5, 6; 'x', 'c', 'v' for 7, 8, 9; a key under 'c' for 0, 'a' for * and 'g' for #. Still other Smartphones have both a standard phone keypad and a QWERTY keyboard. MSS supports all such Smartphones and commands can be performed using combinations of the Home key and any key on the standard phone keypad (short and long press) and the equivalent numeric keys on a QWERTY keyboard. Note that on Smartphones that have a QWERTY keyboard, pressing the Home key automatically tells MSS or MMS that the next key pressed will be recognized by its corresponding numeric function, if any. It is possible that this may not work properly in some applications, however, and in which case, you either enable the numeric functions of the QWERTY keyboard before performing the command, or execute the equivalent Home + letter commands used on external QWERTY keyboards as listed in Section 3.2. 3.1 COMMAND LAYOUTS Starting with version 2.0, commands used in Mobile Speak Smartphone are now grouped, according to function, into different layouts. The command Home + 5 lets you switch to another layout. Remember that since this cycles through the available command layouts, you do not need to press the Home key again when you want to repeat the command. The different command layouts are as follows: DEFAULT: This layout includes the most frequently used commands and screen reader functions such as those for reading displayed information (e.g., date and time, status icons, current softkey assignments), repeating and spelling the last spoken text, reading text by word, opening the Mobile Speak Control Panel, as well as the commands for changing the most commonly configured speech settings (e.g., rate, volume, and active TTS voice) are available in this command layout that is selected immediately after installation of Mobile Speak smartphone. ADVANCED READING: This layout provides different text navigation commands for reading the contents of edit controls and web pages by word, sentence or paragraph. It also lets you read the text continuously from the start or the current cursor position. Further, it includes commands for moving the cursor to the start or end of the text. SETTINGS: This layout consists of the commands that configure MSS settings on the fly wherever you are on the phone's interface. These include settings that affect verbosity and punctuation level, the user mode which provides predefined settings for screen reader options, the user dictionary for changing TTS-specific pronunciation of words, and many more. MAGNIFICATION: This layout is selected by default if you install Mobile Magnifier without the speech component. It offers several hotkeys for controlling the magnifier including the zoom level, color schemes, magnification layout, auto panning feature, font smoothing, as well as commands to move the magnifier to different parts of the screen. 3.1.1 DEFAULT LAYOUT COMMANDS Home + Left Softkey: Read status information (number of missed calls and unread text messages, signal strength and network operator, battery level and charging state, ActiveSync and Bluetooth state, volume level, last caller, upcoming appointments and active tasks). Home + Right Softkey: Read date and time currently set on the device. Home + Back: Quit current application (i.e., unload it from memory rather than minimize its window and let it run in the background). Home + Dial: Change the active TTS voice (Note: this will not open if there is only one installed voice). Home + Enter: Read current softkey assignments. Home + Up: Read text from the start (if performed in an edit field or web page) / Increase speech volume by one level from 0 to 10 (if performed elsewhere). Home + Down: Read text from current cursor position (if performed in an edit field or web page) / Decrease speech volume by one level from 10 to 0 (if performed elsewhere). Home + Right: Move to next word/link and read it (if performed in an edit field or web page) / Increase speech rate by one level from 0 to 20 (if performed elsewhere). Home + Left: Move to previous word/link and read it (if performed in an edit field or web page) / Decrease speech rate by one level from 20 to 0 (if performed elsewhere). Home + 1: Open the MSS Control Panel. Home + 1 (hold): Connect to, or disconnect from, default Braille device. Home + 2: Open the MSS Switch to App dialog (for opening the window of an application currently running in the background or to unload it from memory; note: this will not open if there is no minimized program). Home + 3: Activate the MSS review cursor (to explore areas of the screen not selectable using system focus; note: press Home key to toggle the review cursor off). Home + 5: Change command layout. Home + 7: Spell last spoken text (this cycles through the five previous text strings rendered in speech). Home + 8: Text Capture (to copy the text in the control currently in focus and place it on a read-only edit field where text navigation commands can be used). Home + 9: Repeat last spoken text (this cycles through the five previous text strings rendered in speech). Home + 0: Toggle speech mute. Home + 0 (hold): Route audio to a paired Bluetooth headset (Note: The Headset profile must first be selected in start > Settings > Profiles). Home + *: Read the item or line of text currently in focus. Home + #: Read the contents of the whole screen (use this to read status indicators like the number of characters entered in a text message being composed). Home (pressed when the screen is being read) Interrupt speech (Note: either wait three seconds for the this key to toggle off as command modifier, or press it again). Home (pressed when phone is ringing) Mute ringtone to hear caller ID (Note: You only have to press this key once and the caller ID will be repeated with a two-second interval between readings.) Home (pressed four times quickly within ten seconds) Toggle Command Describer Mode. 3.1.2 ADVANCED READING LAYOUT COMMANDS Home + Left Softkey: Read status information (number of missed calls and unread text messages, signal strength and network operator, battery level and charging state, ActiveSync and Bluetooth state, volume level, last caller, upcoming appointments and active tasks). Home + Right Softkey: Read date and time currently set on the device. Home + Back: Quit current application (i.e., unload it from memory rather than minimize its window and let it run in the background). Home + Dial: Change the active TTS voice (Note: this will not open if there is only one installed voice). Home + Enter: Read current softkey assignments. Home + Up: Increase speech volume by one level (from 0 to 10). Home + Down: Decrease speech volume by one level (from 10 to 0). Home + Right: Increase speech rate by one level (from 0 to 20). Home + Left: Decrease speech rate by one level (from 20 to 0). Home + 1: Move to the previous word and read it. Home + 2: Open the MSS Switch to App dialog (for opening the window of an application currently running in the background or to unload it from memory; note: this will not open if there is no minimized program). Home + 3: Move to the next word and read it. Home + 4: Move to the previous sentence and read it. Home + 4 (hold): Move to the previous paragraph and read it. Home + 5: Change command layout. Home + 6: Move to the next sentence and read it. Home + 6 (hold): Move to the next paragraph and read it. Home + 7: Read text continuously from the start to the end. Home + 7 (hold): Move to the top of the edit field or web page. Home + 8: Text Capture (to copy the text in the control currently in focus and place it on a read-only edit field where text navigation commands can be used). Home + 9: Read text continuously from the current cursor position to the end. Home + 9 (hold): Move to the bottom of the edit field or web page. Home + 0: Toggle speech mute. Home + 0 (hold): Route audio to a paired Bluetooth headset (Note: The Headset profile must first be selected in start > Settings > Profiles). Home + *: Read the item or line of text currently in focus. Home + #: Read the contents of the whole screen (use this to read status indicators like the number of characters entered in a text message being composed). Home (pressed when the screen is being read) Interrupt speech (Note: either wait three seconds for the this key to toggle off as command modifier, or press it again). Home (pressed when phone is ringing) Mute ringtone to hear caller ID (Note: You only have to press this key once and the caller ID will be repeated with a two-second interval between readings.) Home (pressed four times quickly within ten seconds) Toggle Command Describer Mode. 3.1.3 SETTINGS LAYOUT Home + Left Softkey: Read status information (number of missed calls and unread text messages, signal strength and network operator, battery level and charging state, ActiveSync and Bluetooth state, volume level, last caller, upcoming appointments and active tasks). Home + Right Softkey: Read date and time currently set on the device. Home + Back: Quit current application (i.e., unload it from memory rather than minimize its window and let it run in the background). Home + Dial: Change the active TTS voice (Note: this will not open if there is only one installed voice). Home + Enter: Read current softkey assignments. Home + Up: Increase speech volume by one level (from 0 to 10). Home + Down: Decrease speech volume by one level (from 10 to 0). Home + Right: Increase speech rate by one level (from 0 to 20). Home + Left: Decrease speech rate by one level (from 20 to 0). Home + 1: Open the MSS Control Panel. Home + 1 (hold): Connect to, or disconnect from, default Braille device. Home + 2: Open the MSS Switch to App dialog (for opening the window of an application currently running in the background or to unload it from memory; note: this will not open if there is no minimized program). Home + 3: Change graphics verbosity (this affects whether MSS sees "All" graphics, only "Labeled" graphics, or "None" when the review cursor is active). Home + 4: Open the user dictionary for the current TTS voice (to change the pronunciation of words). Home + 5: Change command layout. Home + 6: Change Keyboard Echo (this affects speech output while entering text; set to "None", "Characters", "Words", or "Both Characters and Words"). Home + 7: Change spell mode (this applies when using the Spell Last Text command and when reading text by character; set to "Normal" or "Phonetic") . Home + 9: Change punctuation verbosity (this affects how verbose speech output should be when reading punctuation symbols in text; set to "None", "Some", "Most", or "All"). Home + 0: Toggle speech mute. Home + 0 (hold): Route audio to a paired Bluetooth headset (Note: The Headset profile must first be selected in start > Settings > Profiles). Home + *: Change Secret Mode (this affects speech output while typing in password edit fields; set to "Say star", "Speak characters", or "Silent"). Home + #: Change active user mode (to select a defined set of verbosity settings; use "Beginner" for the most verbose, "Intermediate", or "Advanced" for the least verbose). Home (pressed when the screen is being read) Interrupt speech (Note: either wait three seconds for the this key to toggle off as command modifier, or press it again). Home (pressed when phone is ringing) Mute ringtone to hear caller ID (Note: You only have to press this key once and the caller ID will be repeated with a two-second interval between readings.) Home (pressed four times quickly within ten seconds) Toggle Command Describer Mode. 3.1.4 MAGNIFICATION LAYOUT COMMANDS Home + Left Softkey: Read status information if speech is available (number of missed calls and unread text messages, signal strength and network operator, battery level and charging state, ActiveSync and Bluetooth state, volume level, last caller, upcoming appointments and active tasks). Home + Right Softkey: Read date and time currently set on the device if speech is available. Home + Back: Quit current application (i.e., unload it from memory rather than minimize its window and let it run in the background). Home + Dial: Toggle speech mute. Home + Up: Increase zoom level by one notch (from 1.5x to 16x). Home + Down: Decrease zoom level by one notch (from 16x to 1.5x). Home + 1: Open the Control Panel screen for Magnifier options. Home + 2: Move the magnifier to focus on the window title. Home + 3: Toggle automatic panning of text. Home + 4: Toggle the presence of borders around the magnified area. Home + 5: Change command layout. Home + 6: Change the color scheme (select from "no scheme", "black and white", "gray scale", "black and white inverted", "256K colors", "16K colors", and "inverted colors"). Home + 7: Change the magnification layout (where either the entire screen is magnified or just areas of interest such as the title and softkeys). Home + 8: Move the magnifier to focus on the softkeys. Home + 9: Toggle font and graphics smoothing (this improves readability of magnified screen contents, making it appear less jagged). Home + 0: Enable/disable magnification (Note: this does not affect speech output if available) left/Right/Up/Down arrow keys (hold) Move the magnifier to the left/right/top/bottom without moving the system focus (Note: once an arrow key is pressed and held to enable this feature, the Magnifier can be moved using short presses of the arrow keys, until a second has passed that no arrow key is pressed). Home (pressed when the screen is being read) Interrupt speech (Note: either wait three seconds for the this key to toggle off as command modifier, or press it again; this works only if you have the speech component installed). Home (pressed when phone is ringing) Mute ringtone to hear caller ID (Note: this works only if you have the speech component installed). Home (pressed four times quickly within ten seconds) Toggle Command Describer Mode (Note: this works only if you have the speech component installed). 3.2 EXTERNAL KEYBOARD COMMANDS Although you will be able to perform all tasks with the keys on the Smartphone, you may want to use an external QWERTY or Braille keyboard to work more effectively with your device. These keyboards usually connect through Bluetooth. Mobile Speak Smartphone supports these external keyboards, and you can use them not only for input but also for controlling the Windows Mobile device. Once the connection between the keyboard and your device is established, you may start typing characters on the keyboard and Mobile Speak Smartphone will respond normally. MSS commands are performed on an external QWERTY keyboard using the same key combinations involving numbers or letters as on the Smartphone itself, but instead of the Home key, the Windows key is the command modifier. For example, Windows + D reads the current date and time set on the Smartphone. Braille commands are specific to the Braille device in use and the keys available on it. For more information, please read the MSS Braille Support User's Guide. The following table lists the key combinations to use on an external QWERTY keyboard. Note that the Home + number commands will also work on such a keyboard. On the other hand, even if your Smartphone has a QWERTY keyboard, pressing the letter keys that correspond to numbers during numeric input will be recognized by MSS for their number functions even if you do not activate numeric mode. For example, if the letter d enters the number 5 on your Smartphone, Home + d on the Smartphone's built-in QWERTY keyboard will perform the Home + 5 command (Change Command Layout). However, Windows + d on an external QWERTY keyboard, if the control in focus allows input of letters, will perform the Home + d command (Read Date and Time). Note that it is possible though that in some applications, Home + number combinations using the built-in QWERTY keyboard may not work. In this case, either enable the numeric function of the keyboard before pressing the Home key, or use the following Home + letter command equivalents. External Keyboard commands are omitted in this edition of the documentation. 3.3 APPLICATION-SPECIFIC COMMANDS Apart from the different command layouts available everywhere, Mobile Speak Smartphone provides additional commands for use in certain applications. Some of these commands perform functions not native to the application, but which MSS offers users to meet specific needs of the blind and visually impaired. INTERNET EXPLORER Enter: Focus on a form field (e.g., edit box, combo box, list box) to enter text or select a value Up or Down arrow while focus is on a form field: Exit the field to continue normal navigation of the web page. Home + Left: Move to previous link. Home + Right: Move to next link. Home + Enter: Speak relative position on web page in percent (starting with 0% at the top of the page). WINDOWS MEDIA PLAYER Enter or P: Play currently selected track. Enter or Space: Pause or resume playback of currently selected track. Enter (hold) or S: Stop playback of currently selected track. 2 or A: Play again the currently selected track from the start. Left (short or long press): Rewind currently playing track. Right (short or long press): Fast forward currently playing track. 7 or B: Move back to previous track in "Now Playing" list. 9 or N: Move to next track in "Now playing" list. Up (short press): Increase player volume (size of increment depends on WMP volume slider). Down (short press): Decrease player volume (size of decrement depends on WMP volume slider). 0 or U: Toggle player volume mute (does not affect MSS). 8 or T: Speak information about current track (title, artist, and album). Up (hold) or X: Speak current time position in selected track and its total time length. Down (hold) or G: Go to specified time position (a dialog opens where you can enter the time in fields for the hours, minutes and seconds). 5 or M: Add marker at current time position in selected track (Note: you must enter a marker name to add the marker successfully; markers are saved even when you close the application). 4 or R: Rewind to previous marker. 6 or F: Fast forward to next marker. 3 or D: Delete currently selected marker. 1 or L: Delete all markers. CALCULATOR Arrow keys: Select the four arithmetic operators (+ for addition, - for subtraction, x for multiplication, and / for division). Enter or = from Menu: Get calculation result. Home + 9 or L: Repeat calculation result. Home + # or W: Read calculator screen. MSN OR WINDOWS LIVE MESSENGER Enter: Switch between conversation and input area (Note: if you have reached the top or bottom of the input/conversation field, pressing Up/Down will move you to the other field). Left Softkey: Send chat message. STOPWATCH AND SMART CONVERTER FOUND ON SAMSUNG SMARTPHONES: # key: Read the current stopwatch time at that moment, or read the conversion result. 3.4 COMMAND HELP MODE The Command Help Mode assists you to familiarize yourself with the commands of Mobile Speak/Magnifier Smartphone. In this mode, you can explore all the commands without actually performing them. To turn on the Command Help Mode, Press the Home key four times within ten seconds. Mobile Speak Smartphone will say "Command Help Mode On". You can now press or press and hold any key to learn the command it performs when the Home key is turned on. You do not need to press the Home key because it is already enabled as a command modifier in this Help Mode. Mobile Speak Smartphone will provide a short description of the function assigned to that keystroke. To turn off the Command Help Mode, press Home key four times again within ten seconds. Mobile Speak Smartphone will inform you that it is now exiting Command Help Mode. Note that this mode is not available if the speech component is not installed. The End of Chapter Three