Return to T.R.E. Newsletter Page
Voice I/O & Software
by Janet Hosmer
Remember a scene like this? "Computer . . . . please calculate our new course and acceleration." The computer responds, "As you wish, Captain Kirk!"
Twenty years ago when Jim and Bones were zooming around in the Enterprise we all thought that this was really wild stuff. Well, it's not so wild anymore, and as a matter of fact ... it's becoming pretty common-place. (Of course we're still working on the "beam me up Scotty" part ... but don't be too shocked if this also happens long before you imagined!)
The rapid advancement of computer technology, sound wave technology and CD-ROMs has opened up a whole new world of capabilities on our home computers! And ... the prices are also coming down from space so that we all can afford to utilize this technology and put it to use where we feel it does the most good ... for the education and empowerment of those with special needs. Let's take a look at the history of computerized voice and sound and see how we might apply some of the new products that we're finding on store shelves and in catalogs.
Talk To Me Please
Computers had the ability to talk to us quite some time ago. The problem was, the computer generated or synthesized sound of years back sounded robot-ish and was difficult to understand. That's not the case today. Synthesized (or computer generated) voice output sounds almost as good as digitized (or pre-recorded) voice. This is possible because your modem computer can manipulate data or files more efficiently, and can do more things with them!
As a result, many computer software programs or applications now have sound and voice output associated with them. Whether you're teaching a youngster to count, listening to your screen reading program, or playing Doom when you're supposed to be working, sounds, music and voice have become ordinary components of the computer application that you're using. And with the advent of faster (I believe quad-speed, or four ties the normal access time is standard) CD-ROM (Compact Disk - Read Only Memory) technology, computer applications sound as good as the expensive stereo system in your living room! Add in some fancier and intelligent software, and your computer can talk to you about pretty much anything!
Voice Output Benefits
Speech synthesizers, screen readers, talking word processors, and similar processing aids may be an integral part of the curriculum for a child who is an auditory learner, or may need supplements to printed text. However, they almost have become a necessity for someone who is blind or has visual impairments, and wants to interface with a computer. The potential benefits for users of this kind of technology are certainly exciting.
Do As I Say!
Computers listening to us, and understanding commands or directions is a little different story. It's (relatively) easy for a computer to generate speech, but to go the other way and have them understand it is a whole new ball game!
Computer programs that are designed to allow you to give verbal input are called speech recognition systems. They generally have vocabularies of words that are recognized when spoken into a microphone. This recognition process may or may not require the computer to be "trained" to recognize your voice. Some products also allow you to customize the recognized word vocabulary database by adding words that you need to use for your specific application.
Dictation Systems
Voice input computer dictation systems take your spoken word and input it into a word processor just as you would if you were typing at a keyboard. The computer recognizes what you are saying and converts your speech into words and paragraphs on the screen. This type of application also usually has some form of context analyzer so it can distinguish between words that sound alike (knew and new for instance) and use the appropriate word in the current sentence. Punctuation, spelling and error correction are all handled easily by commands and intelligent macros.
Dictation systems are not limited to word processing either. You can enter data into a spreadsheet or database, can create presentations, and can even dictate e-mail messages. All in a hands-free yet easily accessible environment. Daniel, a 10th grader who does not have full use of his hands, uses Dragon Dictate ®, a PC dictation system, to write his History paper. Without it, he would have to rely on assistance from someone else, or would not be able to participate in regular classroom activities.
Navigation Systems
A windowed environment, whether on PC or a Macintosh, is controlled by voice input navigation systems that act as the mouse for menu navigation and selection. These "windows" based voice input systems allow you to do almost anything that you can do with a mouse in the windows environment. You can bring up an application, choose a menu option, and totally control your environment by voice. Commands like "drag down," and "double click," allow you to simulate mouse movement with your voice. You can also mix voice, mouse and keyboard commands together if necessary.
Environmental Controls
The newest and most exciting on the scene are voice activated environmental control systems. These systems provide those with physical limitation access to their environment. Whole rooms, houses and buildings are being designed and created to be controlled by voice, radio frequencies and infrared devices. Phrases like "turn out the lights," "turn on the stereo," "flip the page," "open the door" all give independence and the abilities to an individual with physical limitations.
A recent story in the Pittsburgh Tribune Review tells how Sanford Blatt, who is paralyzed from the neck down, now uses a voice activated environmental control system known as Multimedia Max to operate any electronic device from anywhere in his house. Using Max from his computer workstation on the second floor, Blatt can see who is on the front porch, open the front door and turn on the hallway light. He can activate an alarm system, call rescue personnel, dictate a letter, send a fax, or play video games. The freedom he has gained from using this device is phenomenal.
Voice Input & Control Benefit
The benefits of being able to control access to your computer and your environment with your spoken word seem quite obvious. For those with physical injuries or visual and motor impairments, a whole world becomes available that wasn't accessible before. Words like independence and empowerment take on a whole new meaning. Your computer can almost become an extension of yourself. Add on a modem, e-mail, the Internet and the World Wide Web, and your reach becomes limitless! It truly is the magic of technology at work!
Where Is This All Going?
Those of us who have been part of the computer industry for many years see the far reaching impact of the newer voice technologies! Besides the fantastic opportunities for children and adults with disabilities, computers and technology will change the way we live! It won't be long before our homes are controlled through a central computer where operations (TV, phone, messages, bills, even groceries and supplies) can be monitored and maintained. Imagine sitting in your living room and saying something like this . . . . "Computer, I'd like to watch Friends tonight." Your computer might answer back, "There's a really cool episode of Star Trek at 9. How 'bout that? Shall I order pizza or subs?'
This article was reprinted from the publication, DIRECTIONS: Technology in Special Education, February 1996 - Volume 2, Number 7. To receive this newsletter, please contact DREAMMS for Kids, Inc., 273 Ringwood Road, Freeville, NY 13068-9618; (607) 539-3027.