Electronic Design

  
Reprints     Printer-Friendly    Email this Article    RSS        Font Size     What's This?


[TechView: The Industry]
Subvocal Speech Capture Keeps Things Quiet While Improving Recognition Accuracy

Dave Bursky  |   ED Online ID #7834  |   April 26, 2004


By sensing activity in the nerves in the throat that control speech, the NASA Ames Research Center has begun to computerize human silent reading.

Button-sized sensors stuck under the chin and on either side of the Adam's apple could gather nerve signals created by "subvocal speech" and send them to a processor that executes a program to translate them into words. Eventually, the technology could be used in spacesuits, in noisy places like airport control towers, or even in traditional voice-recognition programs to increase accuracy.

"The processor analyzes the silent, or subauditory, speech such as when a person silently reads or talks to himself," explained Chuck Jorgensen, a scientist whose team is developing the technology. "Biological signals arise when reading or speaking to oneself with or without actual lip or facial movement. A person using the subvocal system thinks of phrases and talks to himself so quietly, it cannot be heard, but the tongue and vocal cords do receive speech signals from the brain."

In their first experiment, scientists "trained" software to recognize six words and 10 digits that the researchers repeated subvocally. Initial word recognition results had an average of 92% accuracy. The first subvocal words the system learned were stop, go, left, right, alpha, omega, and the numbers zero through nine. Silently speaking these words, scientists conducted simple searches on the Internet by using a number chart representing the alphabet to control a Web browser program. This proved that users could browse the Web without touching a keyboard.

Scientists are now testing new, noncontact sensors that can read muscle signals even through a layer of clothing. A second demonstration will attempt to control a mechanical device using a simple set of subvocal commands, according to Jorgensen. His team is planning tests with a simulated Mars rover. Silent "spoken" words will control rover movement. This would enable people in noisy environments to use the system when privacy is needed, such as during telephone conversations on buses or trains.

An expanded muscle-control system could help injured astronauts control machines. After suffering from muscle weakness due to a long stint in microgravity, astronauts could send signals to software that would assist with landings or other maneuvers. A logical spinoff would be an aid to handicapped individuals who could use this system to help with many tasks.

Scientists at Ames are studying the complex nerve-signal patterns to learn more about the signals that control vocal cords, muscles, and tongue position. The researchers use an amplifier to strengthen the electrical nerve signals. The signals are processed to remove noise and then processed again to differentiate one word from another.

After the signals are amplified, software "reads" the signals to recognize each word and sound. The researchers will continue to expand the vocabulary with sets of English sounds to eventually enable a full speech-recognition program to interpret the words.

The Computing, Information, and Communications Technology Program, part of NASA's Office of Exploration Systems, funds the subvocal word-recognition research. There is a patent pending for the new technology.

For further information, go to http://amesnews.arc.nasa.gov.

See associated figure.


Reprints   Printer-Friendly  Email this Article  RSS    Font Size   What's This?


  • Synopsys Takes The Analog/Mixed-Signal Plunge
  • October 2, 2008
  • Electronic Design Update: October 1, 2008
  • For Checking Software Without Hardware, FPGAs Are The Answer
  • ESL Platform Looks To Solidify Baseband PHY Design Flow
  • September 25, 2008
  • Electronic Design Update: September 24, 2008
  • Tools Take On IC-Package And SiP Design Challenges
    1) Build A Smart Battery Charger Using A Single-Transistor Circuit
    (198 views today)
    2) Easily Convert Decimal Numbers To Their Binary And BCD Formats
    (87 views today)
    3) Efficient DC-To-AC Inverters Charge Equipment Racks
    (85 views today)
    4) Precision DC motor speed controller
    (74 views today)
    5) VIDEO: Under The Hood Of The Tesla Roadster
    (65 views today)
    ALL TOP 20



    Reader Comments

    How do I find out more about potential application use for this technology?

    Ian Necus -July 20, 2006   (Article Rating: )

    I think this gives people with disabilities something to look forward to. I have a cousin who is paraplegic and needs all the help he can get with simple day-to-day tasks, not to mention things we take for granted like surfing the Internet.

    Jennifer -May 11, 2004

    This is just plain scary. Big brother is coming. Soon you won't be able to sit in your bedroom and think to yourself....

    Zork -May 07, 2004

    POST YOUR COMMENTS HERE
    Name:

    Email:
    Your Comments:

    Enter the text from the image below


    Please refresh the page if you have trouble reading this text.

    Search Electronic Design
         
      
     
    Web Seminar
    Sponsored By:
    Title: Read Pacing: A Performance Enhancing Feature of PCI Express Gen 2 Switch Devices
    Speakers: 
    Date: 07/01/08
    Register: 

    Electronic Design Europe Electronic Design China EEPN Power Electronics Auto Electronics Microwaves & RF
    Mobile Dev & Design Schematics Find Power Products Military Electronics EE Events Related Resources