VoxForge was set up to collect transcribed speech for use with Free and Open Source
Speech Recognition Engines (on Linux, Windows and Mac).
make available all submitted audio files under the GPL license, and then ‘compile’ them into acoustic models for use
with Open Source speech recognition engines such as CMU Sphinx , ISIP , Julius ( github ) and HTK (note: HTK has distribution restrictions).
Why Do We Need Free GPL Speech Audio?
Most acoustic models used by ‘Open Source’ speech recognition
(or Speech-to-Text) engines are closed source . They do not give you access to the speech
audio and transcriptions (i.e. the speech
corpus ) used to create the acoustic model.
The reason for this is that Free and Open Source (‘FOSS’) projects are
required to purchase large speech
corpora with restrictive licensing. Although there are a
few instances of small FOSS speech corpora that could be used to
create acoustic models, the vast majority of corpora (especially
large corpora best suited to building good acoustic models) must be
purchased under restrictive licenses.
How Can You Help?
Record yourself reading some text and upload your recordings to VoxForge.
Other Options .
Speech recognition software for Linux
Jump to navigation
Jump to search
This article has multiple issues. Please help improve it or discuss these issues on the talk page . ( Learn how and when to remove these template messages )
( Learn how and when to remove this template message )
There are currently several speech recognition software packages for Linux . Some of them are free and open source software while others are proprietary. Speech recognition usually refers to software that attempts to distinguish thousands of words in a human language. Voice control may refer to software used for sending operational commands to a computer.
- 1 Native Linux speech recognition
- 1.1 History
- 1.2 Current development status
- 1.2.1 Crowdsourcing of speech samples
- 1.3 Speech recognition concept
- 1.3.1 Speech Recognition in Browser
- 1.3.2 Free speech recognition engines
- 1.3.3 Proprietary speech recognition engines
- 2 Voice control and keyboard shortcuts
- 3 Running Windows speech recognition software with Linux
- 3.1 Using a compatibility layer
- 3.2 Using virtualized Windows
- 4 See also
- 5 References
- 6 External links
Native Linux speech recognition[ edit ]
History[ edit ]
In the late 1990s, a Linux version of ViaVoice (created by IBM ) was made available to users for no charge. However, the free SDK was removed by the developer in 2002.
Current development status[ edit ]
Recently, there has been a push to get a high-quality native Linux speech recognition engine developed. As a result, numerous projects dedicated to creating Linux speech recognition solutions were established, such as Mycroft . Mycroft is similar to Microsoft’s Cortana , but open source.
Crowdsourcing of speech samples[ edit ]
It is essential to compile a speech corpus to produce acoustic models for speech recognition projects. VoxForge is a free speech corpus and acoustic models repository that was built with the aim of collect transcribed speech to be used in speech recognition projects. VoxForge accepts crowdsourced speech samples and corrections of recognized speech sequences. It is licensed under the GPL .
Speech recognition concept[ edit ]
The first step is to begin recording an audio stream on a Linux machine. The user has two main processing options:
- (DSR) Discrete Speech Recognition – process the voice recognition entirely on local machine. This refers to self-contained systems in which all aspects of SR (Speech Recognition) are performed entirely within the user’s computer. This is becoming critical for protection of IP (Intellectual Property) and avoiding unwanted surveillance (2018).
- (Remote) Server-based SR which transmits the speech file to a remote server for converting the audio file into a text string. Due to recent Cloud storage schemes and data mining, this method more easily allows surveillance, theft of IP and introduction of malware.
FYI, The second option (remote) was previously used on smart phones as they did not possess sufficient performance, disk space or RAM to process speech recognition on-board the phone.These limitations have largely been overcome although server-based SR on mobile devices remains universal.
Speech Recognition in Browser[ edit ]
Discrete Speech Recognition can be performed within a web browser and works well with supported browsers. Remote SR does not require installation of software on the desktop computer or mobile device as it is primarily a server-based system with the inherent security issues noted above.
- (Remote): https://dictation.io (use Chromium /Chrome) The dictation service records an audio track of the user via the web browser. In turn, dictation.io uses the Google API for speech recognition. Within Google Docs, Google voice typing works within the Chrome browser, regardless of operating system as it is a server-based system.
- (DSR): There are solutions that work on the client only, without sending data to servers, e.g. pocketsphinx.js .
Free speech recognition engines[ edit ]
The following is a list of current projects dedicated to implementing speech recognition in Linux, as well as major native solutions. These are not end-user applications. These are programming libraries that a programmer may use to develop an end-user application.
- CMU Sphinx is a general term to describe a group of speech recognition systems developed at Carnegie Mellon University.
- Julius is a high-performance, two-pass large vocabulary continuous speech recognition (LVCSR) decoder software for speech-related researchers and developers.
- Kaldi a toolkit for speech recognition provided under the Apache licence.
- Mozilla DeepSpeech is developing an open source Speech-To-Text engine based of Baidu’s deep speech research paper. It is intended for end user usage in the coming months. 
Possibly active projects:
- Lera (Large Vocabulary Speech Recognition) based on Simon and CMU Sphinx for KDE  .
- Speechpad.pw  uses Google’s speech recognition engine and Chrome native messaging API to provide direct speech input in Linux.
- Speech  uses Google’s speech recognition engine to support dictation in many different languages.
- Speech Control : is a Qt-based application that uses CMU Sphinx ‘s tools like SphinxTrain and PocketSphinx to provide speech recognition utilities like desktop control, dictation and transcribing to the Linux desktop.
- Platypus  is an open source shim that will allow the proprietary Dragon NaturallySpeaking running under Wine to work with any Linux X11 application.
- FreeSpeech,  from the developer of Platypus, is a free and open source cross-platform desktop application for GTK that uses CMU Sphinx ‘s tools to provide voice dictation, language learning, and editing in the style of Dragon NaturallySpeaking.
- Vedics  (Voice Enabled Desktop Interaction and Control System) is a speech assistant for GNOME Environment
- GnomeVoiceControl  is a dialogue system to control the GNOME Desktop that was developed in the Google Summer of Code in 2007.
- NatI  is a multi-language voice control system written in Python
- SphinxKeys  allows the user to type keyboard keys and mouse clicks by speaking into their microphone.
- VoxForge is a free speech corpus and acoustic model repository for open source speech recognition engines.
- Simon  aims at being extremely flexible to compensate dialects or even speech impairments. It uses either HTK / Julius or CMU SPHINX, works on Windows and Linux and supports training.
- Speeral Speeral a group of speech recognition tools developed at University of Avignon
- Jasper project https://jasperproject.github.io/ Jasper is an open source platform for developing always-on, voice-controlled applications. This is an embedded Raspberry Pi front-end for CMU Sphinx or Julius
It is possible for developers to create Linux speech recognition software by using existing packages derived from open-source projects.
- CVoiceControl  is a KDE and X Window independent version of its predecessor KVoiceControl. The owner ceased development in alpha stage of development.
- Open Mind Speech,  a part of the Open Mind Initiative,  aims to develop free (GPL) speech recognition tools and applications, as well as collect speech data. Production ended in 2000.
- PerlBox  is a perl based control and speech output. Development ended in early stages in 2004.
- Xvoice  A user application to provide dictation and command control to any X application. Development ended in 2009 during early project testing. (requires proprietary ViaVoice to function)
Proprietary speech recognition engines[ edit ]
- Verbio ASR  is a commercial speech recognition server for Linux and windows platforms.
- DynaSpeak,  from SRI International , (speaker-independent speech recognition software development kit that scales from small- to large-scale systems, for use in commercial, consumer, and military applications)
- Janus Recognition Toolkit (JRTk)  is a closed source speech recognition toolkit mainly targeted at Linux developed by the Interactive Systems Laboratories developed at Carnegie Mellon University and Karlsruhe Institute of Technology for which commercial and research licenses are available.
- LumenVox Speech Engine is a commercial library for Linux and Windows for inclusion in other software. It has been integrated into the Asterisk private branch exchange system. 
- VoxSigma is a speech recognition software suite developed by Vocapia Research . 
Voice control and keyboard shortcuts[ edit ]
Speech recognition usually refers to software that attempts to distinguish thousands of words in a human language. Voice control may refer to software used for sending operational commands to a computer or appliance. Voice control typically requires a much smaller vocabulary and thus is much easier to implement.
Simple software combined with keyboard shortcuts , have the earliest potential for practically accurate voice control in Linux.
Running Windows speech recognition software with Linux[ edit ]
Using a compatibility layer[ edit ]
It is possible to use programs such as Dragon NaturallySpeaking in Linux, by utilizing Wine , though some problems may arise, depending on which version is used. 
Using virtualized Windows[ edit ]
It is also possible to use Windows speech recognition software under Linux. Using no-cost virtualization software, it is possible to run Windows and NaturallySpeaking under Linux. VMware Server or VirtualBox support copy and paste to/from a virtual machine, making dictated text easily transferable to/from the virtual machine.
See also[ edit ]
- Speech recognition
- Speech interface guideline
- List of speech recognition software
References[ edit ]
- ^ A TensorFlow implementation of Baidu’s DeepSpeech architecture , Mozilla, 2017-12-05, retrieved 2017-12-05
- ^ Lera KDE git repository – (2015) – https://cgit.kde.org/scratch/grasch/lera.git/ Retrieved 2017-07-25.
- ^ “Speech to text online, Windows and Linux integration” . speechpad.pw.
- ^ “andre-luiz-dos-santos/speech-app” . GitHub. 2018-07-12.
- ^ “The Nerd Show – Platypus” . thenerdshow.com.
- ^ “FreeSpeech Realtime Speech Recognition and Dictation” . TheNerdShow.com.
- ^ “Vedics” .
- ^ “Projects/GnomeVoiceControl – GNOME Wiki!” . wiki.gnome.org.
- ^ “rcorcs/NatI” . GitHub. 2018-09-24.
- ^ “worden341/sphinxkeys” . GitHub. 2016-07-11.
- ^ Simon KDE – Main Developer until 2015 Peter Grasch – (accessed 2017/09/04) – http://simon.kde.org/ ]
- ^ Kiecza, Daniel. “Linux” . www.kiecza.net.
- ^ “Open Mind Speech – Free Speech Recognition for Linux” . freespeech.sourceforge.net.
- ^ Open Mind Initiative Archived 2003-08-05 at the Wayback Machine .
- ^ “Perlbox.org Linux Speech Control and Voice Recognition” . perlbox.sourceforge.net.
- ^ “Xvoice” . xvoice.sourceforge.net.
- ^ “:: Verbio :” . www.verbio.com.
- ^ “SRI Speech: Home” . www.speechatsri.com.
- ^ (IAR), Roedder, Margit (26 January 2018). “KIT – Janus Recognition Toolkit” . isl.ira.uka.de.
- ^ “Speech Recognition Software – LumenVox” . Retrieved 2013-02-28.
- ^ vocapia.com. “Speech to Text Software & Service – Speech Recognition Software” . www.vocapia.com.
- ^ “WineHQ – Dragon Naturally Speaking” . appdb.winehq.org.
External links[ edit ]
- Speech Synthesis & Analysis Software
- Gnome Voice Control (an incomplete speech recognition solution for GNOME) – Demonstration
- Speech Recognition Software – list of speech recognition projects and solutions in Linux
- Accessibility / SpeechRecognition – Ubuntu Help
- Alternatives to Nuance Dragon NaturallySpeaking
- Linux audio video-related software
- Speech recognition
- GNOME Accessibility
- Webarchive template wayback links
- Articles needing expert attention with no reason or talk parameter
- Articles needing unspecified expert attention
- Articles needing expert attention from March 2008
- All articles needing expert attention
- Wikipedia articles that are too technical from February 2012
- All articles that are too technical
- Articles needing expert attention from February 2012
- Articles needing additional references from February 2012
- All articles needing additional references
- Wikipedia external links cleanup from February 2012
- Wikipedia spam cleanup from February 2012
- Articles with multiple maintenance issues
- Incomplete lists from April 2017
- This page was last edited on 10 October 2018, at 09:53 (UTC).
- Text is available under the Creative Commons Attribution-ShareAlike License ;
- About Wikipedia
- Contact Wikipedia
- Cookie statement
- Mobile view