AssemblyAI releases Conformer-1 API, the SOTA Speech Recognition Model
AssemblyAI, the company focused on building speech, voice, and text models, announced Conformer-1, its latest state-of-the-art speech recognition model. Built on the Conformer architecture and undergoing training on 650K hours of audio data, this model attains an accuracy level comparable to that of a human, demonstrating a reduction of up to 43% in errors when processing noisy data in comparison to alternative ASR models. To improve on the Conformer architecture, the company leveraged Efficient Conformer, a modification on the original architecture that uses progressive downsampling which is inspired by ContextNet and also used Group Attention. These changes speedup the inference time by 29% and 36% training time. Click here to learn more about Conformer-1. 2/9 Conformer architectureWe use a modified version of the conformer neural net published by Google Brain.It's built on top of an Efficient Conformer (Orange Labs, 2021), that introduces the following technical modifications: pic.twitter.com/NrOxZPFR7a— AssemblyAI (@AssemblyAI) March 15, 2023 AssemblyAI took inspiration from DeepMind’s data scaling laws in the Chinchilla paper and adapted into the ASR domain, curated 650k hours of English audio, making it the largest trained supervised model. To overcome one of the biggest problems in speech recognition, the noise, the team also implemented a modified version of spare attention. It is a pruning method for attaining sparsity of the model’s weight for achieving regularisation. This is one of the greatest achievements of the model — its robustness to noise. In 2020, Google Brain released the Conformer, a neural network designed for speech recognition. It is based on the Transformer architecture, which is widely used and known for its attention mechanism and parallel processing capabilities. The Conformer architecture enhances the Transformer by incorporating convolutional layers, allowing it to effectively capture both local and global dependencies, while remaining a compact neural network design.
The team took inspiration from DeepMind’s data scaling laws in the Chinchilla paper and adapted into the ASR domain, curated 650k hours of English audio, making it the largest trained supervised model.
Built on the Conformer architecture and undergoing training on 650K hours of audio data, AssemblyAI's model attains an accuracy level comparable to that of a human, demonstrating a reduction of up to 43% in errors when processing noisy data in comparison to alternative ASR models.
["GPT4"]
["Go", "attention mechanism", "AWS", "AI", "neural network", "cloud_platforms:AWS", "programming_languages:R", "RAG", "transformer architecture", "R", "GPT4"]
["AI", "neural network", "RAG", "AWS", "R", "Go", "transformer architecture", "attention mechanism", "cloud_platforms:AWS", "programming_languages:R"]
Mohit writes about AI in simple, explainable, and often funny words. He's especially passionate about chatting with those building AI for Bharat, with the occasional detour into AGI.