Whisper (OpenAI)

Whisper is a cutting-edge automatic speech recognition (ASR) system created by OpenAI. Trained on 680,000 hours of multilingual and multitask supervised data from the web, Whisper boasts improved robustness to accents, background noise, and technical language. It provides transcription services in multiple languages and translates those languages into English. Whisper uses an encoder-decoder Transformer architecture that captures 30-second audio chunks, converts them to log-Mel spectrograms, and predicts corresponding text captions. Its large and diverse dataset helps Whisper outperform existing systems in zero-shot performance across diverse scenarios.