Silero VAD

Silero VAD - pre-trained enterprise-grade Voice Activity Detector (also see our STT models).

Code

SAMPLING_RATE = 16000
import torch
torch.set_num_threads(1)
from IPython.display import Audio
from pprint import pprint
USE_ONNX = False # change this to True if you want to test onnx model
if USE_ONNX:
!pip install -q onnxruntime
model, utils = torch.hub.load(repo_or_dir='AmgadHasan/silero-vad',
model='silero_vad',
force_reload=True,
onnx=USE_ONNX)
(get_speech_timestamps,
save_audio,
read_audio,
VADIterator,
collect_chunks) = utils
audio_file = "myfile.mp3"
wav = read_audio(audio_file, sampling_rate=SAMPLING_RATE)
speech_timestamps, speech_probs = get_speech_timestamps(wav, model, sampling_rate=SAMPLING_RATE, max_speech_duration_s=30, max_speech_duration_buffer=5)

Real Time Example

real-time-example.mp4

Key Features

• Stellar accuracy

  Silero VAD has excellent results on speech detection tasks.

• Fast

  One audio chunk (30+ ms) takes less than 1ms to be processed on a single CPU thread. Using batching or GPU can also improve performance considerably. Under certain conditions ONNX may even run up to 4-5x faster.

• Lightweight

  JIT model is around one megabyte in size.

• General

  Silero VAD was trained on huge corpora that include over 100 languages and it performs well on audios from different domains with various background noise and quality levels.

• Flexible sampling rate

  Silero VAD supports 8000 Hz and 16000 Hz sampling rates.

• Flexible chunk size

  Model was trained on 30 ms. Longer chunks are supported directly, others may work as well.

• Highly Portable

  Silero VAD reaps benefits from the rich ecosystems built around PyTorch and ONNX running everywhere where these runtimes are available.

• No Strings Attached

  Published under permissive license (MIT) Silero VAD has zero strings attached - no telemetry, no keys, no registration, no built-in expiration, no keys or vendor lock.

Typical Use Cases

• Voice activity detection for IOT / edge / mobile use cases
• Data cleaning and preparation, voice detection in general
• Telephony and call-center automation, voice bots
• Voice interfaces

Links

• Examples and Dependencies
• Quality Metrics
• Performance Metrics
• Versions and Available Models
• Further reading
• FAQ

Get In Touch

Try our models, create an issue, start a discussion, join our telegram chat, email us, read our news.

Please see our wiki and tiers for relevant information and email us directly.

Citations

@misc{Silero VAD,
  author = {Silero Team},
  title = {Silero VAD: pre-trained enterprise-grade Voice Activity Detector (VAD), Number Detector and Language Classifier},
  year = {2021},
  publisher = {GitHub},
  journal = {GitHub repository},
  howpublished = {\url{https://github.com/snakers4/silero-vad}},
  commit = {insert_some_commit_here},
  email = {[email protected]}
}

Examples and VAD-based Community Apps

• Example of VAD ONNX Runtime model usage in C++

• Voice activity detection for the browser using ONNX Runtime Web