【音声解析】アルゴリズム #まとめ編

Index

音声解析におけるアルゴリズム

音声解析における深層学習を用いたアルゴリズムを記す.

• 音声解析 #まとめ編

  • yhayato1320.hatenablog.com
    
    

• 深層学習 #まとめ編

  • yhayato1320.hatenablog.com

DNN

WaveNet / 2016

• WaveNet: A Generative Model for Raw Audio
  • [2016]
  • arxiv.org

RNN

Deep Speech / 2014

• Deep Speech: Scaling up end-to-end speech recognition
  • [2014]
  • arxiv.org

CNN

Wav2letter / 2016

• Wav2Letter: an End-to-End ConvNet-based Speech Recognition System
  • [2016 Facebook]

wav2vec /2019

• wav2vec: Unsupervised Pre-training for Speech Recognition
  • [2019]
  • arxiv.org

wav2vec 2.0 / 2020

• wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations
  • [2020]
  • arxiv.org

wav2vec-U / 2021

• Unsupervised Speech Recognition
  • [2021]
  • arxiv.org
    
    

https://t.co/Lq429vguAU
Proposed wav2vec-U for unsupervised speech recognition. It significantly outperforms the scores of conventional unsupervised methods and achieves accuracy comparable to that of supervised learning several years ago. pic.twitter.com/pRAPDI0vBS

— akira (@AkiraTOSEI) June 2, 2021

Attention

Transformer

• Transformer
  • yhayato1320.hatenablog.com

工夫・テクニック

BERT

• BERT
  • yhayato1320.hatenablog.com

Diffusion Model

• Diffusion Model
  • yhayato1320.hatenablog.com

UML / 2023

• UML: A Universal Monolingual Output Layer for Multilingual ASR
  • [2023]
  • arxiv.org

GAN

Wave-U-Net Discriminator / 2023

• Wave-U-Net Discriminator: Fast and Lightweight Discriminator for Generative Adversarial Network-Based Speech Synthesis
  • [2023]
  • arxiv.org

実装・ツール

• S3PRL-VC
  • 音声変換ツール
  • github.com

参考

• NeurIPS 2021 参加報告 前編
  • wav2vec-U
  • blog.recruit.co.jp