【深層学習】Deformable DETR

Index

Deformable DETR

DETR の改善手法.

• DETR
  • yhayato1320.hatenablog.com

Deformable Attention Module

Deformable Attention Module の提案.

Deformable CNN から着想.

• Deformable CNN
  • yhayato1320.hatenablog.com
    
    

Attention Module が、重点的に注意を払うポイントは、 入力される Feature Map のサイズに関わらず、基準点の周辺となる.

Deformable Attention Transformer との関連は？

• Deformable Attention Transformer / DAT
• yhayato1320.hatenablog.com

Multi-scale Deformable Attention Module

その他の工夫

Iterative Bounding Box Refinement

• Raft: Recurrent all-pairs field transforms for optical flow.
  • [2020]
  • arxiv.org

参考

• Deformable DETR: Deformable Transformers for End-to-End Object Detection
  • [2020 SenseTime Research]
  • v4
  • 2 RELATED WORK
    • Efficient Attention Mechanism
    • Multi-scale Feature Representation for Object Detection
  • 3 REVISITING TRANSFORMERS AND DETR
    • Multi-Head Attention in Transformers
    • DETR
  • 4 METHOD
    • 4.1 DEFORMABLE TRANSFORMERS FOR END-TO-END OBJECT DETECTION
      • Deformable Attention Module
      • Multi-scale Deformable Attention Module
      • Deformable Transformer Encoder
      • Deformable Transformer Decoder
    • 4.2 ADDITIONAL IMPROVEMENTS AND VARIANTS FOR DEFORMABLE DETR
      • Iterative Bounding Box Refinement
      • Two-Stage Deformable DETR
  • arxiv.org

Web サイト

• Swin Transformerを超える最先端画像認識モデルDeformable Attention Transformerを詳細解説！

  • deepsquare.jp
    
    

• [DL輪読会]Vision Transformer with Deformable Attention （Deformable Attention Transformer：DAT）

  • [DL輪読会]Vision Transformer with Deformable Attention （Deformable Attention Transformer：DAT） from Deep Learning JP
    www.slideshare.net