【深層学習】Crossformer

Index

Crossformer

Transormer を利用した、時系列の予測モデル.

• Tranformer #まとめ編
  • 時系列解析
  • yhayato1320.hatenablog.com
    
    

いくつかの工夫をしている.

• Dimension Segment Wise (DSW) Embedding
• Two-Stage Attention (TSA)
  • Cross-Time Stage
  • Cross-Dimension Stage
• Hierarchical Encoder-Decoder (HED)

参考

• Crossformer: Transformer Utilizing Cross-Dimension Dependency for Multivariate Time Series Forecasting
  • [2023]
  • Abstract
  • 3 METHODOLOGY
    • 3.1 DIMENSION-SEGMENT-WISE EMBEDDING
    • 3.2 TWO-STAGE ATTENTION LAYER
      • Cross-Time Stage
      • Cross-Dimension Stage
    • 3.3 HIERARCHICAL ENCODER-DECODE
  • openreview.net