オムライスの備忘録

数学・統計学・機械学習・プログラミングに関することを記す

【マルチモーダル】Image Editing #まとめ編 #01

Index

Image Editing

Diffusion Model を利用した、Image Editing のアルゴリズムをまとめる.

アルゴリズム

SDEdit / 2021

InstructPix2Pix / 2022

Blended Latent Diffusion / 2022

pnp diffusion / 2023

RDM / 2023

Cross Attention Control / 2023

  • Prompt-to-Prompt Image Editing with Cross Attention Control

Collage Diffusion / 2023

StyleDiffusion / 2023

  • StyleDiffusion: Prompt-Embedding Inversion for Text-Based Editing

MDP / 2023

  • MDP: A Generalized Framework for Text-Guided Image Editing by Manipulating the Diffusion Path

PAIR-Diffusion / 2023

  • PAIR-Diffusion: Object-Level Image Editing with Structure-and-Appearance Paired Diffusion Models

MasaCtrl / 2023

  • MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editing

Paint-by-Sketch / 2023

  • Reference-based Image Composition with Sketch via Structure-aware Diffusion Model

工夫・テクニック

Content Preservation Loss / 2023

  • Zero-Shot Contrastive Loss for Text-Guided Diffusion Image Style Transfer

Taming Encoder / 2023

  • Taming Encoder for Zero Fine-tuning Image Customization with Text-to-Image Diffusion Models

DDPM Inversion / 2023

  • An Edit Friendly DDPM Noise Space: Inversion and Manipulations

3D Editing

SKED / 2023

  • SKED: Sketch-guided Text-based 3D Editing