Skip to content

Latest commit

 

History

History
468 lines (403 loc) · 32.5 KB

README.md

File metadata and controls

468 lines (403 loc) · 32.5 KB

Awesome Style Transfer Papers

Awesome

Survey Update License: MIT Stars

Methods | Applications | Datasets | Contributing

🎨 About This Repository

A collection of research papers, datasets, and resources related to Style Transfer across various domains. This repository offers a curated list of methods, from traditional techniques to the more recent diffusion models, to provide insights into the ongoing advancements in style transfer.

Style Transfer Examples

Content Image Style Image Transferred Result
City Scene Van Gogh's Starry Night Artistic City

From:S2WAT: Image Style Transfer via Hierarchical Vision Transformer using Strips Window Attention

Key Features:

  • 📚 Traditional Methods: Neural style transfer and its variants
  • 🖼️ GAN-based Methods: Generative approaches for style transfer
  • 🎯 VAE-based Methods: Variational methods for style manipulation
  • 🌟 Diffusion-based Methods: Latest advances in diffusion models
  • 📊 Applications: Portrait, Video, 3D, Text style transfer
  • 💾 Datasets: Curated datasets for style transfer research

📑 Table of Contents

  1. Methods

  2. Applications

  3. Datasets

Methods

Traditional Methods

Title Year Publish Paper Code
Neural Style Transfer (NST) 2015 CVPR paper -
Fast Style Transfer 2016 ECCV paper code
Texture Net 2016 arXiv paper code
Instance Normalization 2016 arXiv paper code
Universal Style Transfer 2017 NIPS paper -
Light-weight Style Transfer 2017 CVPR paper code
Arbitrary Style Transfer in Real-time with Adaptive Instance Normalization 2017 ICCV paper code
Histogram Loss 2017 CVPR paper code
Multimodal Style Transfer (AdaIN Extension) 2018 CVPR paper code
Avatar-Net 2018 CVPR paper code
NST-MetaNet 2018 CVPR -
AMST 2019 CVPR paper -
SEAN 2020 CVPR paper code
AdaAttN 2021 ICCV paper code
ArtFlow 2021 CVPR paper code
CLIPstyler 2021 CVPR paper code
Style Transfer by Rigid Alignment in Neural Net Feature Space 2021 CVPR paper -
Content and style disentanglement for artistic style transfer 2022 ICCV paper code
Region-controlled Style Transfer 2023 arXiv paper -
Optimal Image Transport on Sparse Dictionaries 2023 arXiv paper -
Puff-Net: Efficient Style Transfer with Pure Content and Style Feature Fusion Network 2024 CVPR paper code
S2WAT: Image Style Transfer via Hierarchical Vision Transformer using Strips Window Attention 2024 AAAI paper code
Extending user control for image stylization using hierarchical style transfer networks 2024 Heliyon paper -
Relu-oscillator: Chaotic vgg10 model for real-time neural style transfer on painting au- thentication 2024 ESWA paper -
AEANet: Affinity Enhanced Attentional Networks for Arbitrary Style Transfer 2024 arXiv paper -
Artistic Neural Style Transfer Algorithms with Activation Smoothing 2024 arXiv paper -
StyleMamba 2024 arXiv paper code

GAN-based Methods

Title Year Publish Paper Code
GAN 2014 NeurIPS paper -
DCGAN 2015 ICLR paper -
LAPGAN 2015 ICML paper -
ImprovedGAN 2016 NeurIPS paper -
EBGAN 2016 arXiv paper -
VideoGAN 2016 NeurIPS paper -
InfoGAN 2016 NeurIPS paper -
CycleGAN 2017 ICCV paper code
PGGAN 2017 ICLR paper -
WGAN 2017 ICML paper -
LSGAN 2017 ICCV paper -
BEGAN 2017 ICLR paper -
Pix2Pix 2017 CVPR paper code
FID-GAN 2017 NeurIPS paper -
DualGAN 2017 ICCV paper -
SeqGAN 2017 AAAI paper -
SRGAN 2017 CVPR paper -
ArtGAN 2017 arxiv paper code
ComboGAN 2017 CVPR paper -
Identity-aware CycleGAN 2017 arXiv paper -
PoseNormGAN 2017 ECCV paper -
BigGAN 2018 ICLR paper code
GANimation 2018 ECCV paper -
PacGAN 2018 NeurIPS paper -
RecycleGAN 2018 CVPR paper -
StarGAN 2018 CVPR paper code
MaskGAN 2018 ICLR paper -
POGAN-Dehaze 2018 arXiv paper -
ChipGAN 2018 ACM paper -
StyleGAN 2019 CVPR paper code
GANPaint 2019 SIGGRAPH paper -
SinGAN 2019 ICCV paper code
SAGAN 2019 ICML paper -
StyleGAN2 2020 CVPR paper code
ConSinGAN 2020 CVPR paper code
PaintGAN 2020 ECCV paper -
TecoGAN 2020 ICLR paper code
U-GAT-IT 2020 ICLR paper code
NICE-GAN 2020 CVPR paper code
White-box-Cartoonization 2020 CVPR paper code
E2ECP 2020 CVPR paper -
StyleGAN3 2021 NeurIPS paper code
GANformer 2021 CVPR paper -
FastGAN 2021 arXiv paper -
BlendGAN 2021 arXiv paper -
CoModGAN 2021 CVPR paper code
StyleSwin 2022 CVPR paper -
SemanticStyleGAN 2022 CVPR paper -
InstGAN 2022 CVPR paper -
Style-Aware-Discriminator 2022 CVPR paper code
GP-UNIT 2022 CVPR paper code
GigaGAN 2023 CVPR paper code
CLCAE 2023 CVPR paper -
DeltaEdit 2023 CVPR paper code
NoisyTwins 2023 CVPR paper -
AdaptiveMix 2023 CVPR paper -
CREPS 2023 CVPR paper -
CoralStyleCLIP 2023 CVPR paper -
ISSA 2023 arXiv paper code
zGAN 2024 arXiv paper -
mmist 2024 WACV paper -
CCST-GAN 2024 ICIP paper -
JPSF-SD-ControlNet 2024 arXiv paper -
MRStyle 2024 arXiv paper -

VAE-based Methods

Title Year Publish Paper Code
VAE 2013 ICLR paper -
Conditional VAE (CVAE) 2015 NeurIPS paper -
Hierarchical VAE 2016 NeurIPS paper -
β-VAE 2017 ICLR paper -
VQ-VAE 2017 NeurIPS paper -
InfoVAE (MMD-VAE) 2017 arXiv [paper] -
WAE 2017 ICLR [paper] -
FactorVAE 2018 ICML [paper] -
DIP-VAE 2018 ICLR [paper] -
β-TCVAE 2018 ICML [paper] -
BigVAE 2019 ICLR [paper] -
VQ-VAE-2 2019 NeurIPS [paper] -
NVAE 2020 NeurIPS [paper] -
Parallel VAE 2020 ICML [paper] -
StyleVAE 2021 CVPR [paper] -
Score-VAE 2021 NeurIPS [paper] -
Distilled-VAE 2022 ICML [paper] -
Masked-VAE 2023 CVPR [paper] -
DynamicVAE 2023 AAAI [paper] -
RFE-DiffSketch 2024 arXiv [paper] -

Diffusion-based Methods

Title Year Publish Paper Code
DDIM 2020 NeurIPS paper code
IDDPM 2021 ICML paper -
SBGMLS 2021 NeurIPS paper -
SBGM-SDE 2021 ICML paper -
MLT-SBDM 2021 NeurIPS paper -
SDDMDSS 2021 NeurIPS paper -
DiffusionCLIP 2022 CVPR paper code
HRIS-LDM 2022 CVPR paper code
DPM-Solver 2022 NeurIPS paper code
SBGM-CDLD 2022 - - -
VQDM-TIS 2022 CVPR - -
CCDF-SC 2022 CVPR - -
PNM-DMM 2022 - - -
ASM-ISIG 2022 - - -
StyleDiffusion 2023 - paper -
gDDIM 2023 - paper -
FS-DM-EI 2023 - - -
DACDM 2023 - - -
StyleID 2023 - paper code
PortraitDiff 2024 - paper code
CMCDM 2024 - - -
SGAT-DM 2024 - - -
CFM-Velocity 2024 - - -
ADM-MP 2024 - - -
HEDSDM 2024 - - -
SLDM 2024 - - -
REDAP 2024 - - -
ARTID 2024 - - -
TiNO-Edit 2024 - - -
IDIS-CP 2024 - - -
SCEPTER 2024 - paper code
MagicFace 2024 - paper code
InstantID 2024 - paper code
CreativeSynth 2024 - paper code
B-LoRA 2024 - paper code
DEADiff 2024 - - -
DRL 2024 - - -
StyleTokenizer 2024 - paper code
PFGM 2022 NeurIPS paper -
VP-DGM-SM 2021 ICLR paper -
Frido-FPD 2022 - paper -
GLIDE 2022 ICLR paper -
DreamBooth 2023 ICLR paper code
UniTune 2023 - paper -
RealCompo 2024 - paper -
EditWorld 2024 - paper -
IterComp 2024 - paper -
AdaptiveDiffusion 2024 - paper -
Step-Adaptive Training 2024 - paper -
AdaDiff 2024 - paper -
MDT 2024 - paper -
U-ViT 2023 - paper -
DiffiT 2024 - paper -
FastDiff 2 2023 - paper -
HLDM-TFIST 2024 - paper -
ZeroShotCL 2023 - paper -
MTID-MLLM 2024 - paper -
MUMU 2024 - paper -
Rectified Diffusion 2024 - paper -

Applications

Portrait Style Transfer

Title Year Publish Paper Code
APDrawingGAN 2019 CVPR paper code
WarpGAN 2020 CVPR paper code
AiSketcher 2020 IROS paper code
Cartoon-StyleGAN 2021 Arxiv paper code
SPatchGAN 2021 ICCV paper code
StyleCariGAN 2021 SIGGRAPH paper code
CariMe 2021 TMM paper code
BlendGAN 2021 NeurIPS paper code
DynaGAN 2022 SIGGRAPH paper code
TargetCLIP 2022 ECCV paper code
DCT-Net 2022 TOG paper code
GODA 2022 NeurIPS paper code
Mind the Gap 2022 ICLR paper code
MMFS 2023 PG paper code
Fix the Noise 2023 CVPR paper code
SSR-Encoder 2024 CVPR paper code
InstantStyle 2024 ArXiv paper code
Pair Customization 2024 ArXiv paper code
ZePo 2024 ACM MM paper code
DoesFS 2024 CVPR paper code

Video Style Transfer

Title Year Publish Paper Code
ReCoNet 2018 - paper code
Learning Linear Transformations 2019 CVPR paper code
Layered Neural Atlases 2021 - paper code
VToonify 2022 - paper code
CCPL 2022 - paper code
FateZero 2023 - paper code
CAP-VSTNet 2023 - paper code
Control A Video 2023 - paper code
Rerender A Video 2023 - paper code
Style-A-Video 2023 - paper code
Hallo1 2024 - paper code
Hallo2 2024 - paper code
Hallo3 2024 - paper code

3D Style Transfer

Title Year Publish Paper Code
RSMT 2023 SIGGRAPH paper code
DiffuseStyleGesture 2023 - paper code
CAMDM 2024 - paper code
Local Motion Phases 2022 - paper code

Text Style Transfer

Title Year Publish Paper Code
Sequence to Better Sequence 2017 ICML paper code
Toward Controlled Generation of Text 2017 - paper code
Style Transfer from Non-Parallel Text 2017 NeurIPS paper code
Adversarially Regularized Autoencoders 2018 - paper code
Delete, Retrieve, Generate 2018 - paper code
Style Transfer Through Back-Translation 2018 - paper code
Disentangled Representation Learning 2019 - paper code
Learning Sentiment Memories 2018 - paper code
Unsupervised Controllable Text 2019 - paper code
Dual Reinforcement Learning 2019 - paper code

Domain Adaptation

Title Year Publish Paper Code
One-Shot Domain Adaptation 2020 CVPR paper -
Meta Face Recognition 2020 - paper code
Cross-Domain Document Detection 2020 CVPR paper code
StereoGAN 2020 CVPR paper -
Domain Adaptation for Dehazing 2020 CVPR paper -
PointDAN 2019 - paper code
GCAN 2019 CVPR paper -
DCAN 2020 - paper code

Datasets

Image Dataset

Dataset Year Size Description Link
Danbooru2017 2017 1.9TB, 2.94M images Anime link
Chinese Style Transfer 2018 1000 content, 100 style images Chinese Painting link
Stylized ImageNet 2018 ~134GB Style Transfer link
WikiArt 2018 42,129 images Style, Artist, Genre link
FFHQ 2019 70,000 images Human Faces link
Dark Zurich Dataset 2019 8,779 images Night, Twilight, Day link
Comic Faces 2020 20K images Paired Synthetic Comics link
iFakeFaceDB 2020 87,000 images Face Images link
Ukiyo-e Faces 2020 5,209 images Aligned Ukiyo-e Faces link
DFFD 2020 299,039 images Face Manipulation link
MetFaces 2020 1,336 images Artistic Faces link
AAHQ 2021 25,000 images Artistic Faces link
StyleGAN Human 2022 40K+ images Human Generation link
DiffusionDB 2022 14M images Text-to-image link
4SKST 2023 25 color, 100 sketches Sketch Style link
JourneyDB 2023 4.4M images Multimodal Vision link
DiffusionFace 2024 600,000 images Face Forgery link
Trailer Faces HQ 2024 187K faces Facial Expressions link
StyleShot 2024 - Style Transfer link

Video Dataset

Dataset Year Size Description Link
UADFV 2018 100 videos Video Style Transfer link
Deepfake-TIMIT 2018 960 videos Face Recognition link
DFFD 2019 300 videos Diverse Fake Face link
Celeb-DF 2020 408 original videos DeepFake link
DFDC 2020 100,000 clips DeepFake Detection link
FaceForensics++ 2019 6000 videos Swapped Face link
ForgeryNet 2021 221,247 videos Forgery Analysis link
FFIW-10K 2021 10,000 videos Face Forgery link
Wild Deepfake 2024 7,314 sequences Deepfake Detection link

3D Dataset

Dataset Year Size Description Link
100STYLE 2022 4M frames Stylized Motion Capture link
Motiondataset 2023 36,673 frames 3D Motion link

Text Dataset

Dataset Year Size Description Link
Touchdown 2020 9,326 instructions Navigation link
Yelp 2020 6.99M comments NLP Corpus link
YAFC Corpus 2018 Largest stylistic corpus Style Transfer link
ParaDetox 2020 10,000 toxic sentences Detoxification link

Data Augmentation

Title Year Publish Paper Code
STaDA 2019 VISIGRAPP paper -
CycleGAN-Emotion Augmentation 2019 VISIGRAPP paper -
Cross-Domain NST Augmentation 2019 arXiv paper -
AugMix 2019 arXiv paper code
InstaBoost 2019 arXiv paper code
CutMix 2019 arXiv paper code
Parallel Formality Augmentation 2020 ACL paper -
Albumentations 2020 Information paper code
AugLy 2022 arXiv paper code

Contributing

We welcome contributions! Here's how you can help:

  • 🐛 Report bugs and issues
  • 💡 Suggest new papers or resources
  • 🔧 Submit pull requests
  • ⭐ Star this repository if you find it helpful!

Feel free to open an issue or submit a pull request if you:

  • Have any suggestions or corrections
  • Want to add new papers or resources
  • Find any broken links

Citation

If you find this repository useful for your research, please consider citing:



Star History


Star History Chart


Acknowledgments


Thanks to all researchers and developers who made their work publicly available.








  By Monet's Impression of Sunrise