|
@@ -2,32 +2,58 @@
|
|
## Proceedings of the 28th ACM International Conference on Multimedia
|
|
## Proceedings of the 28th ACM International Conference on Multimedia
|
|
**The official repository with Pytorch**
|
|
**The official repository with Pytorch**
|
|
|
|
|
|
-Currently, only the test code is available, and training scripts are coming soon
|
|
|
|
|
|
+*Our method can realize **arbitrary face swapping** on images and videos with **one single trained model**.*
|
|
|
|
+
|
|
|
|
+Currently, only the test code is available. Training scripts are coming soon
|
|
|
|
+
|
|
[](https://github.com/neuralchen/SimSwap)
|
|
[](https://github.com/neuralchen/SimSwap)
|
|
|
|
|
|
|
|
+Our paper can be downloaded from [[Arxiv]](https://arxiv.org/pdf/2106.06340v1.pdf)
|
|
|
|
+<!-- [[ACM DOI]](https://dl.acm.org/doi/10.1145/3394171.3413630)
|
|
|
|
+[[Google Drive]](https://drive.google.com/file/d/1fcfWOGt1mkBo7F0gXVKitf8GJMAXQxZD/view?usp=sharing)
|
|
|
|
+[[Baidu Drive ]](https://pan.baidu.com/s/1-TKFuycRNUKut8hn4IimvA) Password: ```ummt``` -->
|
|
|
|
+
|
|
|
|
+## Top News
|
|
|
|
|
|
-[[Arxiv paper]](https://arxiv.org/pdf/2106.06340v1.pdf)
|
|
|
|
|
|
+**`2021-06-20`**: We release the scripts for arbitrary video and image processing.
|
|
|
|
+
|
|
|
|
+## Dependencies
|
|
|
|
+- python3.6+
|
|
|
|
+- pytorch1.5+
|
|
|
|
+- torchvision
|
|
|
|
+- opencv
|
|
|
|
+- pillow
|
|
|
|
+- numpy
|
|
|
|
+- moviepy
|
|
|
|
+- insightface
|
|
|
|
|
|
-[[ACM DOI paper]](https://dl.acm.org/doi/10.1145/3394171.3413630)
|
|
|
|
|
|
+## Usage
|
|
|
|
+[Preparation](./doc/guidance/preparation.md)
|
|
|
|
|
|
-[[Google Drive Paper link]](https://drive.google.com/file/d/1fcfWOGt1mkBo7F0gXVKitf8GJMAXQxZD/view?usp=sharing)
|
|
|
|
|
|
+[Inference for image or video face swapping](./doc/guidance/usage.md)
|
|
|
|
|
|
|
|
+Training: **coming soon**
|
|
|
|
|
|
-[[Baidu Drive Paper link]](https://pan.baidu.com/s/1-TKFuycRNUKut8hn4IimvA) Password: ```ummt```
|
|
|
|
|
|
|
|
-
|
|
|
|
-
|
|
|
|
-
|
|
|
|
-
|
|
|
|
|
|
+## Video
|
|
|
|
+<img src="./doc/img/video.webp"/>
|
|
|
|
+<div>
|
|
|
|
+<img width=24% src="./doc/img/anni.webp"/>
|
|
|
|
+<img width=24% src="./doc/img/chenglong.webp"/>
|
|
|
|
+<img width=24% src="./doc/img/zhoujielun.webp"/>
|
|
|
|
+<img width=24% src="./doc/img/zhuyin.webp"/>
|
|
|
|
+</div>
|
|
|
|
|
|
## Results
|
|
## Results
|
|

|
|

|
|
|
|
|
|

|
|

|
|
|
|
|
|
-## Video
|
|
|
|
-<img src="./doc/img/video.webp"/>
|
|
|
|
|
|
|
|
|
|
+<!-- 
|
|
|
|
+
|
|
|
|
+
|
|
|
|
+ -->
|
|
|
|
|
|
|
|
|
|
**High-quality videos can be found in the link below:**
|
|
**High-quality videos can be found in the link below:**
|
|
@@ -45,34 +71,6 @@ Currently, only the test code is available, and training scripts are coming soon
|
|
[[Online Video]](https://www.bilibili.com/video/BV12v411p7j5/)
|
|
[[Online Video]](https://www.bilibili.com/video/BV12v411p7j5/)
|
|
|
|
|
|
|
|
|
|
-## Dependencies
|
|
|
|
-- python3.6+
|
|
|
|
-- pytorch1.5+
|
|
|
|
-- torchvision
|
|
|
|
-- opencv
|
|
|
|
-- pillow
|
|
|
|
-- numpy
|
|
|
|
-
|
|
|
|
-
|
|
|
|
-## Usage
|
|
|
|
-### To test the pretrained model
|
|
|
|
-```
|
|
|
|
-python test_one_image.py --isTrain false --name people --Arc_path arcface_model/arcface_checkpoint.tar --pic_a_path crop_224/6.jpg --pic_b_path crop_224/ds.jpg --output_path output/
|
|
|
|
-```
|
|
|
|
-
|
|
|
|
---name refers to the SimSwap training logs name.
|
|
|
|
-
|
|
|
|
-## Pretrained model
|
|
|
|
-
|
|
|
|
-### Usage
|
|
|
|
-There are two archive files in the drive: **checkpoints.zip** and **arcface_checkpoint.tar**
|
|
|
|
-
|
|
|
|
-- **Copy the arcface_checkpoint.tar into ./arcface_model**
|
|
|
|
-- **Unzip checkpoints.zip, place it in the root dir ./**
|
|
|
|
-
|
|
|
|
-[[Google Drive]](https://drive.google.com/drive/folders/1jV6_0FIMPC53FZ2HzZNJZGMe55bbu17R?usp=sharing)
|
|
|
|
-
|
|
|
|
-[[Baidu Drive]](https://pan.baidu.com/s/1wFV11RVZMHqd-ky4YpLdcA) Password: ```jd2v```
|
|
|
|
|
|
|
|
|
|
|
|
## To cite our paper
|
|
## To cite our paper
|
|
@@ -118,4 +116,10 @@ Learn about our other projects
|
|
|
|
|
|
[[SNGAN-Projection-pytorch]](https://github.com/neuralchen/SNGAN_Projection)
|
|
[[SNGAN-Projection-pytorch]](https://github.com/neuralchen/SNGAN_Projection)
|
|
|
|
|
|
-[[Pretrained_VGG19]](https://github.com/neuralchen/Pretrained_VGG19).
|
|
|
|
|
|
+[[Pretrained_VGG19]](https://github.com/neuralchen/Pretrained_VGG19).
|
|
|
|
+
|
|
|
|
+## Acknowledgements
|
|
|
|
+
|
|
|
|
+<!--ts-->
|
|
|
|
+* [Insightface](https://github.com/deepinsight/insightface)
|
|
|
|
+<!--te-->
|