neuralchen/SimSwap is one of the AI-powered repositories TopGit tracks, currently at 5.2k stars, written primarily in Python. An arbitrary face-swapping framework on images and videos with one single trained model!
Snapshot summary built from the project's own GitHub metadata — there's no written TopGit review yet. The page will update automatically when a full review is published.
WHY NO REVIEW YET
TopGit writes full reviews for the most-starred, most-requested repositories. This page is a snapshot until then — see the READ ME tab for the original README in full.
SimSwap: An Efficient Framework For High Fidelity Face Swapping
Proceedings of the 28th ACM International Conference on Multimedia
The official repository with Pytorch
Our method can realize arbitrary face swapping on images and videos with one single trained model.
We are recruiting full-time engineers. If you are interested, please send an email to my team. Please refer to the website for specific recruitment conditions: Requirements
Training and test code are now available!
We are working with our incoming paper SimSwap++, keeping expecting!
The high resolution version of SimSwap-HQ is supported!
Our paper can be downloaded from [Arxiv] [ACM DOI]
This project also received support from SocialBook.
Attention
This project is for technical and academic use only. Please do not apply it to illegal and unethical scenarios.
In the event of violation of the legal and ethical requirements of the user's country or region, this code repository is exempt from liability
Please do not ignore the content at the end of this README!
If you find this project useful, please star it. It is the greatest appreciation of our work.
Top News
2023-09-26: We fixed bugs in colab!
2023-04-25: We fixed the "AttributeError: 'SGD' object has no attribute 'defaults' now" bug. If you have already downloaded arcface_checkpoint.tar, please download it again. Also, you also need to update the scripts in ./models/.
2022-04-21: For resource limited users, we provide the cropped VGGFace2-224 dataset [Google Driver] VGGFace2-224 (10.8G) [Baidu Driver] [Password: lrod].
2022-04-20: Training scripts are now available. We highly recommend that you guys train the simswap model with our released high quality dataset VGGFace2-HQ.
2021-11-24: We have trained a beta version of SimSwap-HQ on VGGFace2-HQ and open sourced the checkpoint of this model (if you think the Simswap 512 is cool, please star our VGGFace2-HQ repo). Please don’t forget to go to Preparation and Inference for image or video face swapping to check the latest set up.
2021-11-23: The google drive link of VGGFace2-HQ is released.
2021-11-17: We released a high resolution face dataset VGGFace2-HQ and the method to generate this dataset. This dataset is for research purpose.
2021-08-30: Docker has been supported, please refer here for details.
2021-08-17: We have updated the Preparation, The main change is that the gpu version of onnx is now installed by default, Now the time to process a video is greatly reduced.
2021-07-19: Obvious border abruptness has been resolved. We add the ability to using mask and upgrade the old algorithm for better visual effect, please go to Inference for image or video face swapping for details. Please don’t forget to go to Preparation to check the latest set up. (Thanks for the help from @woctezuma and @instant-high)
The first open source high resolution dataset for face swapping!!!
High Resolution Dataset VGGFace2-HQ
Dependencies
python3.6+
pytorch1.5+
torchvision
opencv
pillow
numpy
imageio
moviepy
insightface
timm==0.5.4
Training
Preparation
The training script is slightly different from the original version, e.g., we replace the patch discriminator with the projected discriminator, which saves a lot of hardware overhead and achieves slightly better results.
In order to ensure the normal training, the batch size must be greater than 1.
Friendly reminder, due to the difference in training settings, the user-trained model will have subtle differences in visual effects from the pre-trained model we provide.
[Colab for switching specific faces in multi-face videos]
Image face swapping demo & Docker image on Replicate
Video
Results
High-quality videos can be found in the link below:
[Mama(video) 1080p]
[Google Drive link for video 1]
[Google Drive link for video 2]
[Google Drive link for video 3]
[Baidu Drive link for video] Password: b26n
[Online Video]
User case
If you have some interesting results after using our project and are willing to share, you can contact us by email or share directly on the issue. Later, we may make a separate section to show these results, which should be cool.
At the same time, if you have suggestions for our project, please feel free to ask questions in the issue, or contact us directly via email: email1, email2, email3. (All three can be contacted, just choose any one)
License
For academic and non-commercial use only.The whole project is under the CC-BY-NC 4.0 license. See LICENSE for additional details.
To cite our papers
@inproceedings{DBLP:conf/mm/ChenCNG20,
author = {Renwang Chen and
Xuanhong Chen and
Bingbing Ni and
Yanhao Ge},
title = {SimSwap: An Efficient Framework For High Fidelity Face Swapping},
booktitle = {{MM} '20: The 28th {ACM} International Conference on Multimedia},
year = {2020}
}
@Article{simswapplusplus,
author = {Xuanhong Chen and
Bingbing Ni and
Yutian Liu and
Naiyuan Liu and
Zhilin Zeng and
Hang Wang},
title = {SimSwap++: Towards Faster and High-Quality Identity Swapping},
journal = {{IEEE} Trans. Pattern Anal. Mach. Intell.},
volume = {46},
number = {1},
pages = {576--592},
year = {2024}
}
Related Projects
Please visit our another ACMMM2020 high-quality style transfer project
Please visit our AAAI2021 sketch based rendering project
Please visit our high resolution face dataset VGGFace2-HQ
How does neuralchen/SimSwap compare to other AI Tools projects?
neuralchen/SimSwap is tracked by TopGit in the AI Tools category, with 5.2k GitHub stars and written in Python. Browse the AI Tools topic page on TopGit to compare it against similar projects by stars and activity.
Is neuralchen/SimSwap open source?
TopGit's metadata for neuralchen/SimSwap does not record a license. Most public repositories on GitHub ARE open source, but the exact terms vary — verify by opening the LICENSE file directly.
What else is in the AI Tools space?
neuralchen/SimSwap is tracked by TopGit under the AI Tools category, alongside 9 GitHub-tagged topics. Trending and Topics pages list peer repositories of comparable stars and language.
What is neuralchen/SimSwap?
neuralchen/SimSwap (neuralchen/SimSwap) is a Python project on GitHub. From the project's own README: An arbitrary face-swapping framework on images and videos with one single trained model!
Where do I read more about neuralchen/SimSwap?
This TopGit page is a snapshot — the READ ME tab shows the project's own README content (links stripped, images preserved). The GitHub repository at github.com/neuralchen/SimSwap is the definitive source.
Why is neuralchen/SimSwap categorized under AI Tools?
TopGit places neuralchen/SimSwap in the AI Tools category based on its GitHub topics and description (tagged: "deepfacelab", "deepfakes", "face"). Categories are assigned from real repository metadata, not editorial guesswork.
Read full README in the tab above.
Still deciding about SimSwap?
One click hands the question to an AI along with this page — see what it says about SimSwap.
/SimSwap
