TopGit theo dõi microsoft/Bringing-Old-Photos-Back-to-Life trên GitHub trong nhóm AI Tools, đã đạt 15.7k sao. Bringing Old Photo Back to Life (CVPR 2020 oral)
Tóm tắt dựng từ metadata GitHub của chính dự án — chưa có bài review TopGit. Trang sẽ tự động cập nhật khi bài review đầy đủ được xuất bản.
VÌ SAO CHƯA CÓ REVIEW
TopGit viết bài đầy đủ cho repo có nhiều sao nhất và được yêu cầu nhiều nhất. Trang này là snapshot trong thời gian chờ — xem README gốc ở tab READ ME.
Old Photo Restoration (Official PyTorch Implementation)
Project Page | Paper (CVPR version) | Paper (Journal version) | Pretrained Model | Colab Demo | Replicate Demo & Docker Image :fire:
Bringing Old Photos Back to Life, CVPR2020 (Oral)
Old Photo Restoration via Deep Latent Space Translation, TPAMI 2022
Ziyu Wan1,
Bo Zhang2,
Dongdong Chen3,
Pan Zhang4,
Dong Chen2,
Jing Liao1,
Fang Wen2 1City University of Hong Kong, 2Microsoft Research Asia, 3Microsoft Cloud AI, 4USTC
:sparkles: News
2022.3.31: Our new work regarding old film restoration will be published in CVPR 2022. For more details, please refer to the project website and github repo.
The framework now supports the restoration of high-resolution input.
Training code is available and welcome to have a try and learn the training details.
You can now play with our Colab and try it on your photos.
Requirement
The code is tested on Ubuntu with Nvidia GPUs and CUDA installed. Python>=3.6 is required to run the code.
Installation
Clone the Synchronized-BatchNorm-PyTorch repository for
cd Face_Enhancement/models/networks/
git clone https://github.com/vacancy/Synchronized-BatchNorm-PyTorch
cp -rf Synchronized-BatchNorm-PyTorch/sync_batchnorm .
cd ../../../
cd Global/detection_models
git clone https://github.com/vacancy/Synchronized-BatchNorm-PyTorch
cp -rf Synchronized-BatchNorm-PyTorch/sync_batchnorm .
cd ../../
Download the landmark detection pretrained model
cd Face_Detection/
wget http://dlib.net/files/shape_predictor_68_face_landmarks.dat.bz2
bzip2 -d shape_predictor_68_face_landmarks.dat.bz2
cd ../
Download the pretrained model, put the file Face_Enhancement/checkpoints.zip under ./Face_Enhancement, and put the file Global/checkpoints.zip under ./Global. Then unzip them respectively.
cd Face_Enhancement/
wget https://github.com/microsoft/Bringing-Old-Photos-Back-to-Life/releases/download/v1.0/face_checkpoints.zip
unzip face_checkpoints.zip
cd ../
cd Global/
wget https://github.com/microsoft/Bringing-Old-Photos-Back-to-Life/releases/download/v1.0/global_checkpoints.zip
unzip global_checkpoints.zip
cd ../
Install dependencies:
pip install -r requirements.txt
:rocket: How to use?
Note: GPU can be set 0 or 0,1,2 or 0,2; use -1 for CPU
1) Full Pipeline
You could easily restore the old photos with one simple command after installation and downloading the pretrained model.
Note: Please try to use the absolute path. The final results will be saved in ./output_path/final_output/. You could also check the produced results of different steps in output_path.
2) Scratch Detection
Currently we don't plan to release the scratched old photos dataset with labels directly. If you want to get the paired data, you could use our pretrained model to test the collected images to obtain the labels.
We use a progressive generator to refine the face regions of old photos. More details could be found in our journal submission and ./Face_Enhancement folder.
NOTE:
This repo is mainly for research purpose and we have not yet optimized the running performance.
Since the model is pretrained with 256*256 images, the model may not work ideally for arbitrary resolution.
5) GUI
A user-friendly GUI which takes input of image by user and shows result in respective window.
How it works:
Run GUI.py file.
Click browse and select your image from test_images/old_w_scratch folder to remove scratches.
Click Modify Photo button.
Wait for a while and see results on GUI window.
Exit window by clicking Exit Window and get your result image in output folder.
How to train?
1) Create Training File
Put the folders of VOC dataset, collected old photos (e.g., Real_L_old and Real_RGB_old) into one shared folder. Then
cd Global/data/
python Create_Bigfile.py
Note: Remember to modify the code based on your own environment.
2) Train the VAEs of domain A and domain B respectively
If you find our work useful for your research, please consider citing the following papers :)
@inproceedings{wan2020bringing,
title={Bringing Old Photos Back to Life},
author={Wan, Ziyu and Zhang, Bo and Chen, Dongdong and Zhang, Pan and Chen, Dong and Liao, Jing and Wen, Fang},
booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
pages={2747--2757},
year={2020}
}
@article{wan2020old,
title={Old Photo Restoration via Deep Latent Space Translation},
author={Wan, Ziyu and Zhang, Bo and Chen, Dongdong and Zhang, Pan and Chen, Dong and Liao, Jing and Wen, Fang},
journal={arXiv preprint arXiv:2009.07047},
year={2020}
}
If you are also interested in the legacy photo/video colorization, please refer to this work.
Maintenance
This project is currently maintained by Ziyu Wan and is for academic research use only. If you have any questions, feel free to contact [email protected].
License
The codes and the pretrained model in this repository are under the MIT license as specified by the LICENSE file. We use our labeled dataset to train the scratch detection model.
This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact [email protected] with any additional questions or comments.
microsoft/Bringing-Old-Photos-Back-to-Life thuộc nhóm AI Tools trên TopGit, cùng 8 topic GitHub. Trang Trending và Topics liệt kê các repo cùng số sao và cùng ngôn ngữ để so sánh.
Đọc thêm về microsoft/Bringing-Old-Photos-Back-to-Life ở đâu?
Trang TopGit này là một snapshot — tab "Readme" hiển thị nguyên văn README của repo (đã bỏ link, giữ ảnh). Repo GitHub ở github.com/microsoft/Bringing-Old-Photos-Back-to-Life là nguồn chính thức.
microsoft/Bringing-Old-Photos-Back-to-Life có phải mã nguồn mở không?
Có — microsoft/Bringing-Old-Photos-Back-to-Life phát hành theo license MIT, nghĩa là mã nguồn mở để đọc, fork và (tùy license) tái sử dụng. Mã: github.com/microsoft/Bringing-Old-Photos-Back-to-Life.
microsoft/Bringing-Old-Photos-Back-to-Life có trang demo không?
Dự án có trang chủ ở https://arxiv.org/abs/2004.09484. Tab "Readme" ở trang này thường có ảnh chụp và hướng dẫn bắt đầu nhanh.
microsoft/Bringing-Old-Photos-Back-to-Life dùng license gì?
microsoft/Bringing-Old-Photos-Back-to-Life phát hành theo license MIT. Nên mở file LICENSE trên GitHub để xác nhận — license metadata đôi khi lệch với thực tế dự án.
microsoft/Bringing-Old-Photos-Back-to-Life là gì?
microsoft/Bringing-Old-Photos-Back-to-Life (microsoft/Bringing-Old-Photos-Back-to-Life) là dự án Python trên GitHub. Theo mô tả gốc: Bringing Old Photo Back to Life (CVPR 2020 oral)
Vì sao microsoft/Bringing-Old-Photos-Back-to-Life được xếp vào nhóm AI Tools?
TopGit xếp microsoft/Bringing-Old-Photos-Back-to-Life vào nhóm AI Tools dựa trên GitHub topics và mô tả của repo (gắn thẻ: "gans", "generative-adversarial-network", "image-manipulation"). Việc phân loại dựa trên metadata thật của repo, không phải đoán theo cảm tính biên tập.
Đọc đầy đủ README ở tab phía trên.
Bringing-Old-Photos-Back-to-Life có đáng để bạn bỏ thời gian?
ChatGPT, Claude và Perplexity đều đọc được trang này. Hỏi thử xem họ nghĩ gì về Bringing-Old-Photos-Back-to-Life.