886 sao GitHub và vẫn tăng — ethz-asl/hfnet là dự án Python mà TopGit đang theo dõi trên nền tảng. From Coarse to Fine: Robust Hierarchical Localization at Large Scale with HF-Net (https://arxiv.org/abs/1812.03506)
Tóm tắt dựng từ metadata GitHub của chính dự án — chưa có bài review TopGit. Trang sẽ tự động cập nhật khi bài review đầy đủ được xuất bản.
VÌ SAO CHƯA CÓ REVIEW
TopGit viết bài đầy đủ cho repo có nhiều sao nhất và được yêu cầu nhiều nhất. Trang này là snapshot trong thời gian chờ — xem README gốc ở tab READ ME.
➡️ For state-of-the-art visual localization and SfM, checkout our new toolbox hloc: cvg/Hierarchical-Localization 🔥
HF-Net: Robust Hierarchical Localization at Large Scale
This repository accompanies our CVPR 2019 paper From Coarse to Fine: Robust Hierarchical Localization at Large Scale. We introduce a 6-DoF visual localization method that is accurate, scalable, and efficient, using HF-Net, a monolithic deep neural network for descriptor extraction. The proposed solution achieves state-of-the-art accuracy on several large-scale public benchmarks while running in real-time.
The proposed approach won the visual localization challenge of the CVPR 2019 workshop on Long-Term Visual Localization using this codebase. We also provide trained weights for HF-Net and reconstructed SfM 3D models.
Our method is significantly more robust, accurate, and scalable than standard approaches based on direct matching.
This code allows to:
Perform state-of-the-art 6-DoF hierarchical localization using a flexible Python pipeline
Train HF-Net with multi-task distillation in TensorFlow
Evaluate feature detectors and descriptors on standard benchmarks
Build Structure-from-Motion models based on state-of-the-art learned features
Setup
Python 3.6 is required. It is advised to run the following command within a virtual environment. By default, TensorFlow 1.12 GPU will be installed. You will be prompted to provide the path to a data folder (subsequently referred as $DATA_PATH) containing the datasets and pre-trained models and to an experiment folder ($EXPER_PATH) containing the trained models, training and evaluation logs, and CNN predictions. Create them wherever you wish and make sure to provide absolute paths. PyTorch 0.4.1 is also required to run the original SuperPoint and perform GPU-accelerated feature matching.
make install # install Python requirements, setup paths
Refer to our dataset documentation for an overview of the supported datasets and their expected directory structure.
Demo
We provide a minimal example of the inference and localization with HF-Net in demo.ipynb. Download the trained model here and unpack it in $EXPER_PATH/saved_models/.
HF-Net simultaneously computes global descriptors and local features with an efficient architecture.
6-DoF Localization
We provide code to perform and evaluate our hierarchical localization on the three challenging benchmark datasets of Sattler et al: Aachen Day-Night, RobotCar Seasons, and CMU Seasons.
Required assets
Download the datasets as indicated in the dataset documentation. SfM models of Aachen, RobotCar, CMU, and Extended CMU, built SuperPoint and usable with HF-Net, are provided here. Download and unpack the HF-Net weights in $EXPER_PATH/hfnet/. To localize with NV+SP, download the network weights of NetVLAD and SuperPoint and put them in $DATA_PATH/weights/.
Exporting the predictions
We first export the local features and global descriptors for all database and query images as .npz files. For the sake of flexibility, local descriptors are exported as dense maps for database images, but as sparse samples for query images.
For HF-Net or SuperPoint:
python3 hfnet/export_predictions.py \
hfnet/configs/[hfnet|superpoint]_export_[aachen|cmu|robotcar]_db.yaml \
[superpoint/][aachen|cmu|robotcar] \
[--exper_name hfnet] \ # for HF-Net only
--keys keypoints,scores,local_descriptor_map[,global_descriptor]
python3 hfnet/export_predictions.py \
hfnet/configs/[hfnet|superpoint]_export_[aachen|cmu|robotcar]_queries.yaml \
[superpoint/][aachen|cmu|robotcar] \
[--exper_name hfnet] \ # for HF-Net only
--keys keypoints,scores,local_descriptors[,global_descriptor]
The localization parameters can be adjusted in hfnet/evaluate_[aachen|robotcar|cmu].py. The evaluation logs and estimated poses are written to $EXPER_PATH/eval/[aachen|robotcar|cmu]/<eval_name>*. Of particular interest are the PnP+RANSAC success rate, the average number of inliers per query, and the average inlier ratio.
Visualization
Successful and failed queries can be visualized in notebooks/visualize_localization_[aachen|robotcar|cmu].ipynb.
Training with multi-task distillation
Instructions to train HF-Net are provided in the training documentation.
Evaluation of local features
Instructions to evaluate feature detectors and descriptors on the HPatches and SfM datasets are provided in the local evaluation documentation.
Building new SfM models
Instructions and scripts to build SfM models using COLMAP for any learned features are provided in colmap-helpers.
Citation
Please consider citing the corresponding publication if you use this work in an academic context:
@inproceedings{sarlin2019coarse,
title={From Coarse to Fine: Robust Hierarchical Localization at Large Scale},
author={Sarlin, Paul-Edouard and Cadena, Cesar and Siegwart, Roland and Dymczyk, Marcin},
booktitle={CVPR},
year={2019}
}
Trang TopGit này là một snapshot — tab "Readme" hiển thị nguyên văn README của repo (đã bỏ link, giữ ảnh). Repo GitHub ở github.com/ethz-asl/hfnet là nguồn chính thức.
ethz-asl/hfnet có phải mã nguồn mở không?
Có — ethz-asl/hfnet phát hành theo license MIT, nghĩa là mã nguồn mở để đọc, fork và (tùy license) tái sử dụng. Mã: github.com/ethz-asl/hfnet.
ethz-asl/hfnet có website riêng không?
TopGit chưa ghi nhận URL trang chủ cho ethz-asl/hfnet. Phần README ở tab phía trên thường có link demo, hoặc xem mô tả GitHub của repo.
ethz-asl/hfnet dùng license gì?
ethz-asl/hfnet phát hành theo license MIT. Nên mở file LICENSE trên GitHub để xác nhận — license metadata đôi khi lệch với thực tế dự án.
ethz-asl/hfnet là gì?
ethz-asl/hfnet (ethz-asl/hfnet) là dự án Python trên GitHub. Theo mô tả gốc: From Coarse to Fine: Robust Hierarchical Localization at Large Scale with HF-Net (https://arxiv.org/abs/1812.03506)
Đọc đầy đủ README ở tab phía trên.
Vẫn đang phân vân về hfnet?
Một cú bấm sẽ gửi câu hỏi kèm trang này cho AI — xem AI nói gì về hfnet.