USIP: Unsupervised Stable Interest Point Detection from 3D Point Clouds. ICCV 2019,
Seoul, Korea
Jiaxin Li, Gim Hee Lee
Department of Computer Science, National University of Singapore
@article{li2019usip,
title={USIP: Unsupervised Stable Interest Point Detection from 3D Point Clouds},
author={Li, Jiaxin and Lee, Gim Hee},
journal={arXiv preprint arXiv:1904.00229},
year={2019}(
}
USIP detector: an Unsupervised Stable Interest Point detector that can detect highly repeatable and accurately localized keypoints from 3D point clouds under arbitrary transformations without the need for any ground truth training data.
Examples of keypoints detected by our USIP are shown below for ModelNet40, Redwood, Oxford RobotCar, KITTI, respectively.
This repository consists of point cloud keypoint detector / descriptor for Oxford RobotCar, KITTI, SceneNN, ModelNet40, 3DMatch.
Rquirements:
- Python 3
- PyTorch 1.1 or higher
- visdom
- Compile customized cuda module - index_max:
cd models/index_max_ext
python3 setup.py install
- Compile customized cuda module - ball_query:
cd models/ball_query_ext
python3 setup.py install
- Python wrapper over PCL point cloud keypoint detectors: ISS, Harris3D, SIFT3D: https://github.com/lijx10/PCLKeypoints
python3 setup.py install
This Google Drive link contains datasets used in our paper: KITTI, Oxford RobotCar, 3DMatch, ModelNet40, Redwood, SceneNN.
This Google Drive link contains our trained models for some datasets.
Each folder of kitti, match3d, modelnet, oxford, scenenn contains configuration script ooptions_*** and training scripts train_***. Please modify the configurations files before running the training scripts. For example, you may have to modify the default value of --dataset, --dataroot, --gpu_ids.
- Save detected keypoints via
evaluation/save_keypoints.py - Run Matlab based evaluation code via
evaluation/matlab
We use visdom for visualization. Various loss values and the reconstructed point clouds (in auto-encoder) are plotted in real-time. Please start the visdom server before training, otherwise there will be warnings/errors, though the warnings/errors won't affect the training process.
python3 -m visdom.server
The visualization results can be viewed in browser with the address of:
http://localhost:8097
This repository is released under GPL-3.0 License (see LICENSE file for details).