cnnimageretrieval-master

所属分类:图形图像处理
开发工具:Python
文件大小:60KB
下载次数:5
上传日期:2018-11-06 22:22:46
上 传 者happyliang
说明:  图像检索,CNN ,深度学习,搜索相似图像
(image retrival,CNN, DEEP LEARNING, RESEARCH SIMILAR IMAGES)

文件列表:
cnnblocks (0, 2018-10-09)
cnnblocks\BatchMAP.m (1148, 2018-10-09)
cnnblocks\ContrastiveLoss.m (1213, 2018-10-09)
cnnblocks\EdgeFilter.m (950, 2018-10-09)
cnnblocks\GeM.m (636, 2018-10-09)
cnnblocks\L2N.m (558, 2018-10-09)
cnnblocks\MAC.m (648, 2018-10-09)
cnnblocks\SPOC.m (655, 2018-10-09)
cnnblocks\TripletLoss.m (1163, 2018-10-09)
cnnblocks\cnn_batchmap.m (1500, 2018-10-09)
cnnblocks\cnn_contrastiveloss.m (2055, 2018-10-09)
cnnblocks\cnn_edgefilter.m (2875, 2018-10-09)
cnnblocks\cnn_gem.m (2400, 2018-10-09)
cnnblocks\cnn_tripletloss.m (2325, 2018-10-09)
cnninit (0, 2018-10-09)
cnninit\append_blocks.m (5027, 2018-10-09)
cnninit\build_network.m (1005, 2018-10-09)
cnninit\init_network.m (1223, 2018-10-09)
cnninit\merge_batch_norm.m (3782, 2018-10-09)
cnninit\remove_blocks_with_name.m (844, 2018-10-09)
cnntrain (0, 2018-10-09)
cnntrain\augment_database.m (3880, 2018-10-09)
cnntrain\get_batch.m (3175, 2018-10-09)
cnntrain\get_images.m (2342, 2018-10-09)
cnntrain\hard_neg_remine.m (4442, 2018-10-09)
cnntrain\load_opts_train.m (7638, 2018-10-09)
cnntrain\train_network.m (15677, 2018-10-09)
cnnvecs (0, 2018-10-09)
cnnvecs\cnn_vec.m (959, 2018-10-09)
cnnvecs\cnn_vecms.m (1829, 2018-10-09)
cnnvecs\cnn_vecms_sketch.m (3347, 2018-10-09)
cnnvecs\cnn_vecr.m (4253, 2018-10-09)
cnnvecs\cnn_vecrms.m (5279, 2018-10-09)
cnnvecs\vecpostproc.m (728, 2018-10-09)
examples (0, 2018-10-09)
examples\test_cnnimageretrieval.m (8490, 2018-10-09)
examples\test_cnnsketch2imageretrieval.m (4625, 2018-10-09)
examples\train_cnnimageretrieval.m (6469, 2018-10-09)
... ...

# CNN Image Retrieval in MatConvNet: Training and evaluating CNNs for Image Retrieval in MatConvNet This is a MATLAB toolbox that implements the training and testing of the approach described in our papers: **Deep Shape Matching**, Radenovic F., Tolias G., Chum O., ECCV 2018 [[arXiv](https://arxiv.org/abs/1709.03409)] **Fine-tuning CNN Image Retrieval with No Human Annotation**, Radenovic F., Tolias G., Chum O., TPAMI 2018 [[arXiv](https://arxiv.org/abs/1711.02512)] **CNN Image Retrieval Learns from BoW: Unsupervised Fine-Tuning with Hard Examples**, Radenovic F., Tolias G., Chum O., ECCV 2016 [[arXiv](http://arxiv.org/abs/1604.02426)] ## Prerequisites In order to run this toolbox you will need: 1. MATLAB (tested with MATLAB R2017a on Debian 8.1) 1. MatConvNet MATLAB toolbox version [1.0-beta25](http://www.vlfeat.org/matconvnet/download/matconvnet-1.0-beta25.tar.gz) 1. All the rest (data + networks) is automatically downloaded with our scripts ## Image retrieval This code implements: 1. Training (fine-tuning) CNN for image retrieval 1. Learning supervised whitening for CNN image representations 1. Testing CNN image retrieval on Oxford5k and Paris6k datasets Run the following script in MATLAB: ``` >> run [MATCONVNET_ROOT]/matlab/vl_setupnn; >> run [CNNIMAGERETRIEVAL_ROOT]/setup_cnnimageretrieval; >> train_cnnimageretrieval; >> test_cnnimageretrieval; ``` See ```[CNNIMAGERETRIEVAL_ROOT]/examples/train_cnnimageretrieval``` and ```[CNNIMAGERETRIEVAL_ROOT]/examples/test_cnnimageretrieval``` for additional details. We provide the pretrained networks trained using the same parameters as in our ECCV 2016 and TPAMI 2018 papers. Performance comparison with the networks trained with our [CNN Image Retrieval in PyTorch](https://github.com/filipradenovic/cnnimageretrieval-pytorch), on the original and the revisited Oxford and Paris benchmarks: | Model | Oxford | Paris | ROxf (M) | RPar (M) | ROxf (H) | RPar (H) | |:------|:------:|:------:|:------:|:------:|:------:|:------:| | VGG16-GeM (MatConvNet) | 87.9 | 87.7 | 61.9 | 69.3 | 33.7 | 44.3 | | VGG16-GeM (PyTorch) | 87.2 | 87.8 | 60.5 | 69.3 | 32.4 | 44.3 | | ResNet101-GeM (MatConvNet) | 87.8 | 92.7 | ***.7 | 77.2 | 38.5 | 56.3 | | ResNet101-GeM (PyTorch) | 88.2 | 92.5 | 65.3 | 76.6 | 40.0 | 55.2 | **Note**: Data and networks used for training and testing are automatically downloaded when using the example scripts. ## Sketch-based image retrieval and shape matching This code implements: 1. Training (fine-tuning) CNN for sketch-based image retrieval and shape matching 1. Testing CNN sketch-based image retrieval on Flickr15k dataset Run the following script in MATLAB: ``` >> run [MATCONVNET_ROOT]/matlab/vl_setupnn; >> run [CNNIMAGERETRIEVAL_ROOT]/setup_cnnimageretrieval; >> train_cnnsketch2imageretrieval; >> test_cnnsketch2imageretrieval; ``` See ```[CNNIMAGERETRIEVAL_ROOT]/examples/train_cnnsketch2imageretrieval``` and ```[CNNIMAGERETRIEVAL_ROOT]/examples/test_cnnsketch2imageretrieval``` for additional details. We provide the pretrained networks trained using the same parameters as in our ECCV 2018 paper. The Flickr15k dataset used in the paper is slightly outdated compared to the latest one that is automatically downloaded when using this code (0.1 difference in mAP), so we report results here: |EdgeMAC components||||| |:--|:--:|:--:|:--:|:--:| |Fine-tuned|x|x|x|x| |Mirror||x||x| |Multi-scale|||x|x| |mAP|42.0|43.5|45.7|46.2| **Note**: Data and networks used for testing are automatically downloaded when using the example scripts. ## Related publications ### Image retrieval ``` @article{RTC18a, title = {Fine-tuning {CNN} Image Retrieval with No Human Annotation}, author = {Radenovi{\'c}, F. and Tolias, G. and Chum, O.} journal = {TPAMI}, year = {2018} } ``` ``` @inproceedings{RTC16, title = {{CNN} Image Retrieval Learns from {BoW}: Unsupervised Fine-Tuning with Hard Examples}, author = {Radenovi{\'c}, F. and Tolias, G. and Chum, O.}, booktitle = {ECCV}, year = {2016} } ``` ### Sketch-based image retrieval and shape matching ``` @article{RTC18b, title = {Deep Shape Matching}, author = {Radenovi{\'c}, F. and Tolias, G. and Chum, O.} journal = {ECCV}, year = {2018} } ``` ### Revisited benchmarks for Oxford and Paris ('roxford5k' and 'rparis6k') ``` @inproceedings{RITAC18, author = {Radenovi{\'c}, F. and Iscen, A. and Tolias, G. and Avrithis, Y. and Chum, O.}, title = {Revisiting Oxford and Paris: Large-Scale Image Retrieval Benchmarking}, booktitle = {CVPR}, year = {2018} } ```

近期下载者

相关文件


收藏者