mtcnn-caffe-master

所属分类:其他
开发工具:Python
文件大小:8172KB
下载次数:4
上传日期:2019-09-26 17:50:36
上 传 者一一hh
说明:  MTCNN,Multi-task convolutional neural network(多任务卷积神经网络),将人脸区域检测与人脸关键点检测放在了一起,它的主题框架类似于cascade。总体可分为P-Net、R-Net、和O-Net三层网络结构。
(MTCNN, Multi-task convolutional neural network (multi-task convolutional neural network), puts face region detection and key point detection together, and its subject framework is similar to cascade. Overall, it can be divided into three layers: P-Net, R-Net and O-Net.)

文件列表:
12net (0, 2018-10-01)
12net\12net-cls-only.caffemodel (27148, 2018-10-01)
12net\12net.caffemodel (28163, 2018-10-01)
12net\12net.prototxt (2354, 2018-10-01)
12net\pythonLayer.py (8792, 2018-10-01)
12net\runcaffe.sh (179, 2018-10-01)
12net\solver.prototxt (319, 2018-10-01)
12net\train12.png (198158, 2018-10-01)
12net\train12.prototxt (3582, 2018-10-01)
24net (0, 2018-10-01)
24net\24net-only-cls.caffemodel (399982, 2018-10-01)
24net\24net.caffemodel (407910, 2018-10-01)
24net\24net.prototxt (2969, 2018-10-01)
24net\pythonLayer.py (9638, 2018-10-01)
24net\runcaffe.sh (133, 2018-10-01)
24net\solver.prototxt (318, 2018-10-01)
24net\train24.png (171080, 2018-10-01)
24net\train24.prototxt (4005, 2018-10-01)
48net (0, 2018-10-01)
48net\48net-only-cls.caffemodel (1543381, 2018-10-01)
48net\48net.caffemodel (1558412, 2018-10-01)
48net\48net.prototxt (3897, 2018-10-01)
48net\pythonLayer.py (9650, 2018-10-01)
48net\runcaffe.sh (221, 2018-10-01)
48net\solver.prototxt (318, 2018-10-01)
48net\train48.png (211725, 2018-10-01)
48net\train48.prototxt (4803, 2018-10-01)
_config.yml (26, 2018-10-01)
demo (0, 2018-10-01)
demo\12net.caffemodel (28163, 2018-10-01)
demo\12net.prototxt (2354, 2018-10-01)
demo\24net.caffemodel (407910, 2018-10-01)
demo\24net.prototxt (2969, 2018-10-01)
demo\48net.caffemodel (1558412, 2018-10-01)
demo\48net.prototxt (3931, 2018-10-01)
demo\result.jpg (373149, 2018-10-01)
demo\test.py (3390, 2018-10-01)
... ...

# mtcnn-caffe Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Neural Networks. This project provide you a method to update multi-task-loss for multi-input source. ![result](https://github.com/CongWeilin/mtcnn-caffe/blob/master/demo/result.jpg) ## Requirement 0. Ubuntu 14.04 or 16.04 1. caffe && pycaffe: [https://github.com/BVLC/caffe](https://github.com/BVLC/caffe) 2. cPickle && cv2 && numpy ## Train Data The training data generate process can refer to [Seanlinx/mtcnn](https://github.com/Seanlinx/mtcnn) Sample almost similar to Seanlinx's can be found in `prepare_data` - step1. Download Wider Face Training part only from Official Website and unzip to replace `WIDER_train` - step2. Run `gen_12net_data.py` to generate 12net training data. Besides, `gen_net_imdb.py` provide you an example to build imdb, Remember changing and adding new params. - step3. Run `gen_12net_hard_example.py` to generate hard sample. Run `gen_24net_data.py`. Combine these output and generate imdb. - step4. Similar to last step, Run `gen_24net_hard_example.py` to generate hard sample. Run `gen_48net_data.py`. Combine these output and generate imdb. Strongly suggest readers generate training data themselves. The sample training data of 12net and 24net is available( Too big for Baidu Drive to upload 48net) by sending [Email](cong_weilin@qq.com) ## Net The main idea is block backward propagation for different task 12net ![12net](https://github.com/CongWeilin/mtcnn-caffe/blob/master/12net/train12.png) 24net ![24net](https://github.com/CongWeilin/mtcnn-caffe/blob/master/24net/train24.png) 48net ![48net](https://github.com/CongWeilin/mtcnn-caffe/blob/master/48net/train48.png) ## Questions The Q&A bellow can solve most of your problem. Q1: What data base do you use?
A1: Similar to official paper, Wider Face for detection and CelebA for alignment. Q2: What is "12(24/48)net-only-cls.caffemodel" file for?
A2: Provide a initial weigh to train. Since caffe's initial weigh is random, a bad initial weigh may take a long ran to converge even might overfit before that. Q3: Why preprocess images by minus 128?
A3: Separating data from (0,+) to (-,+), can make converge faster and more accurate. Refer to [Batch Normalization Accelerating Deep Network Training by Reducing Internal Covariate Shift](https://arxiv.org/abs/1502.03167) Q4: Do you implement OHEM(Online-Hard-Example-Mining)?
A4: No. OHEM is used when training data is not that much big. Refer to [faster-rcnn's writer RBG's paper](https://arxiv.org/pdf/1604.03540.pdf) Q5: Ratio positive/negative samples for 12net?
A5: This caffemodel used neg:pos=3:1. Because 12net's function is to eliminate negative answers, similar to exclusive method, we should learn more about negative elininate the wrong answer. Q6: Why your stride is different to official?
A6: If you input a (X,X) image, the output Y = (X-11)/2. Every point on output represent a ROI on input. The ROI's left side moving range = (0, X-12) on input, and (0, Y-1) on output. So that stride = (X-12)/(Y-1) ≈≈ 2 in this net. Q7: What is roi(cls/pts).imdb used for?
A7: Use imdb can feed training data into training net faster. Instead of random search data from the hard-disk, reading data from a large file once to memory will save you a lot of time. `imdb` was created by python module-cPickle. Q8: What is `tools_matrix.py` different from `tools.py`?
A8: Matrix version use linear matrix to make calculation faster(160ms on FDDB). If you are green hand in this area, read Non-Matrix version to understand each process. Q9: I want your training data for emergency use. How to use them? How to train? ...
A9: ??? ## Current Status CongWeilin updated in 2017/3/5 Update `tools_matrix.py` to make calculate faster, about 160ms/image.

近期下载者

相关文件


收藏者