retinaface

所属分类:模式识别(视觉/语音等)
开发工具:Julia
文件大小:0KB
下载次数:0
上传日期:2021-03-31 08:21:29
上 传 者sh-1993
说明:  “用于图像文本检索的上下文感知注意网络”一文在Julia编程语言中的非正式实现,
(An Unofficial Implementation of the Paper "Context-Aware Attention Network for Image-Text Retrieval" in Julia Programming Language,)

文件列表:
BBTNet/ (0, 2021-03-31)
BBTNet/backbones/ (0, 2021-03-31)
BBTNet/backbones/context_module.jl (1153, 2021-03-31)
BBTNet/backbones/fpn.jl (1761, 2021-03-31)
BBTNet/backbones/resnet.jl (7620, 2021-03-31)
BBTNet/backbones/ssh.jl (1115, 2021-03-31)
BBTNet/core/ (0, 2021-03-31)
BBTNet/core/activations.jl (306, 2021-03-31)
BBTNet/core/blocks.jl (4155, 2021-03-31)
BBTNet/core/initializers.jl (552, 2021-03-31)
BBTNet/core/layers.jl (2949, 2021-03-31)
BBTNet/core/losses.jl (427, 2021-03-31)
BBTNet/core/metrics.jl (4452, 2021-03-31)
BBTNet/datasets/ (0, 2021-03-31)
BBTNet/datasets/WIDERFACE.jl (3601, 2021-03-31)
BBTNet/models/ (0, 2021-03-31)
BBTNet/models/pth_load_retinaface.jl (12051, 2021-03-31)
BBTNet/models/retinaface.jl (15908, 2021-03-31)
BBTNet/utils/ (0, 2021-03-31)
BBTNet/utils/ImageReader.jl (5585, 2021-03-31)
BBTNet/utils/box_processes.jl (5834, 2021-03-31)
BBTNet/utils/draw.jl (1615, 2021-03-31)
LICENSE (1078, 2021-03-31)
configs.jl (1545, 2021-03-31)
data/ (0, 2021-03-31)
data/images/ (0, 2021-03-31)
data/images/test.jpg (110760, 2021-03-31)
data/images/test2.jpg (178249, 2021-03-31)
data/images/test3.png (128738, 2021-03-31)
data/info.txt (545, 2021-03-31)
data/results/ (0, 2021-03-31)
data/results/evaluated.jpg (184441, 2021-03-31)
data/results/evaluated2.jpg (180711, 2021-03-31)
data/results/evaluated3.jpg (112932, 2021-03-31)
... ...

# RetinaFace: Single-shot Multi-level Face Localisation in the Wild ## Description This project is an unofficial implementation of the paper "RetinaFace: Single-shot Multi-level Face Localisation in the Wild" in Julia programming language. **Abstract of the Paper:** Though tremendous strides have been made in uncontrolled face detection, accurate and efficient 2D face alignment and 3D face reconstruction in-the-wild remain an open challenge. In this paper, we present a novel single-shot, multi-level face localisation method, named RetinaFace, which unifies face box prediction, 2D facial landmark localisation and 3D vertices regression under one common target: point regression on the image plane. To fill the data gap, we manually annotated five facial landmarks on the WIDER FACE dataset and employed a semi-automatic annotation pipeline to generate 3D vertices for face images from the WIDER FACE, AFLW and FDDB datasets. Based on extra annotations, we propose a mutually beneficial regression target for 3D face reconstruction, that is predicting 3D vertices projected on the image plane constrained by a common 3D topology. The proposed 3D face reconstruction branch can be easily incorporated, without any optimisation difficulty, in parallel with the existing box and 2D landmark regression branches during joint training. Extensive experimental results show that RetinaFace can simultaneously achieve stable face detection, accurate 2D face alignment and robust 3D face reconstruction while being efficient through single-shot inference. ## Sample Result ![Sample Image Detection Result 1](https://github.com/barisbatuhan/retinaface/blob/master/./data/results/evaluated.jpg) ## Requirements * Julia >= v1.5.3 (Latest is preferred) * Knet >= v1.4.5 (Latest is preferred) * CUDA >= 11.0 (Optional: Only required for running the code in GPU, latest is preferred) * Python v3.x (Optional: Only required if WIDER FACE validation data evaluation will be made) ## First Setup * All the packages required to be installed are found under `setup.jl`. To install packages to you can directly run that source file (you can also type `make setup` to run it). * To train or predict boxes and landmarks by using this repository, please initialize the parameters in `configs.jl` first. Especially please assign correct paths for the dataset directory. * All the training, predicting and evaluating commands are available in the makefile. Please check that file before trying to run the code. **Note:** In order to use the `make` command, the operating system should be a linux based distro or macOS. To use this command on Windows 10, please install [**GNU Make**](https://github.com/barisbatuhan/retinaface/blob/master/https://www.gnu.org/software/make/). ## Links * [WIDERFACE](https://github.com/barisbatuhan/retinaface/blob/master/http://shuoyang1213.me/WIDERFACE/) * [WIDERFACE Landmark Annotations](https://github.com/barisbatuhan/retinaface/blob/master/https://www.dropbox.com/s/7j70r3eeepe4r2g/retinaface_gt_v1.1.zip?dl=0) * [ImageNet Weights for ResNet50](https://github.com/barisbatuhan/retinaface/blob/master/https://www.vlfeat.org/matconvnet/models/imagenet-resnet-50-dag.mat) * [Weights to Pretrained Models](https://github.com/barisbatuhan/retinaface/blob/master/https://drive.google.com/drive/folders/1GTyTgfmAG2BXvbDDy5n9Jv2ajv1IvWaw?usp=sharing) **Note:** You can find the default parameters of each of the pretrained models in [**this file**](https://github.com/barisbatuhan/retinaface/blob/master/./weights/info.txt). ## Demonstration of the Network ![Network Graph](https://github.com/barisbatuhan/retinaface/blob/master/./data/readme/network.JPG) ## Results & Evaluation Model | WIDER Easy AP | WIDER Medium AP | WIDER Hard AP | --- | --- | --- | --- | Official Paper | 96.6 | 95.9 | 91.1 | [Official Shared Sub-Model](https://github.com/barisbatuhan/retinaface/blob/master/https://github.com/deepinsight/insightface/tree/master/detection/RetinaFace) | 94.9 | 93.9 | 88.3 | [PyTorch Weights Loaded](https://github.com/barisbatuhan/retinaface/blob/master/https://github.com/biubug6/Pytorch_Retinaface) | 77.8 | 80.3 | 73.8 | *Cascaded Model* | 83.1 | 84.9 | 76.3 | *No-Cascade Model* | 87.3 | 88.3 | 78.3 | Here, AP is calculated by taking the IOU threshold as 0.5. ## Notes * If you just try to predict faces in images, please use the No-Cascade version since it provides more stable bounding box predictions. * Currently the landmark localization task does not work properly, this task is in W.I.P. ## Extra Visualization ![Image2](https://github.com/barisbatuhan/retinaface/blob/master/./data/results/evaluated2.jpg) ![Image3](https://github.com/barisbatuhan/retinaface/blob/master/./data/results/evaluated3.jpg)

近期下载者

相关文件


收藏者