KeywordsSpotting-EfficientNet-A0
所属分类：人工智能/神经网络/深度学习
开发工具：Python
文件大小：50KB
下载次数：0
上传日期：2022-06-16 13:47:33
上 传 者：
sh-1993
说明： 连续语音关键词定位的EfficientNet绝对零
(EfficientNet-Absolute Zero for Continuous Speech Keyword Spotting)
文件列表:
LICENSE (1078, 2022-06-16)
__main__.py (523, 2022-06-16)
config.json (695, 2022-06-16)
measure_power.py (2516, 2022-06-16)
requirements.txt (265, 2022-06-16)
server.py (5222, 2022-06-16)
service.py (6970, 2022-06-16)
utils (0, 2022-06-16)
utils\__init__.py (0, 2022-06-16)
utils\client.py (10692, 2022-06-16)
utils\efficientnet_pytorch (0, 2022-06-16)
utils\efficientnet_pytorch\__init__.py (183, 2022-06-16)
utils\efficientnet_pytorch\model.py (16994, 2022-06-16)
utils\efficientnet_pytorch\utils.py (24966, 2022-06-16)
utils\fonts.png (3152, 2022-06-16)
utils\manage_audio.py (13182, 2022-06-16)
utils\model.py (24940, 2022-06-16)
utils\record.py (4590, 2022-06-16)
utils\spec_aug.py (16705, 2022-06-16)
utils\speech_demo_tk.py (4280, 2022-06-16)
utils\train.py (12027, 2022-06-16)
# KeywordsSpotting-EfficientNet-A0
Keyword spotting in continuous speech using convolutional neural network
This is a PyTorch implementation of some popular CNN models architecture like [Deep Residual Models](https://arxiv.org/abs/1710.10361), [Convolutional Neural Networks for Keyword Spotting](https://research.googleblog.com/2017/08/launching-speech-commands-dataset.html), and our proposed architecture based on [EfficientNet](https://arxiv.org/abs/1905.11946). all models are trained on our new Persian Keyword Spotting Dataset that you can download from [Football Keywords Dataset](https://drive.google.com/file/d/1m0CoqVzneGVxfTx-uGpAXdZvPNgH9gjS/view?usp=sharing). For more details, please check out our paper [Keyword spotting in continuous speech using convolutional neural network
](https://www.sciencedirect.com/science/article/abs/pii/S016763932200084X?via%3Dihub) / [DOI](https://doi.org/10.1016/j.specom.2022.06.001).
This repository is based on [Honk-Repository](https://github.com/castorini/honk-models). Honk models can be used to identify simple commands (e.g., "stop" and "go") that trained on [Speech Commands Dataset](https://research.googleblog.com/2017/08/launching-speech-commands-dataset.html). but our work has some improvements and advantages as below:
1. We used the modified state of the art image classification architecture, `efficientNet`, as a based model.
2. Improve performance in "continuous speech" mode by our Proposed `continuous speech synthesis method`.
3. Improve robustness against noises in real samples by using various noises like bubble, stadium, ... .
4. Better generalization by using [SpecAugment](https://arxiv.org/abs/1904.08779).
5. Using our new Persian Keywords Spotting Dataset that helped us to use this project in real scenarios and projects.
## Demo Application
Use the instructions below to run the demo application (shown in the above video) yourself!
Currently, PyTorch has official support for only Linux and OS X. Thus, Windows users will not be able to run this demo easily.
To deploy the demo, run the following commands:
- change directory to KSM Repository.
- If you do not have PyTorch, please see [the website](http://pytorch.org).
- Install Python dependencies: `pip install -r requirements.txt`
- Start the PyTorch server: `python .`
- Run the demo: `python -m utils.speech_demo_tk`
If you need to adjust options, like turning off CUDA or change trained model file or ... , please edit `config.json`.
## Pre trained Models
As soon as possible we release [KSM trained-models](https://#) in our repository. there are several pre-trained models for PyTorch.
## Contact Us
Feel free to contact us for any further information via below channels.
### Amirmohhammad Rostami:
- email: [*amirmohammadrostami@yahoo.com*](amirmohammadrostami@yahoo.com), [*a.m.rostami@aut.ac.ir*](a.m.rostami@aut.ac.ir)
- linkdin: [*amirmohammadrostami*](https://www.linkedin.com/in/amirmohammadrostami/)
- homepage: [*amirmohammadrostami*](https://ce.aut.ac.ir/~amirmohammadrostami/)
### Ali Karimi
- email: [*aliiikarimi@ut.ac.ir*](aliiikarimi@ut.ac.ir)
### Mohammad Ali Akhaee
- email: [*akhaee@ut.ac.ir*](akhaee@ut.ac.ir)
- homepage: [*Mohammad Ali Akhaee*](https://ece.ut.ac.ir/en/~akhaee)
近期下载者：
相关文件：
收藏者：