Discord_Frontend

  • l7_910488
    了解作者
  • 13.8KB
    文件大小
  • zip
    文件格式
  • 0
    收藏次数
  • VIP专享
    资源类型
  • 0
    下载次数
  • 2022-05-22 12:19
    上传日期
CSUN无障碍编码竞赛2021 创建了一个Discord机器人,该机器人可以主动听语音,并最终通过Discord服务器聊天中的视频将该语音转换为American Sign Language。 项目目标 创建一种有效的方式,使机器人在被调用时主动进行侦听 使用Google Cloud Speech将这些音频准确地转录为基于文本的格式 在后端处理文本,转换为正确的ASL句子结构 使用Web抓取器和ASL词典,实现ASL格式设置后,找到与正确文本相对应的正确手语视频 然后Bot会发回适当的视频,以证明Discord聊天中的ASL,从而实现准确的翻译 使用的资源和语言 Nodejs,Python,Bash Discord API-Discord.js Google Cloud语音转文字 简单的用户功能 使用'!join'使机器人加入语音通道 使用'!asl'调用命令将音频转换为视频,演示AS
Discord_Frontend-main.zip
  • Discord_Frontend-main
  • .env
    56B
  • README.md
    1.4KB
  • .gitignore
    63B
  • index.js
    5.3KB
  • package-lock.json
    30.8KB
  • package.json
    830B
内容介绍
# CSUN Accessibility Coding Competition 2021 Created a discord bot that actively listens to speech and ultimately transcribes this speech into American Sign Language via video inside of a Discord server chat. ## Goals of the project 1. Create an efficient way for the bot to actively listen when invoked 2. Accurately transcribe this audio into a text based format, using Google Cloud Speech 3. Process the text on the backend, convert into the proper ASL sentence structure 4. With ASL formatting achieved, using a web scraper and the ASL Dictionary, find the correct sign language video that corresponds to the correct text 5. Bot then sends back the proper video demonstrating ASL inside the Discord Chat, thus achieving an accurate translation ## Resources and Languages used 1. Nodejs, Python, Bash 2. Discord API - Discordjs 3. Google Cloud Speech-to-Text ## Simple User Functionality 1. Use '!join' to have the bot join the voice channel 2. Use '!asl' to invoke the command to translate the audio into a video demonstrating the ASL translation ## Future Ideas 1. Centralize the project by reducing the amount of languages used, this will contribute a seamless design 2. Utilize a cache of ASL videos to further improve the performance of the Discord Bot 3. Power a web app, that has universal capabilities. Not being tied to Discord chat can serve more people who are hearing impaired/deaf
评论
    相关推荐