cudaformer
所属分类：人工智能/神经网络/深度学习
开发工具：Cuda
文件大小：0KB
下载次数：0
上传日期：2023-09-21 04:45:30
上 传 者：
sh-1993
说明： nvidia tesla m60 gpu上的transformer，
(transformer on a nvidia tesla m60 gpu,)
文件列表:
FFNN.cu (390, 2023-09-29)
TERRIBLE_multi_head_attention.cu (5495, 2023-09-29)
optimized_matmul.cu (4453, 2023-09-29)
unoptimized_matmul.cu (3433, 2023-09-29)
# CUDAFORMER
implementing the transformer architecture (and eventually many more modern AI concepts) on a CUDA kernel.
Inspired by James Lin, check out his work here: https://github.com/linjames0/Transformer-CUDA/tree/main
main AI concepts: Transformer, Flash-Attention, Some Kind of Triton Implementations (need to look up AWS tutorial for that)
近期下载者：
相关文件：
收藏者：