pip install torch-multi-head-attentionfrom torch_multi_head_attention import MultiHeadAttention
MultiHeadAttention(in_features=768, head_num=12)
This repository was archived by the owner on Mar 3, 2024. It is now read-only.
-
Notifications
You must be signed in to change notification settings - Fork 36
Multi-head attention in PyTorch
License
CyberZHG/torch-multi-head-attention
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
Multi-head attention in PyTorch
Topics
Resources
License
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published