GitHub · Where software is built

8000 GitHub · Where software is built

More Web Proxy on the site http://driver.im/

Labels Milestones New issue

Is Retnet equivalent to ordinary GPT when the decay is set to 1 ?

#37

· xuanyaoming opened

on Jan 15, 2024

a question about xpos and D of decay mat

#35

· DavideHe opened

on Nov 15, 2023

Confusion about "the chunkwise recurrent representation of retention"

#34

· CHENHUI-X opened

on Nov 7, 2023

Can this mechanism be applied to PointCloud data ?

#33

· madjid-dx opened

on Nov 5, 2023

How to predict use this net?

#30

· GodPCWANG opened

on Oct 8, 2023

The complex theta should cancel out

#28

· albertbuchard opened

on Sep 24, 2023

Assistance on training a new retention network model ?

#25

· risedangel opened

on Sep 22, 2023

Passing Attention Masks

#24

· leffff opened

on Sep 14, 2023

can retnet be applied in point cloud tasks？

#19

· huiyang0613 opened

on Aug 19, 2023

Changelog of official implementation

#18

· donglixp opened

on Aug 10, 2023

what about cross-attention

#17

· aki819 opened

on Aug 9, 2023

Error when the model is running on GPU

#16

· SSamDav opened

on Aug 3, 2023

0