8000 Commits · lucidrains/vit-pytorch · GitHub

More Web Proxy on the site http://driver.im/

Commits

Commits on Mar 5, 2025

add the proposed jumbo vit from Fuller et al. of Carleton University
lucidrains
committed

Commits on Jan 19, 2025

Commits on Jan 4, 2025

Commits on Dec 21, 2024

add a simple vit flavor for a new bytedance paper that proposes to break out of the traditional one residual stream architecture - "hyper-connections"
lucidrains
committed

Commits on Nov 24, 2024

make value residual learned
lucidrains
committed

Commits on Nov 20, 2024

allow for qk norm to be turned off for na vit nested tensor
lucidrains
committed

Commits on Nov 19, 2024

readme
lucidrains
committed

Commits on Nov 10, 2024

Commits on Nov 8, 2024

update comment for navit 3d
lucidrains
committed

Commits on Oct 31, 2024

fix value residual
lucidrains
committed

Commits on Oct 28, 2024

add value residual based simple vit
lucidrains
committed

Commits on Oct 11, 2024

fix multiheaded qk rmsnorm in nViT
lucidrains
committed

Commits on Oct 10, 2024

Commits on Oct 9, 2024

add a hypersphere vit, adapted from https://arxiv.org/abs/2410.01131
lucidrains
committed

Commits on Oct 4, 2024

address https://github.com/lucidrains/vit-pytorch/issues/330
lucidrains
committed

Commits on Aug 28, 2024

add register tokens to the nested tensor 3d na vit example for researcher
lucidrains
committed

Commits on Aug 22, 2024

Commits on Aug 21, 2024

3d version of navit nested tensor
lucidrains
committed

Commits on Aug 20, 2024

Commits on Aug 7, 2024

Commits on Jul 20, 2024

attention re-use in lookup vit should use pre-softmax attention matrix
lucidrains
committed

Commits on Jun 11, 2024

fix t2t vit having two layernorms, and make final layernorm in distillation wrapper configurable, default to False for vit
lucidrains
committed

Commits on May 11, 2024

rotary needs to be done with full precision to be safe
lucidrains
committed

0