FactorTopy model with DAT++ backbone for fMRI prediction visual cortex’s fMRI responses on image stimuli
- Dowanload a pretrained DAT++ from this checkpoint or this checkpoint
- Use train_model.ipynb for training the FactorTopy with DAT++ backbone
- Use prepare_dat_submission.ipynb (https://github.com/logogriph2/BrainDecodesDeepNets/blob/main/prepare_dat_submission.ipynb) for preparing Algonauts2023 submission
I thank
- the Nature Scene Dataset team and Algonauts 2023 organizers for providing the data,
- Huzheng Yang from University of Pennsylvania for BrainDecodesDeepNets,
- Zhuofan Xia, Xuran Pan, Shiji Song, Li Erran Li, Gao Huang for Deformable Attention Transformers.
fix local paths