8000 GitHub - MedARC-AI/fMRI-foundation-model: Self-supervised fMRI foundation model
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

MedARC-AI/fMRI-foundation-model

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

80 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

fMRI Foundation Model

In-progress -- this repo is under active development in the MedARC discord server. https://medarc.ai/fmri

Installation

  • Run setup.sh to create a new "foundation_env" virtual environment

  • Activate the virtual environment with "source foundation_env/bin/activate"

Datasets

Usage

1. Train MAE

  • main.ipynb (use accel.slurm to allocate multi-gpu Slurm job)

2a. Downstream probe using frozen MAE latents

Save latents to hdf5 / parquet:

  • prep_mindeye_downstream.ipynb
  • prep_HCP_downstream.ipynb
  • Then evaluate downstream performance using the saved latents:

    • mindeye_downstream.ipynb
    • HCP_downstream.ipynb

    2b. Full fine-tuning of both MAE and downstream model

    This requires having access to train_subj01.hdf5 which is saved in "/weka/proj-fmri/paulscotti/fMRI-foundation-model/src".

    If you cannot access this file, the commented out code shows how to create this file yourself.

    • mindeye_finetuning.ipynb

    About

    Self-supervised fMRI foundation model

    Resources

    License

    Stars

    Watchers

    Forks

    Releases

    No releases published

    Packages

    No packages published

    Contributors 7

    0