This repo hosts the mock galaxy catalogs used by DESIQA.
On a NERSC machine, all these catalogs can be directly accessed through the "Generic Catalog Reader" (GCR) inferface. More information about GCR can be found here.
Currently these sets of catalogs are available (Note that these catalogs are not perfect and will continue to be updated):
- Buzzard series:
by Joe DeRose, Risa Wechsler, Eli Rykoff et al.
buzzard(full catalog, DES Y3 area)buzzard_test(same asbuzzardbut a small subset for testing purpose)buzzard_high-res(higher resolution, smaller sky area)buzzard_v1.6
- EZMocks created by Albert Chuang and Marcos Pellejero Ibanez
- MXXL BGS created by Alex Smith, Shaun Cole, Carlton Baugh, Zheng Zheng, Raul Angulo, Peder Norberg, and Idit Zehavi
Each of the catalogs is specified by a YAML config file, which can be found here. The galaxy quantities in these catalogs conform to this schema.
Note: These instructions about Python environment may change in the future. If you encounter issues, please check if there's any updates on these instructions.
First, start a NERSC notebook server and open a notebook with a DESI kernel. Make sure you add the DESIQA Python enviornment to sys.path:
import sys
sys.path.insert(0, '/project/projectdirs/desi/mocks/desiqa/cori/lib/python3.6/site-packages/')Activate DESIQA Python environment by running the following on NERSC (needs to be in bash or zsh):
source /project/projectdirs/desi/software/desi_environment.sh export PYTHONPATH=/project/projectdirs/desi/mocks/desiqa/cori/lib/python3.6/site-packages/:$PYTHONPATH
To be able to import GCRCatalogs, make sure you first source the desi environment (source /project/projectdirs/desi/software/desi_environment.sh) and the first line of the script should be:
#!/usr/bin/env python
import sys
sys.path.insert(0, '/project/projectdirs/desi/mocks/desiqa/cori/lib/python3.6/site-packages/')You can install the latest version by running (but note that you need to change the python paths accordingly)
pip install https://github.com/desihub/gcr-catalogs/archive/master.zip
But note that the actual catalogs can only be accessed on a NERSC machine.
-
See this notebook for a tutorial on how to use GCR Catalogs.
-
See this notebook for an actual application (the Conditional Luminosity Function test) using GCR Catalogs. (Thanks to Joe DeRose for providing the CLF test example!)
-
See GCR documentation for the complete GCR API.
-
On GitHub fork the GCRCatalogs GitHub repo.
-
On NERSC, clone your fork (you can skip this if you've done it)
cd /your/own/directory git clone git@github.com:YourGitHubUsername/gcr-catalogs.git git remote add upstream https://github.com/desihub/gcr-catalogs.git -
Sync with the upstream master branch
cd /your/own/directory/gcr-catalogs git checkout master git pull upstream master git push origin master -
Create a new branch for this edit:
git checkout -b newBranchName -
Make changes
-
Test by adding your clone to the path when running Python:
import sys sys.path.insert(0, '/your/own/directory/gcr-catalogs')
-
Commit and push to your forked repo
git add <files changed> git commit -m <short but meaningful message> git push origin newBranchName -
Go to your forked repo's GitHub page and "create a pull request".