- Ubuntu 22.04 LTS
- CUDA 12.1
- Python 3.10.12
- hallo v1.0.0
- Torch 2.2.2
- xformers 0.0.25.post1
- Jupyter Lab
- code-server
- runpodctl
- OhMyRunPod
- RunPod File Uploader
- croc
- rclone
This image is designed to work on RunPod. You can use my custom RunPod template to launch it on RunPod.
Note
You will need to edit the docker-bake.hcl file and update REGISTRY_USER,
and RELEASE. You can obviously edit the other values too, but these
are the most important ones.
# Clone the repo
git clone https://github.com/ashleykleynhans/hallo-docker.git
# Log in to Docker Hub
docker login
# Build the image, tag the image, and push the image to Docker Hub
cd hallo-docker
docker buildx bake -f docker-bake.hcl --push
# Same as above but customize registry/user/release:
REGISTRY=ghcr.io REGISTRY_USER=myuser RELEASE=my-release docker buildx \
bake -f docker-bake.hcl --pushdocker run -d \
--gpus all \
-v /workspace \
-p 3000:3001 \
-p 7777:7777 \
-p 8888:8888 \
-p 2999:2999 \
-e VENV_PATH=/workspace/venvs/hallo \
ashleykza/hallo:latestYou can obviously substitute the image name and tag with your own.
| Connect Port | Internal Port | Description |
|---|---|---|
| 3000 | 3001 | hallo |
| 7777 | 7777 | Code Server |
| 8888 | 8888 | Jupyter Lab |
| 2999 | 2999 | RunPod File Uploader |
| Variable | Description | Default |
|---|---|---|
| JUPYTER_LAB_PASSWORD | Set a password for Jupyter lab | not set - no password |
| DISABLE_AUTOLAUNCH | Disable hallo from launching automatically | (not set) |
| DISABLE_SYNC | Disable syncing if using a RunPod network volume | (not set) |
hallo creates a log file, and you can tail the log instead of killing the service to view the logs.
| Application | Log file |
|---|---|
| hallo | /workspace/logs/hallo.log |
For example:
tail -f /workspace/logs/hallo.logPull requests and issues on GitHub are welcome. Bug fixes and new features are encouraged.
