Open
Description
Intuitively, these steps are functionally equivalent.
In our experiments, the new method is ~12x slower. Is there a configuration problem?
deprecated builder:
- name: 'gcr.io/cloud-builders/gsutil'
args:
- '-m'
- 'rsync'
- '-d'
- '-r'
- '-c'
- 'dags/'
- '${_COMPOSER_BUCKET}/dags'
new method:
- name: 'gcr.io/google.com/cloudsdktool/cloud-sdk:slim'
args:
- 'storage'
- 'rsync'
- '--checksums-only'
- '--delete-unmatched-destination-objects'
- '--recursive'
- 'dags/'
- '${_COMPOSER_BUCKET}/dags'
Metadata
Metadata
Assignees
Labels
No labels