-
Notifications
You must be signed in to change notification settings - Fork 75
Indexing all the things
Daoud Clarke edited this page Jun 11, 2022
·
1 revision
A potential strategy for keeping the index up-to-date. At the moment, updating the index is a manual process. We want to change that.
- We now have a server (before we were using only serverless tech).
- We could run the indexing on a cron job (or similar)
- The data we need to index also passes through the server; we could store it locally at that point to reduce bandwidth
- Once the index is built, we need to deploy it
Currently an index is deployed by copying it to the docker image when it is built. This works well with Google Cloud Run which we are currently using to host the server.
We could continue using this strategy by creating a deploy script to run on a cron job on the server. The script would:
- Rebuild the index given the most up-to-date data
- Build the docker image
- Push the new image to the repository
- Deploy to Cloud Run