API to web scraping job portals and store the data in PostgreSQL
Right now only supports greenhouse.io
- Golang + Gorilla Mux
- PostgreSQL
- Docker
POST localhost:8000/crawl
{
"url": "https://boards.greenhouse.io/monzo"
}
GET localhost:8000/jobs
- Docker-Compose:
docker-compose up --build - PostgreSQL on local: change
DATABASE_URLinmain.go
- Add
Launch Packageto create a launch.json - If you have issues with DAP server and DLV:
- Ctrl + Shift + P
- Type
Go: Install/Update Tools