8000 GitHub - peterwade153/trips_scraper
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

peterwade153/trips_scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

13 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

trips_scraper

This is a complete scrapy spider built using Scrapy, a web crawling and scraping framework, and Python 3.6

The spider pulls tourism trips data from https://www.bookmundi.com specifically for the East-african region i.e Uganda, Kenya and Tanzania.

The data includes name(short description), prices, activities, tour types, departures dates, duration days and country.

The Scraped data is stored in a temporary directory tmp as a trips.csv file.

Installation

Create a virtual env and activate it.

Clone the project

git clone https://github.com/peterwade153/trips_scraper.git

Install Dependencies.

pip install requirements.txt

To run the spider.

Use the command below

scrapy crawl trips

About

No description or website provided.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

0