8000 GitHub - essoen/TDT4305: Code and report for our project in TDT4305 BIg Data Architecture at NTNU spring 2016

More Web Proxy on the site http://driver.im/

essoen / TDT4305 Public

Notifications You must be signed in to change notification settings
Fork 0
Star 0

Code and report for our project in TDT4305 BIg Data Architecture at NTNU spring 2016

0 stars 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 28 Commits
report		report
task1		task1
task2		task2
.gitignore		.gitignore
Bigdata_assignment_specs.pdf		Bigdata_assignment_specs.pdf
LICENSE		LICENSE
QuickstartSystems.pdf		QuickstartSystems.pdf
README.md		README.md
assignment_presentation.pdf		assignment_presentation.pdf

Repository files navigation

TDT4305 Big Data Architecture

Setup

Install and setup Python 2.7, Spark and Pyspark.
Unpack the ZIP-files with the data.

Run

spark-submit task1/foursquare.py input_data_path
spark-submit task2/twitter.py input_data_file output_data_file.

About

Code and report for our project in TDT4305 BIg Data Architecture at NTNU spring 2016

Report repository

Releases

No releases published

Packages

No packages published

Contributors 2

Languages

0