TwitterPopularTags.scala example of Apache Spark Streaming in a standalone project
2015-10-22
This is an easy tutorial of using Apache Spark Streaming with Scala language using the official TwitterPopularTags.scala example and putting it in a standalone sbt project. In few minutes you will be able to receive streams of tweets and manipulating then in realtime with Apache Spark Streaming
- Install Apache Spark (I used 1.5.1)
- Install sbt
- git clone https://github.com/matteoredaelli/TwitterPopularTags
- cd TwitterPopularTags
- cp twitter4j.properties.sample twitter4j.properties
- edit twitter4j.properties
- sbt package
- spark-submit –master local –packages “org.apache.spark:spark-streaming-twitter_2.10:1.5.1” ./target/scala-2.10/twitterpopulartags_2.10-1.0.jar italy