Version 0.4.0

Project refresh to work with Spark 1.6.0 and the 4.x.x series of Elastic MapReduce AMIs

Code

• Upgrade to use Spark 1.6.0 (#19)
• Bump Scala to 2.10.5 (#22)

Ops

• Add Boto3 to Vagrant (#23)
• Update tasks.py to work with AMI 4.x.x (#20)
• Add missing / before logs for log URI in invoke (#16)

Testing

• Remove openjdk from test suite (#24)

Version 0.3.0

Updates to Spark 0.3.0 and Scala 2.10.4. Adds Boto-based tasks for uploading the files to S3 and running the job on Elastic MapReduce

Code

• Bumped to Spark 1.3.0 (#1)
• Bumped Scala to 2.10.4 (#5)
• Added Spark SQL to dependencies (#10)
• Removed dependency on MASTER environment property (#12)

Ops

• Added dedicated Vagrant setup (#6)
• Removed run-spark-job.sh (#11)
• Added invoke tasks using Boto (#13)

Docs

• Added CHANGELOG (#7)