Skip to content

Latest commit

 

History

History
19 lines (12 loc) · 506 Bytes

README.md

File metadata and controls

19 lines (12 loc) · 506 Bytes
Raw

Introduction

This is a very very simple spark application. In this application, we show how to use gradle shadowjar plugin to create a shadow(uber) jar and then submit it to the spark cluster.

How to Use

  1. Build the Shardow Jar (Uber Jar)

    ./gradlew shadowJar

  2. Submit the jar

    $SPARK_HOME/bin/spark-submit --master=<spark-master> build/libs/spark-wordcount-all.jar

Good luck and happy Sparking!!!