Spark Examples

Examples for demonstrating profiling on a Spark cluster using Opsian

Instructions

• Use the GenerateUsers and GenerateTransactions programs to generate example files to profile with.
• cp example-vars.sh var.sh and fill in the values for your machine and demo.
• ./start-master.sh and ./start-worker.sh in screen in order to run the cluster.
• ./submit.sh to submit your job to the cluster.