Skip to content

bdremadhav/StreamGrids

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2,620 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Installation Steps

General Prerequisites

Cloudera Quickstart 5.5.0

Git 1.9 and up

Maven 3 and up

Oracle JDK 8(and up) or OpenJDK

MySQL Server 5.1 and up

Google Chrome browser

Steps:

1)Download and install VirtualBox from https://www.virtualbox.org/

2)Download Cloudera Quickstart VM 5.5.0 from https://www.cloudera.com/downloads/cdh/5-5-0.html

3)Setup a 'Host-Only Adapter' for network to enable communication between Host and Guest OS.

4)Login to Cloudera Quickstart VM

5)Download Maven from a mirror, unpack and add to the PATH.

[cloudera@quickstart ~]# wget http://www.us.apache.org/dist/maven/maven-3/3.3.9/binaries/apache-maven-3.3.9-bin.zip

[cloudera@quickstart ~]# unzip apache-maven-3.3.9-bin.zip

[cloudera@quickstart ~]# export PATH=$PATH:/home/cloudera/apache-maven-3.3.9/bin

6)Download Oracle JDK 8 tar.gz file from here:

http://www.oracle.com/technetwork/java/javase/downloads/jdk8-downloads-2133151.html

Extract the jdk tar.gz

Edit the /etc/profile and change

[cloudera@quickstart ~]# sudo vi /etc/profile

1)JAVA_HOME variable to point to new Java home after downloading and extracting (export JAVA_HOME=/home/cloudera/jdk.1.8.--)

2)PATH variable and append :$JAVA_HOME/bin

[cloudera@quickstart ~]# source /etc/profile

Building StreamGrids from source

Obtain the source code

cd to the home directory of cloudera.

[cloudera@quickstart ~]# cd ~

Pull StreamGrids source from this git repository.

[cloudera@quickstart ~]# git clone https://github.com/bdremadhav/StreamGrids.git cd to the cloned source dir

[cloudera@quickstart ~]# cd StreamGrids


Database Setup

Execute the dbsetup.sh script without any parameters as shown below. In this example, we are going to use MySQL as StreamGrids backend as it's already available in the Cloudera VM.

[cloudera@quickstart ~/StreamGrids]# sh dbsetup.sh⏎ Supported DB⏎

  1. Embedded ⏎
  2. Oracle⏎
  3. MySQL⏎
  4. PostgreSQL⏎

Select Database Type(Enter 1, 2, 3 , 4 or leave empty and press empty to select the default DB):3⏎

Enter DB username (Type username or leave it blank for default 'root'):root⏎

Enter DB password (Type password or leave it blank for default ''):cloudera⏎

Enter DB hostname (Type db hostname or leave it blank for default 'localhost'):localhost⏎

Enter DB port (Type db port or leave it blank for default '3306'):3306⏎

Enter DB name (Type db name or leave it blank for default 'bdre'):platmd⏎

Enter DB schema (Type schema or leave it blank for default 'bdre'):platmd⏎

Are those correct? (type y or n - default y):y⏎

Database configuration written to ./md-dao/src/main/resources/db.properties

Will create DB and tables

Tables created successfully in MySQL platmd DB


Building

Now build StreamGrids using (note StreamGrids may not compile if the settings.xml is not passed from the commandline so be sure to use the -s option. When building for the first time, it might take a while as maven resolves and downloads the jar libraries from diffrent repositories.

mvn -s settings.xml clean install -P cdh52


Installing StreamGrids

After building StreamGrids successfully run

sh install-scripts.sh local

It'll install the StreamGrids scripts and artifacts in /home/cloudera/bdre

Using StreamGrids

After a successful build, start the StreamGrids UI service

[cloudera@quickstart ~/StreamGrids]$ sh quick-run.sh

Use Google Chrome browser from the host machine and open http://VM_IP:28850/mdui/pages/content.page⏎

Login using admin/zaq1xsw2⏎

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 13