Install and Configure WPS-Hadoop

From Gcube Wiki
Jump to: navigation, search


1. Configure the VM structure

1.1. hadoopApplications folder

1.2. algorithmRepository HDFS folder

1.3. wps-hadoop-source folder

1.4. wps-hadoop-0.1-SNAPSHOT-tomcat-embedded folder

2. Tutorial: create the indicator_i1 process

2.1. Create the application

2.1.1. Create the directory structure

2.1.2. Copy and integrate the .R script

2.1.3. Create the run bash script

2.2. Create the application jar and put it into the HDFS

2.2.1. Compress the application folder in a .jar file

2.2.2. Copy the jar into the HDFS

2.3. Create the process description xml file

2.4. Create the wps-hadoop process java class(es)

2.4.1. IndicatorI1.java

2.4.2. SpeciesCodes.java

2.4.3. Constants.java

2.5. Build and package the sources

2.6. Configure the wps-hadoop web-app

2.6.1. Copy the jar library

2.6.2. Update the wps_config.xml

2.6.3. Restart the wps-hadoop web application

2.7. Run, Test and Debug

2.7.1. Run & Test

2.7.2. Debug