Nafisa Farooqui CC Manual
Nafisa Farooqui CC Manual
13
PRACTICAL NO.01
AIM : INSTALL GOOGLE APP ENGINE .CREATE HELLO WORLD APP AND OTHER WEB
APPLICATIONS USING PYTHON AND JAVA
AIM : USE GOOGLE APP ENGINE LAUNCHER TO LAUNCH THE WEB APPLICATIONS
Setting up HADOOP
Prerequisite
1. Java
2. SSH
Before any other steps, we need to set the java environment variable, this can be done in windows from the
system variables window or on linux by adding the following to the variablesfile:
export JAVA_HOME=/usr/java/latest
1 wget http://apache.claz.org/hadoop/common/hadoop-3.1.2/
2 hadoop-3.1.2.tar.gz
3 tar xzf hadoop-3.1.2.tar.gz
4 hadoop-3.1.2/* to hadoop/
Pseudo-distributed mode
1. Add the following variables to the system variable file
1 export HADOOP_HOME=/usr/local/hadoop
2 export HADOOP_MAPRED_HOME=$HADOOP_HOME
3 export HADOOP_COMMON_HOME=$HADOOP_HOME
4
5 export HADOOP_HDFS_HOME=$HADOOP_HOME
6 export YARN_HOME=$HADOOP_HOME
7 export HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_HOM
E/lib/native
8 export PATH=$PATH:$HADOOP_HOME/sbin:$HADOOP_HOME/bi
n
9 export HADOOP_INSTALL=$HADOOP_HOME
2. Configure HADOOP files
a. Change to the Hadoop directory/etc/Hadoop
b. Add the following to the hadoop-env.sh file
export JAVA_HOME=/usr/local/jdk1.7.0_71
hdfs-site.xml
yarn-site.xml
mapred-site.xml
Starting YARN
<configuration>
<property>
<name>fs.default.name</name>
1 <configuration>
2 <property>
3 <name>dfs.namenode.name.dir</name>
4 <value>/home/hadoop/data/nameNode</value>
5 </property>
6
7 <property>
8 <name>dfs.datanode.data.dir</name>
9 <value>/home/hadoop/data/dataNode</value>
10 </property>
11
12 <property>
13 <name>dfs.replication</name>
14 <value>1</value>
15 </property>
16 </configuration>
1 <configuration>
2 <property>
3 <name>yarn.acl.enable</name>
4 <value>0</value>
5 </property>
6
7 <property>
8 <name>yarn.resourcemanager.hostname</name>
9 <value>node-master</value>
10 </property>
11
12 <property>
13 <name>yarn.nodemanager.aux-services</name>
14 <value>mapreduce_shuffle</value>
15 </property>
16 </configuration>
STEPWISE SCREENSHOT :
AIM : INSTALL A C COMPILER IN THE VIRTUAL MACHINE CREATED USING VIRTUAL BOX
STEPWISE SCREENSHOT :
STEP 5: CREATE A .C FILE USING TOUCH COMMAND AND RUN THE CODE
AIM : FIND THE PROCEDURE TO TRANSFER THE FILES FROM ONE VIRTUAL MACHINE TO
ANOTHER VIRTUAL MACHINE