27
Hadoop Installation Presented by: Ahmed Shouman Contacts: E-mail: [email protected] LinkedIn: eg.linkedin.com/in/ahmdshouman Twitter: https://twitter.com/AhmdShouman

Hadoop Installation

Embed Size (px)

Citation preview

Page 1: Hadoop Installation

Hadoop Installation Presented by: Ahmed Shouman Contacts: E-mail: [email protected] LinkedIn: eg.linkedin.com/in/ahmdshouman Twitter: https://twitter.com/AhmdShouman

Page 2: Hadoop Installation

What’s Hadoop? Is a Java-based programming framework that supports the processing of large data sets in a distributed computing environment.

Page 3: Hadoop Installation

Hadoop installation modes

Stand alone mode. pseudo distributed mode. Fully distributed mode.

Page 4: Hadoop Installation

What’s Hadoop?

Page 5: Hadoop Installation

Setting up our Lab:

Page 6: Hadoop Installation

Prerequisites:

Page 7: Hadoop Installation

Install JAVA & Configure hosts file

sudo apt-get update sudo apt-get install sun-java6-jdk Java –version

Hosts File #gedit /etc/hosts

Page 8: Hadoop Installation

Install & Configure SSH sudo apt-get install openssh-server ssh-keygen -t rsa -P "“

#cat $HOME/.ssh/id_rsa.pub >> $HOME/.ssh/authorized_keys

Page 9: Hadoop Installation

Download & Install

Page 10: Hadoop Installation

Download & Install

Page 11: Hadoop Installation

Download & Install

Page 12: Hadoop Installation

Download & Install

Page 13: Hadoop Installation

Download & Install

Page 14: Hadoop Installation

Download & Install

Page 15: Hadoop Installation

Download & Install In the Linux Terminal, Writ: “ wget http://supergsego.com/apache/hadoop/common/hadoop-

1.2.1/hadoop-1.2.1-bin.tar.gz ” & hit ENTER

Page 16: Hadoop Installation

Editing .bashrc file #gedite ~/.bashrc Add the following lines at the end of the

file

Page 17: Hadoop Installation

Main Installation #tar –zxvf hadoop-1.2.1-bin.tar.gz

#mv /home/hadoop-1.2.1 /opt/hadoop

Page 18: Hadoop Installation

Editing hadoop-env.sh #gedite /opt/hadoop/conf/hadoop-env.sh

Page 19: Hadoop Installation

Editing conf/*-site.xml files 1- “Core-site.xml” File: #gedit /opt/hadoop/conf/core-site.xml

Page 20: Hadoop Installation

Editing conf/*-site.xml files 2-”Mapred-site.xml” File #gedit /opt/hadoop/conf/mapred-site.xml

Page 21: Hadoop Installation

Editing conf/*-site.xml files 3-”hdfs-site.xml” File. #gedit /opt/hadoop/conf/hdfs-site.xml

Page 22: Hadoop Installation

Formatting Namenode F.S. #hadoop namenode –format

Page 23: Hadoop Installation

Firing Hadoop Deamons #start-all.sh

Page 24: Hadoop Installation

Testing Installation Localhost:50070

Page 25: Hadoop Installation

Testing Installation Localhost:50070

Page 26: Hadoop Installation
Page 27: Hadoop Installation

Questions?! Thanks