Upload
ducatfbd
View
30
Download
5
Embed Size (px)
Citation preview
l
l
l
l
l
Characteristics of Big Data
Big data collection and cleanup
Why analyze big data
Why parallel computing important
Various products for handling big data
Introduction to Big data
CURRICULUM
BIG DATAHadoop (Admin)
l
l
l
l
l
Hadoop Stack
Components of Hadoop
Starting Hadoop
Various Hadoop processes
Hands On
Introducing Hadoop
l
l
l
l
l
l
l
l
l
Basic file commands
Reading & writing to files
Run a word count on a large text file
Web based UI
View jobs status on Hadoop prompt
View jobs status on web UI
High availability
Federation
Hands On
Working with HDFS
l
l
l
l
Architecture
Scheduler
Resource Manager
Yarn Hands On
YARN
l
l
l
l
l
l
l
l
l
l
Types of installation (standalone, distributed)
Hadoop distributions (Apache, cloudera and hortonworks)
Setup linux for Hadoop installation (Java and SSH)
Haddop directory structure
XML, masters and slave files
Checking system health
Checking file system health
Block size, replication factor and block health monitoring
Benchmarking cluster
Hands On
Installation & Configuring Hadoop
l
l
l
l
l
l
l
l
l
Superuser
Authorization
Secure Mode
Adding and de-commissioning nodes
Secondary NameNode
Failover
Manage Quotas
Enabling Thrash
Hands On
Advanced administration activities
Partners :
.
E - 35, SITE - 4, Near SwarnaNagari, Adjacent J.P. Golf Course, Greater Noida (U. P.)Ph. : 0120-4345190-91-92 to 97Mb. :09899909738, 09899913475
GREATER NOIDANOIDAA-43 & A-52, Sector-16, Noida - 201301, (U.P.) INDIAPh. : 0120-4646464Mb. : 09871055180
GHAZIABAD1, Anand Industrial Estate, Near ITS College, Mohan Nagar, Ghaziabad (U.P.)Ph.: 0120-4835400...98-99Mb. : 09810831363 / 9818106660 : 08802288258 - 59-60
GURGAON1808/2, 2nd floor old DLF,Near Honda Showroom,Sec.-14, Gurgaon (Haryana)Ph. : 0124-4219095-96-97-98Mb. : 09873477222-333
SCO-32, 1st Floor, Sec.-16,Faridabad (HARYANA)Ph. : 0129-4150605-09Mb. : 09811612707
FARIDABAD
38,Jai Jawan Colony 3rd,Near Gaurav Tower,JLN Marg, Jaipur (Rajsthan) Ph. : 0141-2550077, 2550202Mb : 08824246937
JAIPURC-8, Ist floor, Opposite Aditya College, Near Airtel Office,City Centre, Gwalior (M.P.)Ph. : 0751-6058744Mb. : 09039078744
GWALIOR
www.facebook.com/ducateducation
l
l
l
l
l
Hadoop infrastructure monitoring
Hadoop specific monitoring
Install and configure Nagios / Ganglia
Capture metrics
Hands on
Monitoring Hadoop Cluster
l
l
l
l
l
Discuss Hive, Sqoop, Pig, HBase, Flume
Use cases of each
Use Hadoop streaming to write code in Perl /
Python
Hands on
Other Components of Hadoop Ecosystem