Course Description

The demand for Big Data professionals is increasing across the globe and it’s a great opportunity for the IT professionals to move into the most sought technology in the present day world. ExcelR offers classroom and instructor-led live online Big Data course with Hadoop, delivered by industry experts who are considered to be the best trainers in the industry. The training is studded with loads of practical assignments, case studies and project work, which ensures the hands-on experience for the participants. Our Big data training program is meticulously designed to become a professional Big data Hadoop developer and crack the job in the space of Big Data. Various tools like Sqoop, Hive, HBase, Scala, Spark, Spark streaming, Kafka are extensively covered as part of the training. Along with these several value added topics like SQL, AWS, Azure, Python, Linux etc are covered in the context of Bigdata Hadoop. All these topics are considered to be nice to have which complements BIg Data concepts and are sought after by the recruiters. Post training support is provided and necessary hand holding will be provided in terms of resume preparation, Interview questions etc. ExcelR’s Big data program is considered to be the best program in the industry owing to its comprehensive curriculum, hands on assignments and projects, top notch trainers with extensive Big Data experience and have passion for training. No wonder ExcelR’s Big Data course is considered to be the best in the industry.

Course Curriculum

Module 1 - Introduction to Big Data

Introduction to Big Data
- Introduction
- What is Big data?
- Evolution of Data
- 5Vs pf Big Data
- Different Kinds of Data
- Big Data Sources
- Processing Big Data
- Big data Analytics
- Big Data Insight
- Applications of Big Data Analytics
- Benefits of Big Data
- How big Data Impacts IT
- Introduction To Big Data Quiz
Hadoop and Its Architecture
- what is hadoop?
- About Hadoop
- Problems in Distributed Computing
- Famouse Hadoop Users
- Why Hadoop?
- Features of Hadoop
- Simple Architecture of Hadoop
- Core Components of Hadoop
- What is HDFS ?
- What is Map Reduce?
- Hadoop Versions
- Types of Nodes in Hadoop
- Hadoop System
- Hadoop 1.x Architecture
  - Hadoop 1.x Cluster Administration
  - Hadoop 1.x Meta Data Management
  - Hadoop 1.x Architecture Disadvantages
- Hadoop 2.x Architecture
  - Hadoop 2.x Description
- Hadoop Spt QUIZ
Map Reduce and YARN
- Hadoop Core Components
- Design of HDFS
- Concept of HDFS
- Map Reduce - Data Processing
- Map Reduce : Parallel Processing of Data
- Map Reduce Programming Model
- Map Reduce Example : Vote Count (Traditional)
- Map Reduce Example : Vote Count (Map Reduce)
- Map Reduce in Detail through Word Count
- YARN
- YARN FLOW
- Scheduling in YARN
- Scheduling in YARN - Capacity Scheduler
- Map Reduce Vs YARN
- Yarn Take AWAY
Map Reduce and Yarn QUIZ
Cloudera Installation
Basic Commands in Hadoop
- Basic Commands in Hadoop Description
- Basic Commands in Hadoop Description - version
- Basic Commands in Hadoop Description - jps
- Basic Commands in Hadoop Description - ls
- Basic Commands in Hadoop Description -mkdir
- Basic Commands in Hadoop Description -put
- Basic Commands in Hadoop Description -cat
- Basic Commands in Hadoop Description - touchz
- Basic Commands in Hadoop Description - get
- Basic Commands in Hadoop Description -cp
- Basic Commands in Hadoop Description -mv
- Basic Commands in Hadoop Description -rm-r
- Basic Commands in Hadoop Description -du
- Basic Commands in Hadoop Description -stat
- Basic Commands in Hadoop Description -report
Basic Hadoop Commands Quiz
Tasks (Hadoop Commands)
Hadoop Distribution Systems
- Popular Hadoop Distributions
- Popular Hadoop Distributions - Cloudera
- Popular Hadoop Distributions - Horton Works
- Popular Hadoop Distributions - MapR
- Choosing a Hadoop Distribution
Hadoop Distribution Systems Quiz

Module 2 - Sqoop

Sqoop
- Sqoop Introduction
- Why Sqoop
- Sqoop Architecture
- Sqoop Features
- Sqoop Import
  - SQOOP Import Internal Process
  - Sqoop Import Important Parameters
  - Sqoop import Sample Execution
  - Sqoop Import Commands
    - Sqoop Import Command using WHERE condition
    - Sqoop Import for importing only Specific column
  - Sqoop Handson in CLOUDERA
- Sqoop Import Assignments
- Sqoop Import Important Commands
  - Sqoop EVAL
  - SQOOP EVAL SELECT
  - Sqoop EVAL Insert
  - Sqoop EVAL Update
  - Sqoop EVAL DELETE
  - Sqoop Import Split by
  - Sqoop Import Split by Handson
  - Sqoop Import Direct Mode
  - Sqoop Import Direct Mode Handson
- Sqoop Import EVAL,Split by ,direct Mode Assignments
- Sqoop Incremental Import
  - Incremental Append
  - Incremental Append - Sample Execution
  - Incremental Last Modified
  - Incremental Last Modified Sample Execution
- Assignments On Incremental Append
- Sqoop Job
  - Sqoop Job Description
  - Sqoop Job handson
  - Sqoop Job Listing
  - Sqoop Job Inspect
  - Sqoop Job Execute
  - Sqoop Job creation with Password file
  - Sqoop validate Command
  - Sqoop validate hands-on
- Sqoop Export
  - Sqoop Export Description
  - Sqoop Export Internal Process
  - Sqoop Export Hands-on
  - Sqoop Export Properties
    - Sqoop Export properties - Batch Mode
    - Sqoop Export properties - Merge
    - Sqoop export Properties - Transactionality
  - Sqoop Export Assignment
  - File Formats in Hadoop and Data Import in AVRO and PARQUET
    - File Formats in Hadoop
    - Benefits of Choosing exact File formats
    - Text Input Format
    - Sequence File Input Format
    - RC file Input format
    - ORC File INPUT format
    - AVRO Format
    - Parquet Format
    - Sqoop Import in AVRO
    - SQOOP Import in Parquet
  - Sqoop File format Assignments
  - Quiz on Sqoop (15 Questions)
  - Final Assignment on Sqoop

Module 3 - Hive

Hive Introduction
- Why another Warehousing system
- Hive Introduction
- what is hive?
- Architectural Overview
- Hive Execution plan
Quiz
Apache Hive Tables & Data types
- Hive Data types
- Data Abstraction in Hive
- Hive Data Model
- Hive Default Warehouse
- Hive Default Warehouse - Sample Execution
- Hive Tables
- Create database in Hive
- Internal Table
- Drop Internal Table
- Drop External Table
- When to use Internal and External Table?
- Internal Table Vs External Table
- Industry Usage
QUIZ
Assignments on Hive tables
Hive Bucketing and Partitions
- Partitions in Hive
- Static Partition
- Static Partition Creattion and Advantages
- Static Partition Sample Execution
- Dynamic Partition creation
- Dynamic Partition Sample Execution
- Dynamic Partition Advantages
- Bucketing in Hive
- Bucketing Sample Execution
- Industry Usage
QUIZ on Partitions
Assignments on Bucketing and partitions
ACID Properties and JOINS
- ACID Properties
- ACID Property - sample execution
- JOINS
- JOINS Strategies in Hive
- Shuffle Joins
- Map side join
- Sort Merge Bucket join
- Industry Usage
QUIZ
Assignments on ACID Properties
File Formats & Permformance Tuning
- Hive Built in Formats
- Hive Authorization
- Hive Serde
- Hive Serde - sample execution
- Hive Performance Tuning Techniques
- Industry Usage
Handling XML data, JSON in Hive
- XML data handling in Hive
- Handling XML data in Hive - Step - 1
- Handling XML data in Hive - Step - 2,3
- Handling XML data in Hive - Step - 4
- Handling JSON data
Hive Tasks -1
Handling Incremental data in Hive
- Handling Incremental load in Hive
- Handling Incremental load Hive - Merge
- Handling Incremental load Hive - Full Outer
QUIZ on Handling Incremental data
Hive tasks -2
Hive Advanced Scenarios
- How to choose the Number of Buckets
- How to check the Partitions in a table
- How to add Partitions to the existing table
- How to add multiple partitions to a table
- How to Drop partitions from a table
- How to create a new table from existing table
- How to create a new table from existing table without data
- How to pass variable to Hive script
- How to see create table syntax for a existing hive table
- How to rename the table in Hive
- Usage of case statement in Hive
QUIZ on Hive advanced commands
Hive Task - 3
Hive String Functions
- Hive CONCAT Function
- Hive Substring Function
- Hive Length (String A) Function
- Hive Upper(String A) Function
- Hive Lower(String A) Function
- Hive ucase(String A) Function
- Hive lcase(String A) Function
- Hive Ipad(String A,int len, string pad) function
- Hive rpad(String A,int len, string pad) function
- Hive trim(String A) function
- Hive Itrim(String A) function
- Hive rtrim(String A) function
- Hive Repeat(String A,int n) function
- Hive Reverse(String A,int n) function
Hive QUIZ on String functions
Hive Final QUIZ

Module 4 - Hbase

No SQL Database Introduction
- Summary of Early Database systems
- RDBMS
- Issues with RDBMS - Scalability
- Why RDBMS is not suitable for Big data
- What is NoSQL?
- Need of NoSQL
- Types of NoSQL Databases
- Characteristics of NoSQL Database
- Key Value Pair Based
- Column Based
- Document Based
- Graph Based
- CAP Theorem
- Advantages of NoSQL Database
- What are not provided by NoSQL
- Where to use NoSQL
- Conclusion
QUIZ on No SQL Introduction
Apache Hbase Introduction
- Introduction to NoSQL
- Benefits of NoSQL
- CAP Theorem
- What is Data Store?
- What is Columnar Database?
- Hbase
- How Hbase is a different kind of Columnar DB
- Difference between HDFS and Hbase
- When to use Hbase
- Features of Hbase
- Companies using Hbase
- Applications of Hbase
- Usecases of Hbase
QUIZ Hbase Introduction
Apache Hbase Core Components
- Hbase Tables
- Regions as Shards - Scalability
- Column Family
- Data Management
- Hfile Format Information
- Hbase Architecture
- Hbase Detailed Architecture
- Hbase Master(HMaster)
- Region Servers
- Zookeeper
- API
- Hbase first read or write
- Hbase Write Steps - 1
- Hbase Write Steps - 2
- Hbase MemStore
- HDFS Data Replication
- Web Interface
- Hbase Shell
QUIZ
Apache Hbase Commands & Hands-on
- Hbase Shell
- Hbase Shell - status
- Hbase Commands - Version
- Hbase commands - table_help
- Hbase commands -whoami
- Data Definition Language
- Data Manipulation Language
- Creating a Hbase table
- List command Hands-on
- How to create the data in Hbase -put
- How to view the data in Hbase -scan
- How to read the data in Hbase -get
- How to get the description of Table -describe
- Alter Command in Hbase
- Disabling a Table using Hbase Shell
- ls_disabled
- Enable a Hbase Table
- ls_enabled
- Existence of Table using Hbase Shell
- Delete a Specific cell in a Table
- Drop the Hbase Table
- Count command in Hbase
- User_Permission command
- Grant
Hands-on Hbase QUIZ
Assignment on Hbase