3.65 out of 5
3.65
65 reviews on Udemy

Big Data Analytics Using Sqoop and Hive

Access, Manipulate, Transform, and Analyze Massive data sets with Hands-on
Instructor:
Big Data Trunk
1,055 students enrolled
English [Auto-generated]
After this course, students will have all the necessary foundational knowledge which is vital to be a successful big data analytics professional.

Data is the new oil of this Digital Age. 

Are you thinking to start your career in Big Data Analytics ? Then you have landed in the right place.

In this course, you will learn how to organize, analyze and interpret vast sources of information. 

We cover all essential fundamental understanding of Big Data Analytics and provide end-to-end real life project practice.

Course contains 

  1. Understanding of Big Data and MapReduce 
  2. How to transfer Data from different sources using Sqoop
  3. Manipulate Data in HDFS using HIVE
  4. Real Hands experience project 

You will get only in this course :

1) 24*7 support for any issue or doubt raised by student.

2) Exercises in well written document with screenshot.

Introduction

1
Course Introduction

In this video we are providing all features of the course 

2
Introduction to Big Data

Big Data Trunk is the leading Big Data focus consulting and training firm founded by industry veterans in data domain. It helps is customer gain competitive advantage from open source, big data, cloud and advanced analytics. It provides services like Strategy Consulting, Advisory Consulting and high quality classroom individual and corporate training. 

3
Data analytics Introduction
In this video, we have explained the what is big data analytic, why it is important for companies and business analyst. what is difference between traditional analytic and big data analytic, Application area of big data analytic?

Newly added section- Installation and Configuration of Cloudera

1
Steps of Cloudera Installation

How to install cloudera in 64 bit Window Machine.

2
Hands on Lab: Cloudera Installation

Step 1: Download the virtual box- executable file from https://www.virtualbox.org/wiki/Downloads

Download Virtual Box 5.0 for Windows hosts The page look like:

Step2: Click on x86/amd64  link, then it starts downloading virtualBox-5.0.0-101573-Win.exe

Step 3:  Click on arrow to open folder contains the file

Step4: Then folder gets open, then double click on that folder to run

Step5 : Installation process starts. Click on Next button.

Step 6: It show default location ; if you want to change location, click on Browse button. Otherwise click on Next button

Step 7: It shows list of options, click on Next button.

Step8 : Then it asks for installation, Click on Next button.

Step9: It asks for review or change in Installation setting If you want any changes in previous process, click on Back button or else, click on Install button

Step10: It starts processing.

Step11: Click on Finish button

Step12: Virtual Box Manager Window appear.

Step13: Click on below link to download Cloudera Quick Start VM

              http://www.cloudera.com/downloads/quickstart_vms/5-7.html

The page look like:

Step14: Fill below screenshot page and Download the required version from menu (Virtual Box in this case)

Step15: Extract files from cloudera-quickstart-vm-5.7.0-virtualbox.

Step16: Double click on cloudera-quickstart-vm-5.7.0-virtualbox.

Step17: Double Click on setup as shown on below

Step18: Click on Import button

                                            Step19: Shows Progress of importing.

Step20: After completion of process of importing, the following window opens; then click on highlighted area to start cloudera on Oracle Virtualbox.

Step21: Running Cloudera on Virtualbox.

Step 22: Finally completed installation.

3
Know more about Cloudera VM tools

Understand Big Data

1
Introduction to Big Data
In this video we have explained, what is big data, Vs of Big data, Importance of Big Data.
2
Introduction to Big Data
3
Big Data Concepts

In this video, we have explained what is Hadoop, how we can use MapReduce in our day-to-day life.

4
Big Data Ecosystem

In this video, we have explained Big data ecosystem, and Big data terms, what are different tools of Hadoop Eco-system.

5
Big Data Distributions
In this video, we have explained what are the big Data Distribution available in the market, what are the common services available from different Distributions

Understating of MapReduce

1
Learn MapReduce

In this video we have explained, what is mapreduce, what is use of mapreduce, how mapreduce is executed.

2
Learn MapReduce
3
Map Reduce Core Concept
In this video, we have explained How map reduces can be applied in solving real life problem.
4
Map Reduce Core Concept
5
Map Reduce Concept with Simple Example

In this video, we have explained what are the daemons run while executing map reduce job, how daemons communicate with each other to do the job of map reduce.

Ingestion

1
Introduction of Sqoop

In this video, we have explained to you what is sqoop, what is flume,  sqoop work flow, sqoop architecture

2
Sqoop Import

In this video, we have explained what is import command, how sqoop import command is executed.

3
Sqoop Import
4
Import From RDBMS To HDFS

In this video we have explained how to execute commands in terminal,how
to get table list, how to get list of data bases, how to import data in
hdfs.

5
Hands Lab on Sqoop Import
6
Import From RDBMS To HDFS
7
Sqoop Export

In this video we have explained what is sqoop export, and how it is used.

8
Hands on Lab Sqoop export
9
Sqoop Export
10
Sqoop Incremental Import

In this video we have explained what is incremental sqoop, and how it works.what are the incremental import parameters etc.

11
Sqoop Jobs

In this video, we have explained what is sqoop jobs how it used and when
it is used. how to create jobs, how to list sqoop jobs available.

12
Hands on Lab Sqoop Job
13
Sqoop Jobs
14
Hands on Lab: Sqoop Incremental Import

In this video,  we have shown you, what is an incremental import, how it is executed, what is a benefit of incremental import.

15
Hands on Lab Sqoop incremental
16
Sqoop incremental import

Hive

1
Hadoop in Retail Industry
In this video, we have explained how Hadoop is applicable in the retail market, how hadoop can play important role in customer analysis
2
Hive Introduction

In this video, we have given a small introduction of the hive, why Facebook uses hive, where the hive was developed, what are hive features.

3
Hive Introduction
4
Hive Architecture

In this video, we have explained what is hive Architecture, how the hive is integrated with other hive components, how hive executes hive query.

5
Hive Architecture
6
DataTypes in Hive
In this video we have explained, what are the data type available in HiveQL, what are primitive data type available, Collection data types etc
7
Managed table and External table in Hive

In this video, we have explained what is an internal table, what is an external table, How they are used, what is the feature of hive internal table and external table.

8
Managed table and External table in Hive
9
Demonstrating difference between Internal and external table

In this video, we have explained what is an external table and internal table, what is the benefit of an external table over an internal table.

10
Hands on Lab Hive ExternalVsInternalTable
11
Demonstrating difference between Internal and external table
12
Partitions in Hive with demo
In this video we have explained partitioning in the hive, what is the meaning of partitioning table.
13
Hands on Lab Hive Partition
14
Partitions in hive
15
HIve Dynamic Partitioning

In this video we have explained Dynamic partition in hive, what is the usage of hive dynamic table, how to create dynamic table etc.

16
Hands on Lab HIve Dynamic Partitioning
17
HIve Dynamic Partitioning

Project

1
Data Masking Project Overview

In this video, we have explained the data masking project, which components we are going to use, what is the use of data masking etc, what are project requirement, what is a flow of the project.

2
Data Masking Project Solution Design
In this video, we have explained data masking solution, how this project is executed, what is the goal of the project, what Softwares/tools we are going to use in execution.
3
Data Masking Project Solution Walkthrough

In this video we have explain the step-by-stpe flow of Data Masking project, and different stages of project.

4
DataMaskingProject-step1(Create tables inMySql)

In this video we have explained how to create table in mysql, how to load data in mysql from file.

5
Hands on Lab DataMaskingProject-step1-Document
6
Step2:Creating and importing data in hive external tables

In this video, we have explained how to create an external table, and how to load data in the external table, how to import data from external table to hive table.

7
Hands on Lab DataMaskingProject-step2- Document
8
Step3:Creating UDFs in Java

In this video we have explained, how to crreate UDFs, and how to jar for Data Masking Project.

9
Hands on Lab DataMaskingProject-step3(udf)- Document
10
Step4:Exporting data to MySql in masked database

In this video, we have shown you actual execution of data masking, by using MySQL, sqoop.

11
Hands on Lab DataMaskingProjectStep4 - Document
12
Bonus Lecture
You can view and review the lecture materials indefinitely, like an on-demand channel.
Definitely! If you have an internet connection, courses on Udemy are available on any device at any time. If you don't have an internet connection, some instructors also let their students download course lectures. That's up to the instructor though, so make sure you get on their good side!
3.7
3.7 out of 5
65 Ratings

Detailed Rating

Stars 5
26
Stars 4
19
Stars 3
11
Stars 2
3
Stars 1
6
6edb0fb4768ee797940d0a396ea62396
30-Day Money-Back Guarantee

Includes

3 hours on-demand video
13 articles
Full lifetime access
Access on mobile and TV
Certificate of Completion