3.2 out of 5
3.2
146 reviews on Udemy

Learn Big Data Testing with Hadoop and Hive with Pig Script

Big Data Testing - Hadoop & Hive including Unix, Shell and Pig Scripting
Instructor:
Big Data Engineer
1,011 students enrolled
At the end of this course, students would be able to get the knowledge about Hadoop Big Data Testing.
Also, students would get the knowledge of Hive Query language with Hadoop data integration.

This course is for Big Data testing with Hadoop tool.

The target audience for this tutorial is who all are willing to learn big data testing and wanted to make his/her career into big data testing.

I have included the material that is needed for big data testing profile.

All the users who is working in testing profile and wanted to move into big data testing should take this course and go through the complete tutorials.

Big Data Testing - Hadoop

1
Hadoop Introduction

After this session, students would get to know the complete agenda on this tutorial which we are going to cover in this.

2
Why we need Hadoop

This video has covered why we need big data and what is in it for Testing.

3
What is Big Data?
4
Big Data Hadoop Introduction

This video covered the introduction part of big data Testing with Hadoop.

Cloudera Environment Setup Process

1
What is Cloudera and How to Setup Cloudera Environment?

Different Hadoop Commands

1
Hadoop Practice Questions for Students
2
Hadoop Installation process and Service Start Stop

In this video tutorial, user would get the information for Hadoop installation. Also, they will get to know how to start and stop hadoop services.

3
Hadoop Start and Stop on Ubuntu Machine

In this video, user would get the details information for hadoop services when running on Ubuntu Machine. It gives the information how they can execute the command in Terminal.

4
Hadoop Services and JPS Command

In this session, user would get the details about hadoop services and JPS command in detail.

5
All HDFS Comamnds -1
6
All HDFS Comamnds -2
7
All HDFS Comamnds -3
8
All HDFS Comamnds -4
9
Different HDFS Command Part -5(Ubuntu)

In this video, user would get to know practical example of how to work on different hadoop command i.e. create file, directories etc.

10
Different HDFS Command Part -6 (Ubuntu)

In this video, user would get to know practical example of how to work on different hadoop command i.e. moving file within cluster, head, tail, remove etc.

11
How to Work with Map-Reduce for Word Count Example in Eclipse?
12
Execute Hadoop Jar for Word Count Program from Hadoop Terminal

Hadoop Background

1
Unix and Shell Scripting Practice Questions for Students
2
HDFS Architecture with NameNode and DataNode

In this session, user would get to know the Hadoop Architecture in detail with NameNode and  DataNode features.

3
Different Hadoop Running Modes

In this session, user would get to know the all three modes in which Hadoop Can be executed.

4
Hadoop Main Components

In this session, user would get to know all the main components of Hadoop in details and their functionalities.

5
3 Vs in Big Data

This video tutorial covered the 3 V's available in Big Data Hadoop with detailed information.

6
Hadoop Different Data Supports

In this video tutorial, user would get the detailed information about the different data supports available in Big Data Hadoop. It covered the information with different testing data. 

7
Differences Between Hadoop 1.x and Hadoop 2.x

In this video, user would get to know the major differences between Hadoop 1.x version and Hadoop 2.x Version in detail.

8
HDFS and Hadoop Daemons

In this session, user would get to know the HDFS in detail and Hadoop Daemons in details with their functionalities.

9
Hadoop Block Size and Input Split

In this session, user would get to know the hadoop block size and input split in details. Also, they will get the knowledge how they can increase or decrease the block size as per the need of the project.

10
Automation Related Practice Questions for Students

Big Data Testing - Hive

1
Hive Overview

In this session, user would get the details overview for Hive Tool which is used with Hadoop for the data processing.

2
Hive Practice Questions for Students
3
Hive Installation

In this session, user would get the detail view of Hive installation and how to open the Hive terminal for query/table creation.

4
Hive Queries - Part1

In this session, students would get the knowledge of how to create queries in Hive and with different tables and how we insert records in tables. 

5
Hive Characteristics and Features

In this session, user would get to know the Hive characteristics and their Features in detail.

6
Different Hive Tables and its Differences

In this session, user would get to know the different types of Hive tables and what all are the major differences for different types of Hive tables available in details.

7
How Hive different with RDBMS

In this session, user would get to know how Hive is different with our traditional RDBMS in details.  

8
Hive Components

In this session, user would get to know the different Hive Components in detail with diagram.

9
Hive Queries (Managed Table) - Part2

In this session, students would get the knowledge of Managed Table creation i.e. default table of Hive and how we insert values in managed tables.

10
Hive Queries (External Table) - Part3

In this session, user would get the detail information about how we can create external table and how we can insert data into external table.

11
Few Important Hive Basic Queries

In this session, students would get to know the basic queries for Hive i.e. how to see database, how to see the table, how to see the schema of table, table creation, data insertion in table etc.

12
Different Hive Joins i.e. Inner Join, Left Outer Join and Right Outer Join

In this session, students would get the knowledge of different Join available in Hive and how we created our queries using these joins which is Inner Join, Left Outer Join and Right Outer Join etc. to fetch the records from multiple tables.

13
Hive Partitions - Static Partition Implementation

In this session, students would get the detailed knowledge of different Hive Partitions. In this video, I have included how Static Partition is implemented in real time projects.

14
Hive Partitions - Dynamic Partition Implementation

In this session, students would get the detailed knowledge of dynamic Hive Partitions and its implementation in real time projects.

15
Hive - Indexes Implementation

In this session, students would get the detailed knowledge on how they can implement the Indexes in Hive and how to query with Indexes and verify the different Indexes created on Hive table in real projects.

16
Hive - Views Implementation

In this session, students would get the detailed knowledge on how they can implement the View in Hive and how to query the view and verify the different view created on Hive table in real projects.

17
Hive - Bucketing

In this session, students would get the detailed knowledge on how they can implement the Bucketing in Hive and how to query the using this and verify the different buckets created on Hive table in real projects.

18
Hive UDFs

In this session, students would be able to learn about how to implement the UDFs and how we can use these implemented UDFs through Hive CLI in detailed step by step information.

19
Insert INTO and Insert Overwrite

In this session, students would get the knowledge for the insert into and insert overwrite query implementation.

20
Use Case (MovieLens) implementation Part-1

In this session, students get the practical implementation of the movielens use case implementation.

21
Use Case implementation Part-2

In this session, students get the practical implementation of the movielens use case implementation.

22
How to Update and Delete Table Records in Hive

In this session, students get the detailed information how they can update or delete the records in Hive table that is by default not available in Hive's lower version.

23
How to Add Columns in Existing Table

In this session, students get the detailed information how they can can add columns in existing Hive table.

24
Min Max Avg and Count Functions Implementation

In this session, students get the detailed information how they can can get the Min, Max, Avg and Count value of Hive table using the inbuilt Hive functions.

25
Add Table Using Existing Table

In this session, students would get the information about the adding new tables from existing tables available in database in Hive terminal.

26
How to Rename Table

In this session, students get the knowledge how they can rename the table if they wanted using the inbuilt function provided by Hive.

27
Replace Columns Schema

In this session, students get the knowledge how they can replace columns with new schema from existing table schema using the inbuilt function provided by Hive.

28
How to Compare Two HIVE Tables to Get the Distinct Records?
29
How to execute Hive Tables/Files using Shell Script File?
30
Collections

In this session, students would get the knowledge of different types of Collections available in Hive and how it is implemented.

Unix/Linux and Shell Scripting

1
How to create File and Directories?
2
How to Open file in Editor and Save the file?
3
Copy and Move commands
4
How to Find Files?
5
Head and Tail Commands
6
More and Less Commands
7
How to Find 'String/Word" from File with word count condition.
8
How to Work with SED commands in Unix
9
How to Work with AWK command in Unix
10
Redirect Output to Other File which is generated from Conditition

Pig Concepts

1
Pig Scripting Practice Questions for Students
2
Pig Installation
3
Pig Shell Types
4
How to Load Data in Pig from Local Enviornment and Query the Data
5
How to test Schema and Metadata?
6
Grouping in Pig Script
7
How to Filter Data in Pig Scripting (Local Mode)
8
How to Limit Pig Script Output?
9
How to Load Data in Pig from HDFS Environment and Query?
10
How to Filter Data Based on String (HDFS Mode)
You can view and review the lecture materials indefinitely, like an on-demand channel.
Definitely! If you have an internet connection, courses on Udemy are available on any device at any time. If you don't have an internet connection, some instructors also let their students download course lectures. That's up to the instructor though, so make sure you get on their good side!
3.2
3.2 out of 5
146 Ratings

Detailed Rating

Stars 5
61
Stars 4
23
Stars 3
28
Stars 2
17
Stars 1
17
ae22692ce654e9ee008c8a9540dcd93f
30-Day Money-Back Guarantee

Includes

11 hours on-demand video
Full lifetime access
Access on mobile and TV
Certificate of Completion