3.15 out of 5
3.15
95 reviews on Udemy

Apache Spark With Examples for Big Data Analytics

In-depth course to master Spark SQL & Spark Streaming using Scala for Big Data (with lots real-world examples)
Instructor:
Code Peekers
2,136 students enrolled
Get clear understanding of the limitations of MapReduce and role of Spark in overcoming these limitations
Understand fundamentals of Scala Programming Language and it’s features
Expertise in using RDD for creating applications in Spark
Mastering SQL queries using SparkSQL
Gain thorough understanding of Spark Streaming features

This course covers all the fundamentals you need to write complex Spark applications. By the end of this course you will get in-depth knowledge on Spark core,Spark SQL,Spark Streaming.

This course is divided into 9 modules

  1. Dive Into Scala – Understand the basics of Scala that are required for programming Spark applications.Learn about the basic constructs of Scala such as variable types, control structures, collections,and more.
  2. OOPS and Functional Programming in Scala – Learn about object oriented programming and functional programming techniques in Scala
  3. Introduction to Apache Spark – Learn Spark Architecture,Spark Components and spark use-cases
  4. Spark Basics – Learn how to configure/run spark in eclipse/intellij
  5. Working with RDDs in Spark – Learn what is Resilient Distributed Dataset,Different types of actions and transformations which can be applied on RDDs
  6. Aggregating Data with Pair RDDs – Learn how Pair RDD is different from RDD,Different types of actions and transformations which can be applied on Pair RDDs
  7. Advanced Spark Concepts – Learn how Spark uses Broadcast variables and Accumulators to perform calculations,how persistence and partitioning helps to achieve performance
  8. Spark SQL and Data Frames – Understand the difference between Dataframe and Dataset
  9. Spark Streaming – Learn how to analyse massive amount of dataset on the fly

All the concepts are explained using hands-on examples.This course covers 10+ hands-on big data examples such as

  • Explore player data from 2014 world cup
  • Agregate data from ebay online auction data
  • Understand different data points from Adhaar data
  • Develop application to analyse funds received by Indian startup
  • Explore the price trend by looking at the real estate data in California
  • Help retailer to find out valid and invalid purchase transactions of chain of stores in Bangalore
  • Write Spark program find out count of stores in each US region from USA states & Store locations data
  • Develop Spark Streaming application to perform Twitter Sentiment Analysis

30-day Money-back Guarantee! You will get 30-day money-back guarantee from Udemy for this course. 

If not satisfied simply ask for a refund within 30 days. You will get a full refund. No questions whatsoever asked.

Dive Into Scala

1
Introduction to scala
2
Environment Setup
3
Hello Scala
4
Flow Controls
5
Functions and operators
6
OOPS concepts
7
Traits
8
Arrays
9
Collections

Introduction to Apache Spark

1
BigData and Need for Apache Spark
2
What is Spark,Spark Features and Spark Eco System
3
Spark Architecture
4
Spark Usecases

Spark Configuration

1
Setup Environment
2
Word Count Program in Spark

Working with RDDs in Spark

1
What is RDD & How to Create
2
Transformations - filter & map
3
Solving Cars By Mileage problem using map and filter transformations
4
Solving Cars In America problem using map and filter transformations
5
Transformations - flatmap,union & intersection
6
Analysis on 2014 football world cup player information
7
RDD Actions
8
Nasa Access Logs Analysis

Aggregating Data with Pair RDDs

1
Pair RDD - How to Create,reduceByKey
2
groupByKey and reduceBykey vs groupByKey
3
Transformations - mapvalues sortbykey countbykey
4
Analysis on 2015 Indian Startup funding information
5
Analysis on real estate data using pair rdd operations
6
Join Operations

Advanced Spark Concepts

1
Broadcast Variables
2
Accumulators
3
Persistence and Caching
4
Partitioning

Spark SQL

1
What is Spark SQL
2
DataFrames
3
DataSets
4
Ebay Auction Data Analysis
5
Adhaar Data Analysis

Spark Streaming

1
What is Spark Streaming?
2
DStreams
3
Spark Streaming Example
4
Twitter Sentiment Analysis
You can view and review the lecture materials indefinitely, like an on-demand channel.
Definitely! If you have an internet connection, courses on Udemy are available on any device at any time. If you don't have an internet connection, some instructors also let their students download course lectures. That's up to the instructor though, so make sure you get on their good side!
3.2
3.2 out of 5
95 Ratings

Detailed Rating

Stars 5
61
Stars 4
13
Stars 3
12
Stars 2
2
Stars 1
7
6cba02a0c696609f5f989234183c2c2b
30-Day Money-Back Guarantee

Includes

4 hours on-demand video
Full lifetime access
Access on mobile and TV
Certificate of Completion