4.44 out of 5
4.44
3344 reviews on Udemy

Scala and Spark for Big Data and Machine Learning

Learn the latest Big Data technology - Spark and Scala, including Spark 2.0 DataFrames!
Instructor:
Jose Portilla
19,714 students enrolled
English [Auto-generated] More
Use Scala for Programming
Use Spark 2.0 DataFrames to read and manipulate data
Use Spark to Process Large Datasets
Understand hot to use Spark on AWS and DataBricks

Learn how to utilize some of the most valuable tech skills on the market today, Scala and Spark! In this course we will show you how to use Scala and Spark to analyze Big Data.

Scala and Spark are two of the most in demand skills right now, and with this course you can learn them quickly and easily! This course comes packed with content:

  • Crash Course in Scala Programming
  • Spark and Big Data Ecosystem Overview
  • Using Spark’s MLlib for Machine Learning 
  • Scale up Spark jobs using Amazon Web Services
  • Learn how to use Databrick’s Big Data Platform
  • and much more!

This course comes with full projects for you including topics such as analyzing financial data or using machine learning to classify Ecommerce customer behavior! We teach the latest methodologies of Spark 2.0 so you can learn how to use SparkSQL, Spark DataFrames, and Spark’s MLlib!

After completing this course you will feel comfortable putting Scala and Spark on your resume!

Thanks and I will see you inside the course!

Course Introduction

1
Introduction

Welcome to the Course!

2
Course FAQs

FAQ for the course!

3
Scala and Spark Overview

Get an Overview of Scala and why it is one of the most in demand programming skills!

Scala IDE Options and Overview

1
ScalaIDE Overview

Get an overview of the IDE we choose for this course: ScalaIDE

2
Computer Set-up Time!

Let's get you set-up!

Windows Scala and Spark Set-up and Installation

1
Windows Introduction

Let's install Scala and Spark on your Windows Machine!

2
Quick note about Windows Installation.

Let's install Scala and Spark on your Windows Machine!

3
Windows Scala and Spark Installation

Let's install Scala and Spark on your Windows Machine!

4
Atom Windows Installation

Learn about various options for IDEs for Scala and Spark

5
Terminal Exericse

Let's install Scala and Spark on your Windows Machine!

Mac OS Setup and Installation

1
Mac OS Installation and Setup

Install Spark and Scala if you are on a Mac!

Linux (Ubuntu) Setup and Installation

1
Installing Scala and Spark on Linux (Ubuntu)

Full guide to installing Spark and Scala on a Linux Ubuntu Platform

Scala Programming: Level One

1
Arithmetic and Numbers

Learn about basic arithmetic operators in Scala

2
Values and Variables

Learn the basics of Data Types in Scala

3
Booleans and Comparison Operators

Learn about Relational operators in Scala

4
Strings and Basic Regex

Learn about strings in Scala

5
Tuples

Learn about Scala tuples!

6
Scala Basics - Assessment Test Exercises

Test your knowledge!

7
Scala Basics Assessment Test Questions

Time to practice!

8
Scala Basics - Assessment Test Solutions

Learn about Logical Operators

Collections

1
Intro to Collections

Part of the Scala Collections section of the course!

2
Lists

Part of the Scala Collections section of the course!

3
Arrays

Part of the Scala Collections Section

4
Sets

Part of the Scala Collections section of the course!

5
Maps

Part of the Scala Collections section of the course!

6
Collections - Assessment Test Exercise

Part of the Scala Collections section of the course!

7
Scala Collections Assessment Test

Part of the Scala Collections Part of the Course

8
Collections Assessment Test - Solutions

Part of the Scala Collections section of the course!

Scala Programming: Level Two

1
Flow Control

Learn Level Two of Scala Programming!

2
For Loops

Learn how to create control flow loops with Scala

3
While Loops

Learn Level Two of Scala Programming!

4
Functions

Learn how to create functions with Scala!

5
Scala Programming Exercises

Overview of Scala Level One Assessment

6
Scala Programming Exercises - Solutions

Solutions to Scala Programming Test

Spark DataFrames with Scala

1
Quick Note for Windows Users!

Quick note!

2
Introduction to Spark DataFrames

Learn how to use the Latest Spark 2.0 DataFrames!

3
DataFrames Overview

Learn how to use the Latest Spark 2.0 DataFrames!

4
Spark DataFrame Operations

Learn how to use the Latest Spark 2.0 DataFrames!

5
GroupBy and Aggregate Functions

Learn how to use the Latest Spark 2.0 DataFrames!

6
Missing data

Learn how to use the Latest Spark 2.0 DataFrames!

7
Date and Timestamps

Learn how to use the Latest Spark 2.0 DataFrames!

8
Quick Note on DataFrame Project

Quick note!

9
DataFrame Project Exercises

Learn how to use the Latest Spark 2.0 DataFrames!

10
DataFrame Project - Solutions

Learn how to use the Latest Spark 2.0 DataFrames!

Introduction to Machine Learning

1
Introduction to Machine Learning

Part of the Machine Learning with Scala and Spark Section

2
Machine Learning with Spark

Part of the Machine Learning with Scala and Spark Section

3
IntelliJ IDEA Installation Overview

Part of the Machine Learning with Scala and Spark Section

Regression with Spark

1
Introduction to Linear Regression

Learn about Regression Models with Spark!

2
Introduction to Regression Section

Learn about Regression Models with Spark!

3
Linear Regression Documentation Example

Learn about Regression Models with Spark!

4
Alternate Linear Regression Data CSV File

Quick note

5
Linear Regression Walkthrough Part 1

Learn about Regression Models with Spark!

6
Linear Regression Walkthrough Part 2

Learn about Regression Models with Spark!

7
Linear Regression Exercise Project

Learn about Regression Models with Spark!

8
Linear Regression Project Solutions

Learn about Regression Models with Spark!

Classification with Spark

1
Introduction to Classification

Learn about Classification with Spark!

2
Classification Documentation Example

Learn about Classification with Spark!

3
Spark Classification - Logistic Regression Example - Part 1

Learn about Classification with Spark!

4
Spark Classification - Logistic Regression Example - Part 2

Learn about Classification with Spark!

5
Logistic Regression Project Exercise

Learn about Classification with Spark!

6
Classification Project Solutions

Learn about Classification with Spark!

Model Evaluation

1
Model Evaluation Overview

Learn about Model Evaluation with Spark

2
Spark Model Evaluation - Documentation Example

Learn about Model Evaluation with Spark

3
Spark - Model Evaluation - Regression Example

Learn about Model Evaluation with Spark!

Clustering with Spark

1
Introduction to Clustering with Spark

Learn how to use Clustering Algorithms with Spark!

2
KMeans Theory Lecture

Learn how to use Clustering Algorithms with Spark!

3
Note on Kmeans
4
Example of KMeans with Spark

Learn how to use Clustering Algorithms with Spark!

5
Clustering Project Exercise Overview

Learn how to use Clustering Algorithms with Spark!

6
Clustering Project Exercises - Solutions

Learn how to use Clustering Algorithms with Spark!

PCA with Spark

1
PCA Theory Overview

Learn how to conduct a Principal Component Analysis with Spark!

2
PCA with Spark - Documentation Example

Learn how to conduct a Principal Component Analysis with Spark!

3
PCA with Spark - Project Exercise

Learn how to conduct a Principal Component Analysis with Spark!

4
PCA Spark Exercise - Solutions

Learn how to conduct a Principal Component Analysis with Spark!

DataBricks and Spark

1
Databricks Overview

Learn how to build a Recommender System on Databricks!

2
Introduction to Spark Recommendation Systems

Learn how to build a Recommender System on Databricks!

3
Spark Recommender System Implementation

Learn how to build a Recommender System on Databricks!

4
Zeppelin Notebooks on AWS Elastic MapReduce

Learn how to set up your own cluster on AWS EMR!

5
So what's next?

Find out what's next for you

BONUS DISCOUNT COUPONS

1
Bonus Lecture: Coupons
You can view and review the lecture materials indefinitely, like an on-demand channel.
Definitely! If you have an internet connection, courses on Udemy are available on any device at any time. If you don't have an internet connection, some instructors also let their students download course lectures. That's up to the instructor though, so make sure you get on their good side!
4.4
4.4 out of 5
3344 Ratings

Detailed Rating

Stars 5
1661
Stars 4
1242
Stars 3
349
Stars 2
66
Stars 1
26
236d17c601abf0994c092d45b9525197
30-Day Money-Back Guarantee

Includes

10 hours on-demand video
12 articles
Full lifetime access
Access on mobile and TV
Certificate of Completion