Online Courses > Development > Databases > mastering data integration (ETL) with pentaho kettle PDI

3.4 out of 5

382 reviews on Udemy

mastering data integration (ETL) with pentaho kettle PDI

hands on , real case studies ,tips, examples , walk trough a full project from start to end based on mySQL sakila DB.

Instructor:

Itamar Steinberg (inflow systems)

2,298 students enrolled

English [Auto-generated]

develop real pentaho kettle projects

become master in transformation steps and jobs

know how to set pentaho kettle environment and deploy

be familiar with the most used steps of pentaho kettle

you will know to secure , validate , handle errors

check the performance and have the tools to solve issues

Why should i take this course
Isn’t it obvious? Don’t you want to be the best ETL, pentaho kettle developer?

General:
The course is the outcome of my 10 year experience with IT projects and business intelligence and data integration with pentaho kettle.

I developed the course because I want to share my knowledge with you.

the best way to learn technological software and concepts is via an online course,
structured by a real developer with actual experience that guide you through his (my) Path to knowledge.

I will help you master ETL with pentaho kettle .

What is the course about?The course is about taking you from the beginning and transfer you to a master of Pentaho kettle .

The main dish of the course is a walk-through of a real pentaho kettle project hands on, case study, tips taking you from easy steps that becomes more and more complex, layer by layer, as you go forward. That way you can learn pentaho kettle as a beginner but also become an expert as you go along (and practice)

Also I cover

the concepts of data integration
why we need it
what are the tools used today
data warehouse concepts

Structure of the course
the course is divided 4 main sections:

Section 1: Theory and concepts of data integration in general
(if you already an ETL developer you can skip that)

Section 2: setting up the environment

install and operate the data integration with pentaho kettle.
Including database management and profiling the database as a source.
PDI, navicat (to manage database), jdbc drivers, JRE, sakila database example, mysql and more .

walk-through

pentaho kettle environment.
navicat (best database manager in my opinion)
power architect

Section 3: the main dish

full data integration project with pentaho kettle
project overview
detailed design
step-by-step (divide and conquer)

until the successfully end of the project. Including some 80% of the steps used by pentaho kettle in order to master data integration.
You can see all the steps in the curriculum (it’s too many to write them here)
just for the example:

a. Connect to various data sources (databases, files…)

b. manipulate the data
changing strings, dates and calculations, joins, lookups, slowly changing dimensions, consideration of when and how to use different steps.

c. Work with variables
d. outputs steps (bulk load , table output , update/insert , file output…)

Section 4: wrapping up – go to production

You will learn how to:

deploy the project.
make it stable by securing the solution – validation, error handling
logging

performance

Installations

What we are going to install?

The list of software we require in order to run and work with Pentaho ETL

Install mysql

Install JRE - java runtime

JRE is required by Pentaho in order to run

Install pentaho data integration (kettle)

This lecture shows how to install pentaho data integration

Install navicat - mysql manager

This lecture shows how to install navicat

Install sakila database (and notepad++)

install power architect

this lecture shows how to install data architect - profile tool for databases

Install expresso

This lecture will show how to install expresso, a tool that acts as wizard for creating regular explressions

Hands on - Pentaho

Pentaho PDI getting started

kettle variables part 1

kettle variables part 2

kettle database connection

Pentaho repositories

schema introduction

Software Walkthroughs

Navicat walkthrough

power architect walkthrough

This lecture is about Profiling database with power architect

The Date Dimension

dim date intro

generate rows part 1

generate rows part 2

generate rows part 3

the add sequence

the select values

the mapping / string cut / string concat

the table output

the string operation

dim date summary

dim time

dim time intro

arrange steps and create hours and minutes

the Cartesian step

Cartesian customer example

the modified java script value

the field set / filter rows / dummy steps

dim time summary

dim staff

dim staff intro

the table input

the data grid / value mapper

consideration 1 - historical data in dimensions

consideration 2 - truncate or update table

consideration 3 - be like mike - deleted rows on dimension

dim store

dim store intro

the database lookup

the stream lookup

the insert /update step

the system info

dim customer

dim customer intro

control "changed data only" input

down it goes with the stream

slow changing dimension - concept

slow changing dimension - example

dim film

dim film intro

objectives

the number range

the merge join / sort rows / value null

the denormaiser / split fields to rows

fact rentals

fact rental intro

the inventory - film and store id

slow changing dimension on fact table

counter and date diff calculation

key date handling

the time dimension check

error handling step

Go to production

production steps intro

the final job

kitchen batch file

schedule jobs

validation - secure the stream part 1

validation - secure the stream part 2

logging

performance

ETL concepts and sources

what is ETL

the data warehouse concept

Analytical structure

ETL tools comparison

Whats next...

need more input

this is a goodbye

How long do I have access to the course materials?

You can view and review the lecture materials indefinitely, like an on-demand channel.

Can I take my courses with me wherever I go?

Definitely! If you have an internet connection, courses on Udemy are available on any device at any time. If you don't have an internet connection, some instructors also let their students download course lectures. That's up to the instructor though, so make sure you get on their good side!

3.4