Learning Hive,Apache Zookeeper and SAS

Leveraging Apache Hive to process raw data and ETL operations in Hadoop various environments effectively
Instructor:
ASHOK M
6 students enrolled
You will learn hive
You will learn how to use zookeeper
You will learn kafka architecture
You will learn how to integrate Hive with Hbase

ZooKeeper is a replicated synchronization service with eventual consistency. It is robust, since the persisted data is distributed between multiple nodes (this set of nodes is called an “ensemble”) and one client connects to any of them (i.e., a specific “server”), migrating if one node fails; as long as a strict majority of nodes are working, the ensemble of ZooKeeper nodes is alive. In particular, a master node is dynamically chosen by consensus within the ensemble; if the master node fails, the role of master migrates to another node.

The master is the authority for writes: in this way writes can be guaranteed to be persisted in-order, i.e., writes are linear. Each time a client writes to the ensemble, a majority of nodes persist the information: these nodes include the server for the client, and obviously the master. This means that each write makes the server up-to-date with the master. It also means, however, that you cannot have concurrent writes.

The guarantee of linear writes is the reason for the fact that ZooKeeper does not perform well for write-dominant workloads. In particular, it should not be used for interchange of large data, such as media. As long as your communication involves shared data, ZooKeeper helps you. When data could be written concurrently, ZooKeeper actually gets in the way, because it imposes a strict ordering of operations even if not strictly necessary from the perspective of the writers. Its ideal use is for coordination, where messages are exchanged between the clients.

Introduction

1
Introduction
2
Architecture

Detailed information about Kafka and Spark Integration

1
Compression
2
Kafka Architecture
3
System Messages
4
Hive with SAS
5
Zookeeper model
6
Zookeeper installation
You can view and review the lecture materials indefinitely, like an on-demand channel.
Definitely! If you have an internet connection, courses on Udemy are available on any device at any time. If you don't have an internet connection, some instructors also let their students download course lectures. That's up to the instructor though, so make sure you get on their good side!

Be the first to add a review.

Please, login to leave a review
2290340b2f051b0fba5eb6366856caf0
30-Day Money-Back Guarantee

Includes

0 hours on-demand video
Full lifetime access
Access on mobile and TV
Certificate of Completion