Apache Druid : Complete Guide
Learn Druid Architecture, Kafka Ingestion, Schema Evolution, Tuning and Druid Hive Integration with Twitter example
Lectures -21
Resources -8
Duration -2 hours
30-days Money-Back Guarantee
Get your team access to 10000+ top Tutorials Point courses anytime, anywhere.
Course Description
What do you learn from this course ?
In this course, we learn end-to-end apache druid salient features and integration with Apache Hive. We start this course by gaining theoretical knowledge on Druid and its key features.
Next, we jump to practical part where we install druid locally and walk you through its user portal. We change the druid metadata storage to Mysql and deep storage to S3 for enhancing the druid setup. After that, we write our own Twitter Producer app which pulls the tweets from twitter in realtime and push the tweets to apache Kafka.
We create a Kafka ingestion task on Druid which pull tweets from Kafka and store it into Apache Druid. Also, we learn how to apply transformation, filter, schema configuration during Kafka ingestion process.
Keeping practical knowledge in mind we jump to the theory part and dig deeper into the druid internal working principal. We learn, how the data is distributed between the data nodes and retrieved in realtime. Next, we tune our ingestion pipeline to gain better result. Lastly, we explore salient features like Accessing Druid through JDBC and Schema Evolution.
In the 2nd module, we talk about druid hive integration. At first, we learn what is this integration ? Next, we provision VM from AWS and install apache druid on it. After that, we acquire a hive EMR cluster from AWS and configure it such that it can communicate to druid easily. Lastly, we run the same druid queries on hive and learn how the computation is pushdown to druid for better performance.
Overall, this course is composite of theory and practical sessions. Throughout this course we use latest druid and hive version. At the end of this course, you will be excel on apache druid.
Goals
- In depth knowledge on Druid Components and it's Architecture
- Realtime data ingestion from Apache Kafka using Twitter Producer application
- Tuning Apache Druid for better throughput
- Accessing Apache Druid Tables through Avatica JDBC driver
- Learning Schema Evolution
- Complete Druid Hive Integration with hands-on  experience
Prerequisites
- Basics of Apache Kafka, Apache Hive
- Practical experience on Mysql, Â AWS
![Apache Druid : Complete Guide Apache Druid : Complete Guide](https://d3mxt5v3yxgcsr.cloudfront.net/courses/8364/course_8364_image.png)
Curriculum
Check out the detailed breakdown of what’s inside the course
Introduction
1 Lectures
-
Introduction 03:03 03:03
Apache Druid
15 Lectures
![Tutorialspoint](/market/public/assets/images/loader.gif)
Druid Hive Integration
5 Lectures
![Tutorialspoint](/market/public/assets/images/loader.gif)
Instructor Details
![Ganesh Dhareshwar](https://www.tutorialspoint.com/assets/profiles/377253/profile/200_2675683-1632039861.png)
Ganesh Dhareshwar
Course Certificate
Use your certificate to make a career change or to advance in your current career.
![sample Tutorialspoint certificate](/market/public/assets/newDesign/img/primePacks/V-certificate.png)
Our students work
with the Best
![adobe logo](/market/public/assets/newDesign/img/adobe.png)
![adp logo](/market/public/assets/newDesign/img/adp.png)
![apple logo](/market/public/assets/newDesign/img/apple.png)
![armani logo](/market/public/assets/newDesign/img/armani.jpg)
![bosch logo](/market/public/assets/newDesign/img/bosch.png)
![capegemini logo](/market/public/assets/newDesign/img/capegemini.png)
![cisco logo](/market/public/assets/newDesign/img/cisco.png)
![hdfc bank logo](/market/public/assets/newDesign/img/hdfcbank.png)
![ibm logo](/market/public/assets/newDesign/img/ibm.png)
![intel logo](/market/public/assets/newDesign/img/intel.png)
![mastercard logo](/market/public/assets/newDesign/img/mastercard.png)
![netflix logo](/market/public/assets/newDesign/img/netflix.png)
![qualcomm logo](/market/public/assets/newDesign/img/qualcomm.png)
![samsung logo](/market/public/assets/newDesign/img/samsung.png)
![sony logo](/market/public/assets/newDesign/img/sony.png)
![unilever logo](/market/public/assets/newDesign/img/unilever.png)
![walmart logo](/market/public/assets/newDesign/img/walmart.png)
![adobe logo](/market/public/assets/newDesign/img/adobe.png)
![adp logo](/market/public/assets/newDesign/img/adp.png)
![apple logo](/market/public/assets/newDesign/img/apple.png)
![armani logo](/market/public/assets/newDesign/img/armani.jpg)
![bosch logo](/market/public/assets/newDesign/img/bosch.png)
![capegemini logo](/market/public/assets/newDesign/img/capegemini.png)
![cisco logo](/market/public/assets/newDesign/img/cisco.png)
![hdfcbank logo](/market/public/assets/newDesign/img/hdfcbank.png)
![ibm logo](/market/public/assets/newDesign/img/ibm.png)
![intel logo](/market/public/assets/newDesign/img/intel.png)
![mastercard logo](/market/public/assets/newDesign/img/mastercard.png)
![netflix logo](/market/public/assets/newDesign/img/netflix.png)
![qualcomm logo](/market/public/assets/newDesign/img/qualcomm.png)
![samsung logo](/market/public/assets/newDesign/img/samsung.png)
![sony logo](/market/public/assets/newDesign/img/sony.png)
![unilever logo](/market/public/assets/newDesign/img/unilever.png)
![walmart logo](/market/public/assets/newDesign/img/walmart.png)
Related Video Courses
View MoreAnnual Membership
Become a valued member of Tutorials Point and enjoy unlimited access to our vast library of top-rated Video Courses
Subscribe now![Annual Membership Annual Membership](/market/public/assets/newDesign/img/membership-large-small.jpg)
Online Certifications
Master prominent technologies at full length and become a valued certified professional.
Explore Now![Online Certifications Online Certifications](/market/public/assets/newDesign/img/traning-for-a-team.png)