Apache Druid Basics

Lessons

1. Introduction to Data Streaming & Subsequent Processing

   Easy

   Gautam Goswami

   1. Introduction to Data Streaming

      Easy

      40 mins

      Gautam Goswami

      Data streaming is essential for modern businesses in practically every industry since it enables applications to run in real time.

   2. Why is Real-time Data Streaming Analytics Critical?

      Moderate

      30 mins

      Gautam Goswami

      Here are the following reasons of why real-time analytics becoming critical day by today

   3. Basic Understanding of OLAP and Slice & Dice Analytics

      Moderate

      50 mins

      Gautam Goswami

      OLAP stands for Online Analytical Processing, and it's a technology used to analyze large amounts of data quickly and efficiently.

   4. Real time Data Streaming Platforms (Apache Kafka, Amazon Kinesis, Azure Stream Analytics)

      Difficult

      50 mins

      Gautam Goswami

      A real-time data streaming platform is a software infrastructure designed to ingest, process, and deliver data in real-time from various sources to multiple destinations.

   5. Introduction to Apache Druid

      Difficult

      40 mins

      Gautam Goswami

      Apache Druid is a high performance, real-time analytics database that delivers sub-second queries on streaming and batch data at scale and under load.

   6. Apache Druid Use Cases

      Difficult

      40 mins

      Gautam Goswami

      Apache Druid is used in various real-time use cases where fast and interactive analytics on streaming data are required.

2. Going deeper with Apache Druid

   Moderate

   Gautam Goswami

   1. Architecture of Apache Druid

      Difficult

      60 mins

      Gautam Goswami

      The distributed architecture of Druid is created to be user-friendly and cloud-friendly.

   2. Data Ingestion or Data Indexing in Apache Druid

      Difficult

      60 mins

      Gautam Goswami

      Ingestion or indexing in Apache Druid refers to the process of loading data into the Druid system for querying and analysis.

   3. Data Management in Apache Druid

      Difficult

      45 mins

      Gautam Goswami

      Data management in Apache Druid involves various aspects of handling data within the Druid system, including data retention, data purging, and schema evolution.

   4. Interacting with Apache Druid using Druid SQL

      Difficult

      45 mins

      Gautam Goswami

      Druid SQL is a query language that allows you to interact with Apache Druid using SQL-like syntax. It provides a familiar and intuitive way to query and analyze data stored in Druid.

   5. Understanding the Deep Storage in Apache Druid

      Difficult

      60 mins

      Gautam Goswami

      The phrase "deep storage" refers to the long-term storage system used by Apache Druid, where past data segments are preserved for durability and retrieval in the future.

3. Installation & Set-up of Apache Druid

   Difficult

   Gautam Goswami

   1. Installing a Single-node Apache Druid Cluster

      Difficult

      120 mins

      Gautam Goswami

      This document explains how to set up Apache Druid on a single node cluster. This single node will act as both Druid servers as well as external dependencies.

4. Data Management With Apache Druid

   Moderate

   30 mins

   Gautam Goswami

   1. Data Loading/Ingestion in Apache Druid

      Moderate

      50 mins

      Gautam Goswami

      Data loading in Apache Druid refers to the process of ingesting data into the Druid cluster for storage and subsequent querying and analysis.

   2. Data Formats in Apache Druid

      Moderate

      120 mins

      Gautam Goswami

      The data format in Druid can be described as a "columnar" format. This means that data for each column is stored together in memory, making it highly efficient for analytical queries.