Apache Druid® Multi-Stage Query Framework Basics

In October 2022, a critical feature was released by Apache in the Druid database: support for INSERT operations in Druid SQL.  But that's not all – it introduced a new execution framework called "MSQ".  With Druid 24.0 and above, INSERT on top of the MSQ framework becomes an awesome way to carry out parallel batch ingestion – and in this training course you get a safe environment to try out this new feature first hand.

Who is this course for?

Application developers who ingest data into Druid are going to want to know about this framework!  But if you're a Druid operator, you will also need to have a feel for the infrastructure resources needed, especially for task parallelisation.

What's in this course?

With hands-on labs and short presentations, this course will walk you through:

• How to install and configure the multi-stage query framework
• Using the INSERT statement to ingest some batch data
• Generating SQL INSERT statements
• How MSQ actually works behind the scenes
• The APIs that MSQ provides

What do I need?

This course is best suited to those who have already got some experience of parallel batch ingestion in Druid. Other than that, as the course is fully browser-based, there's nothing else you'll need.