The building blocks of Elasticsearch’s massive scalability at Kariera Codeweek 2024

The Kariera CodeWeek 2024 was a free, three-day (April 15-17, 2024) online conference organized by kariera.gr targeting software engineers, developers, and tech enthusiasts. It was an honor to be one of the speakers!

My presentation was titled “The building blocks of Elasticsearch’s massive scalability”. The abstract of the presentation is:

The Elasticsearch Platform tackles modern-day observability & security demands of fast-paced searches in ever-increasing data volumes. Elasticsearch, the core of the platform, is a leading distributed search and analytics engine. In this talk, we give an overview of the building blocks of what makes Elasticsearch distributed, efficient and resilient both on bare-metal and on the cloud. This includes an overview of advancements made in recent years. You will learn how: (a) data is ingested, sharded and replicated, (b) searches and aggregations are distributed, (c) recovery works in the event of failures, (d) cluster state is coordinated, and (e) scaling with data tiers. We conclude with Elasticsearch’s novel serverless cloud vision for unparallel scalability.

You can access the video recording of the presentation here:

The slides of the presentation are available here to download in PDF format.

The agenda of the presentation revolves around the topics:

• What is Elastic
• What is Elasticsearch
• How Elasticsearch scales out with shards
• Distributed searches & aggregations
• Shard recovery
• Cluster state
• Scaling with data streams
• Scaling with ILM
• Vision: scaling with Serverless

Enjoy and feel free to share your feedback!