Skip to content

Latest commit

 

History

15 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Stream Processing

An open course on how stream processing systems are organized and how they work.

Follow events from their source to a continuously updated result. Learn why time, state, and recovery matter, how Kafka fits into the system, and what happens when events arrive late or twice.

Start learning

Who is this for?

Backend developers, data engineers, and software engineers who want to understand the principles behind stream processing systems. The course introduces the concepts as they become useful; prior experience with a stream processing framework is not required.

How is the course different?

The focus is on concepts and architectural trade-offs. Connected examples follow grocery deliveries, AI service usage, and charging station availability as new problems arise. You'll see why a mechanism is needed, how it works, and what its limits are before exploring framework-specific APIs.

Course outline

Published

24 articles are available. Each link opens the first article in that section.

Planned

  • Implementations and comparison: the same computation in Kafka Streams, Flink, and Spark Structured Streaming.
  • Event contracts and evolution: schema compatibility and events that cannot be processed.
  • Using results: views for reading and automated actions.
  • Operations: overload, data skew, scaling, observability, and recovery.
  • The whole system: tracing the data path and revisiting architectural decisions.

Errors and questions

Open an issue to report an error or ask a question. For an error, include the article link and the passage or behavior you think needs fixing.

See Contributing for correction and topic suggestion guidelines.

License

© 2026 Grig Alex. The text of the course articles is licensed under CC BY-NC-SA 4.0. You may share and adapt it for noncommercial purposes if you credit Grig Alex, link to the license, indicate changes, and share adaptations under the same license. See LICENSE for the full terms.

The site uses open-source software, including Astro, Starlight, and Pagefind, under their own licenses.