Skip to content
Sharayu Rasal
← All projects

Data & ML · 2025

Hadoop & PySpark Streaming

  • Hadoop
  • PySpark
  • Structured Streaming

Hadoop & PySpark Streaming

§01What it is

Batch and structured-streaming pipelines over text, e-commerce, JSON and sensor data.

Built on

  • Hadoop
  • PySpark
  • Structured Streaming
See source code ↗

This is one of the smaller projects. The systems I’ve written up properly, with the architecture and the trade-offs, are on the homepage.