[Spotify] How Spotify Optimized the Largest Dataflow Job Ever | Software engineering blogs

[Spotify]
How Spotify Optimized the Largest Dataflow Job Ever for Wrapped 2020
In this post we’ll discuss how Spotify optimized and sped up elements from our largest Dataflow job, Wrapped 2019, for Wrapped 2020 using a technique called Sort Merge Bucket SMB join. We’ll present the design and implementation of SMB and how we incorporated it into our data pipelines