Shuffle operation is used in Spark to re-distribute data across multiple partitions.
It is a costly and complex operation.
In general a single task in Spark operates on elements in one partition. To execute shuffle, we have to run an operation on all elements of all partitions. It is also
called all-to-all operation.
