0 votes
in Spark Preliminaries by
Why are partitions immutable?

1 Answer

0 votes
by
With each change, a new partition is made. Partitions use the HDFS API, so they can't be changed, are spread out, and can handle mistakes. Because of this, partitions are aware of where the results are.
...