Login
Remember
Register
Ask a Question
Why are partitions immutable?
0
votes
asked
Feb 16, 2023
in
Spark Preliminaries
by
Robindeniel
Why are partitions immutable?
partitions-immutable
Please
log in
or
register
to answer this question.
1
Answer
0
votes
answered
Feb 16, 2023
by
Robindeniel
With each change, a new partition is made. Partitions use the HDFS API, so they can't be changed, are spread out, and can handle mistakes. Because of this, partitions are aware of where the results are.
...