Hi, thanks for writing the notebooks.
In the introduction to RDD partitioning you mention that the filter operation does not preserve partitioning. But I'm looking at the source code where I see that MapPartitionsRDD is instantiated with preservesPartitioning = true.
Doesn't this conflict your statement?
Hi, thanks for writing the notebooks.
In the introduction to RDD partitioning you mention that the
filteroperation does not preserve partitioning. But I'm looking at the source code where I see thatMapPartitionsRDDis instantiated withpreservesPartitioning = true.Doesn't this conflict your statement?