Skip to content

Commit 9dbf7b5

Browse files
Mohammad LinjawiMohammad Linjawi
authored andcommitted
[VL][Delta] Remove DV validation that blocks native DV scan handoff
The doValidateInternal() method from upstream was rejecting all DV scans with 'Deletion vector is not supported in native.' This conflicts with this branch's purpose of enabling DV support via JVM handoff. Removed the validation to allow DV scans to proceed through the native scan path with JVM handoff for DV processing. This fixes test failures in DeltaInsertIntoSQLByPathSuite where DV scans were incorrectly falling back to JVM instead of using the handoff feature.
1 parent 31b5b0d commit 9dbf7b5

1 file changed

Lines changed: 0 additions & 12 deletions

File tree

gluten-delta/src/main/scala/org/apache/gluten/execution/DeltaScanTransformer.scala

Lines changed: 0 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -84,18 +84,6 @@ case class DeltaScanTransformer(
8484
case _ => dataFilters
8585
}
8686

87-
override protected def doValidateInternal(): ValidationResult = {
88-
if (
89-
requiredSchema.fields.exists(
90-
_.name == "__delta_internal_is_row_deleted") || requiredSchema.fields.exists(
91-
_.name == "__delta_internal_row_index")
92-
) {
93-
return ValidationResult.failed(s"Deletion vector is not supported in native.")
94-
}
95-
96-
super.doValidateInternal()
97-
}
98-
9987
override def doCanonicalize(): DeltaScanTransformer = {
10088
DeltaScanTransformer(
10189
relation,

0 commit comments

Comments
 (0)