This doc. contains list of Spark UTs which are chosen not run with Gluten, because they checks for Spark specific behavior.
| Suites | Versions | Reason to exclude |
|---|---|---|
| org.apache.spark.sql.SingleLevelAggregateHashMapSuite org.apache.spark.sql.TwoLevelAggregateHashMapSuite org.apache.spark.sql.TwoLevelAggregateHashMapWithVectorizedMapSuite |
4.0, 4.1 | This UTs is similar to DataFrameAggregateSuite.The only difference being that it contains variation for Spark codegen enabled and disabled and enabling single level or two level aggregate hash-maps which is also specific to Spark Aggregate implementation. We already run GlutenDataFrameAggregateSuite for DataFrameAggregateSuite so these additional suites doesn't need to run |
| org.apache.spark.sql.sources.GlutenBucketedReadWithHiveSupportSuite org.apache.spark.sql.sources.GlutenBucketedWriteWithHiveSupportSuite org.apache.spark.sql.sources.GlutenDisableUnnecessaryBucketedScanWithHiveSupportSuite org.apache.spark.sql.sources.GlutenCommitFailureTestRelationSuite org.apache.spark.sql.sources.GlutenJsonHadoopFsRelationSuite org.apache.spark.sql.sources.GlutenParquetHadoopFsRelationSuite org.apache.spark.sql.sources.GlutenSimpleTextHadoopFsRelationSuite |
4.0, 4.1 | These suites extend TestHiveSingleton which provides a global HiveSession singleton. The TestHiveSingleton.spark (protected val) conflicts with Gluten test traits' spark (implicit protected def), making it impossible to load GlutenPlugin through any Gluten test trait. The non-Hive variants of these suites (e.g. GlutenBucketedReadWithoutHiveSupportSuite) are already enabled and cover the same functionality. |