[KYUUBI #7415] Add a configuration to include additional Spark keys as path validation targets

[LamiumAmplexicaule]

Why are the changes needed?

To add Spark configuration keys for path validation without rebuilding.
Close: #7415

How was this patch tested?

Unit tests.

$ ./build/mvn clean install -Dtest=none -DwildcardSuites=org.apache.kyuubi.engine.KyuubiApplicationManagerSuite

Was this patch authored or co-authored using generative AI tooling?

No.

[pan3793]

is this config allow the user to override with the session conf? or is it a server-side static config? - unfortunately, our codebase does not use a canonical name to distinguish serverConf, sessionConf, opConf, etc., and this has been causing confusion and bugs

[LamiumAmplexicaule]

Thank you for your question.

is this config allow the user to override with the session conf? or is it a server-side static config?

Since it must not be overwritten, I think it should be a static server-side config.
Also, the conf used in this PR is the KyuubiSessionManager config, so I consider it a server-side static config.

kyuubi/kyuubi-server/src/main/scala/org/apache/kyuubi/session/KyuubiSessionImpl.scala

Lines 99 to 104 in 8bed9de

	override def checkSessionAccessPathURIs(): Unit = {
	KyuubiApplicationManager.checkApplicationAccessPaths(
	sessionConf.get(ENGINE_TYPE),
	sessionConf.getAll,
	sessionManager.getConf)
	}

kyuubi/kyuubi-server/src/main/scala/org/apache/kyuubi/engine/KyuubiApplicationManager.scala

Lines 219 to 228 in 61fc167

	def checkApplicationAccessPaths(
	applicationType: String,
	appConf: Map[String, String],
	kyuubiConf: KyuubiConf): Unit = {
	applicationType.toUpperCase(Locale.ROOT) match {
	case appType if appType.contains("SPARK") => checkSparkAccessPaths(appConf, kyuubiConf)
	case appType if appType.startsWith("FLINK") => // TODO: check flink app access local paths
	case _ =>
	}
	}

[pan3793]

let's put it under kyuubi.server. namespace as it's a server-side static config.

Suggested change

	buildConf("kyuubi.session.spark.file.config.list")
	buildConf("kyuubi.server.spark.file.config.list")

[LamiumAmplexicaule]

I renamed the config to kyuubi.server.spark.file.config.list in 2f8450c.

[pan3793]

change the config namespace, otherwise lgtm

[aajisaka]

Merged the PR into master. Thank you @LamiumAmplexicaule @pan3793 !