Skip to content

Fixes 32693: Encrypt and mask ingestion pipeline secrets - #33284

Open
IceS2 wants to merge 8 commits into
mainfrom
bugreport-config-encryption
Open

Fixes 32693: Encrypt and mask ingestion pipeline secrets#33284
IceS2 wants to merge 8 commits into
mainfrom
bugreport-config-encryption

Merge branch 'main' into bugreport-config-encryption

b5e7553
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
GitHub Actions / Integration Test Report (mysql-elasticsearch, parallel) failed Sep 15, 2026 in 0s

15583 tests run, 1481 skipped, 4 failed.

Published from workflow run: https://github.com/open-metadata/OpenMetadata/actions/runs/34951442125

Annotations

Check failure on line 88 in openmetadata-integration-tests/src/test/java/org/openmetadata/it/tests/IngestionPipelineSecretsIT.java

See this annotation in the file changed.

@github-actions github-actions / Integration Test Report (mysql-elasticsearch, parallel)

IngestionPipelineSecretsIT.rejectedConcurrentSaveCannotChangeCredentialsOrDeployment(boolean, TestNamespace)[1] 

Missing Airflow credentials. Ensure 'username' and 'password' are configured in pipelineServiceClientConfiguration.parameters. Follow [this guide](https://docs.open-metadata.org/deployment/ingestion/openmetadata) for further details.
Raw output 
org.openmetadata.sdk.exception.PipelineServiceClientException: Missing Airflow credentials. Ensure 'username' and 'password' are configured in pipelineServiceClientConfiguration.parameters. Follow [this guide](https://docs.open-metadata.org/deployment/ingestion/openmetadata) for further details.
	at org.openmetadata.service.clients.pipeline.airflow.AirflowRESTClient.<init>(AirflowRESTClient.java:91)
	at org.openmetadata.it.tests.IngestionPipelineSecretsIT$CapturingPipelineClient.<init>(IngestionPipelineSecretsIT.java:297)
	at org.openmetadata.it.tests.IngestionPipelineSecretsIT.setup(IngestionPipelineSecretsIT.java:88)
	at java.base/java.lang.reflect.Method.invoke(Method.java:580)
	at java.base/java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184)
	at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:197)
	at java.base/java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:179)
	at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:197)
	at java.base/java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184)
	at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:197)
	at java.base/java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184)
	at java.base/java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184)
	at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:197)
	at java.base/java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:1024)
	at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:509)
	at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499)
	at java.base/java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151)
	at java.base/java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174)
	at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
	at java.base/java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:596)
	at java.base/java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:276)
	at java.base/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1708)
	at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:509)
	at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499)
	at java.base/java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151)
	at java.base/java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174)
	at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
	at java.base/java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:596)
	at java.base/java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:276)
	at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:197)
	at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:197)
	at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:197)
	at java.base/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1708)
	at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:509)
	at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499)
	at java.base/java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151)
	at java.base/java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174)
	at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
	at java.base/java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:596)
	at java.base/java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:276)
	at java.base/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1708)
	at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:509)
	at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499)
	at java.base/java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151)
	at java.base/java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174)
	at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
	at java.base/java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:596)
	at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387)
	at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312)
	at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843)
	at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808)
	at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188)

Check failure on line 88 in openmetadata-integration-tests/src/test/java/org/openmetadata/it/tests/IngestionPipelineSecretsIT.java

See this annotation in the file changed.

@github-actions github-actions / Integration Test Report (mysql-elasticsearch, parallel)

IngestionPipelineSecretsIT.rejectedConcurrentSaveCannotChangeCredentialsOrDeployment(boolean, TestNamespace)[2] 

Missing Airflow credentials. Ensure 'username' and 'password' are configured in pipelineServiceClientConfiguration.parameters. Follow [this guide](https://docs.open-metadata.org/deployment/ingestion/openmetadata) for further details.
Raw output 
org.openmetadata.sdk.exception.PipelineServiceClientException: Missing Airflow credentials. Ensure 'username' and 'password' are configured in pipelineServiceClientConfiguration.parameters. Follow [this guide](https://docs.open-metadata.org/deployment/ingestion/openmetadata) for further details.
	at org.openmetadata.service.clients.pipeline.airflow.AirflowRESTClient.<init>(AirflowRESTClient.java:91)
	at org.openmetadata.it.tests.IngestionPipelineSecretsIT$CapturingPipelineClient.<init>(IngestionPipelineSecretsIT.java:297)
	at org.openmetadata.it.tests.IngestionPipelineSecretsIT.setup(IngestionPipelineSecretsIT.java:88)
	at java.base/java.lang.reflect.Method.invoke(Method.java:580)
	at java.base/java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184)
	at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:197)
	at java.base/java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:179)
	at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:197)
	at java.base/java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184)
	at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:197)
	at java.base/java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184)
	at java.base/java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184)
	at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:197)
	at java.base/java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:1024)
	at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:509)
	at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499)
	at java.base/java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151)
	at java.base/java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174)
	at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
	at java.base/java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:596)
	at java.base/java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:276)
	at java.base/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1708)
	at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:509)
	at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499)
	at java.base/java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151)
	at java.base/java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174)
	at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
	at java.base/java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:596)
	at java.base/java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:276)
	at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:197)
	at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:197)
	at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:197)
	at java.base/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1708)
	at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:509)
	at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499)
	at java.base/java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151)
	at java.base/java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174)
	at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
	at java.base/java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:596)
	at java.base/java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:276)
	at java.base/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1708)
	at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:509)
	at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499)
	at java.base/java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151)
	at java.base/java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174)
	at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
	at java.base/java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:596)
	at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387)
	at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312)
	at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843)
	at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808)
	at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188)

Check failure on line 88 in openmetadata-integration-tests/src/test/java/org/openmetadata/it/tests/IngestionPipelineSecretsIT.java

See this annotation in the file changed.

@github-actions github-actions / Integration Test Report (mysql-elasticsearch, parallel)

IngestionPipelineSecretsIT.consolidationDeploysOnlyRequestedChanges(TestNamespace) 

Missing Airflow credentials. Ensure 'username' and 'password' are configured in pipelineServiceClientConfiguration.parameters. Follow [this guide](https://docs.open-metadata.org/deployment/ingestion/openmetadata) for further details.
Raw output 
org.openmetadata.sdk.exception.PipelineServiceClientException: Missing Airflow credentials. Ensure 'username' and 'password' are configured in pipelineServiceClientConfiguration.parameters. Follow [this guide](https://docs.open-metadata.org/deployment/ingestion/openmetadata) for further details.
	at org.openmetadata.service.clients.pipeline.airflow.AirflowRESTClient.<init>(AirflowRESTClient.java:91)
	at org.openmetadata.it.tests.IngestionPipelineSecretsIT$CapturingPipelineClient.<init>(IngestionPipelineSecretsIT.java:297)
	at org.openmetadata.it.tests.IngestionPipelineSecretsIT.setup(IngestionPipelineSecretsIT.java:88)
	at java.base/java.lang.reflect.Method.invoke(Method.java:580)
	at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387)
	at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312)
	at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843)
	at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808)
	at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188)

Check failure on line 88 in openmetadata-integration-tests/src/test/java/org/openmetadata/it/tests/IngestionPipelineSecretsIT.java

See this annotation in the file changed.

@github-actions github-actions / Integration Test Report (mysql-elasticsearch, parallel)

IngestionPipelineSecretsIT.identicalDisplayNamesKeepManagedCredentialsSeparate(TestNamespace) 

Missing Airflow credentials. Ensure 'username' and 'password' are configured in pipelineServiceClientConfiguration.parameters. Follow [this guide](https://docs.open-metadata.org/deployment/ingestion/openmetadata) for further details.
Raw output 
org.openmetadata.sdk.exception.PipelineServiceClientException: Missing Airflow credentials. Ensure 'username' and 'password' are configured in pipelineServiceClientConfiguration.parameters. Follow [this guide](https://docs.open-metadata.org/deployment/ingestion/openmetadata) for further details.
	at org.openmetadata.service.clients.pipeline.airflow.AirflowRESTClient.<init>(AirflowRESTClient.java:91)
	at org.openmetadata.it.tests.IngestionPipelineSecretsIT$CapturingPipelineClient.<init>(IngestionPipelineSecretsIT.java:297)
	at org.openmetadata.it.tests.IngestionPipelineSecretsIT.setup(IngestionPipelineSecretsIT.java:88)
	at java.base/java.lang.reflect.Method.invoke(Method.java:580)
	at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:387)
	at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1312)
	at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1843)
	at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1808)
	at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:188)
View more details on GitHub Actions