Skip to content

Use shell and lakectl for Spark integration test setup #19961

Use shell and lakectl for Spark integration test setup

Use shell and lakectl for Spark integration test setup #19961

This workflow is awaiting approval from a maintainer in #10525
Triggered via pull request September 3, 2026 14:17
Status Action required
Total duration
Artifacts
This workflow is awaiting approval from a maintainer in #10525

esti.yaml

on: pull_request
Check if secrets are available.
Check if secrets are available.
Generate code from latest lakeFS app
Generate code from latest lakeFS app
paths-filter
paths-filter
Build lakeFS HadoopFS
Build lakeFS HadoopFS
Prepare Spark Apps
Prepare Spark Apps
login-to-amazon-ecr
login-to-amazon-ecr
Build and push Docker image
Build and push Docker image
Build and push rclone export Docker image
Build and push rclone export Docker image
Build metadata client
Build metadata client
Matrix: Run latest lakeFS app on AWS S3
Waiting for pending jobs
Test changes in SDK against the python wrapper
Test changes in SDK against the python wrapper
E2E - DynamoDB Local - Local Block Adapter
E2E - DynamoDB Local - Local Block Adapter
Quickstart
Quickstart
Run latest lakeFS app on AWS S3 + Basic Auth
Run latest lakeFS app on AWS S3 + Basic Auth
Run latest lakeFS app on AWS S3 DynamoDB KV
Run latest lakeFS app on AWS S3 DynamoDB KV
Run latest lakeFS app on Azure with Azure Data Lake Storage Gen2 and CosmosDB
Run latest lakeFS app on Azure with Azure Data Lake Storage Gen2 and CosmosDB
Run latest lakeFS app on Azure with Azure blobstore
Run latest lakeFS app on Azure with Azure blobstore
Run latest lakeFS app on Google Cloud Platform and Google Cloud Storage
Run latest lakeFS app on Google Cloud Platform and Google Cloud Storage
Test lakeFS Hadoop FileSystem
Test lakeFS Hadoop FileSystem
Test lakeFS against the python wrapper client
Test lakeFS against the python wrapper client
Test lakeFS multipart upload with Hadoop S3A
Test lakeFS multipart upload with Hadoop S3A
Matrix: spark
Waiting for pending jobs
Test lakeFS rclone export functionality
Test lakeFS rclone export functionality
Test lakeFS metadata client export with Spark 3.x
Test lakeFS metadata client export with Spark 3.x
Matrix: unified-gc-test
Waiting for pending jobs
Fit to window
Zoom out
Zoom in