Esti

Accelerate large files download using concurent chunks for lakectl do… #2

Sign in to view logs

Triggered via push February 12, 2025 11:29

master

Status Success

Total duration 5m 40s

Artifacts 3

esti.yaml

on: push

Check if secrets are available.

Generate code from latest lakeFS app

Build lakeFS HadoopFS

Prepare Spark Apps

Build and push rclone export Docker image

Build and push Docker image

Build metadata client for Spark 3.x

Test lakeFS rclone export functionality

Test lakeFS Hadoop FileSystem

Test lakeFS multipart upload with Hadoop S3A

Test metastore client commands using trino

Run latest lakeFS app on AWS S3 DynamoDB KV

Run latest lakeFS app on Google Cloud Platform and Google Cloud Storage

Run latest lakeFS app on Azure with Azure blobstore

Run latest lakeFS app on Azure with Azure Data Lake Storage Gen2 and CosmosDB

Test lakeFS against the python wrapper client

E2E - DynamoDB Local - Local Block Adapter

Run latest lakeFS app on AWS S3 + Basic Auth

Matrix: Run latest lakeFS app on AWS S3

Matrix: spark

Test lakeFS metadata client export with Spark 3.x

Test unified gc

Annotations

1 warning

Build lakeFS HadoopFS

Error: Path Validation Error: Path(s) specified in the action for caching do(es) not exist, hence no cache is being saved.

Artifacts

Produced during runtime

Name	Size	Digest
generated-code	27.5 MB	`sha256:0dba395bf862a4258dbd3c0ae19b297157d83eccd34cd301842fa134e4c31afc`
lakefs-hadoopfs	5.68 MB	`sha256:5f6dc951aa1742fe18a116139717fea711445c643a39501b12af76790ba79ef6`
spark-apps	313 KB	`sha256:5956f0ff201c4bcd168835e2ddf9d6f1797a0f3c9c1dbdabe32cb3005ae30fc2`