V1.4.13 by flarco · Pull Request #595 · slingdata-io/sling-cli

flarco · 2025-07-08T01:40:50Z

Key Features & Enhancements

Database & Connection Improvements

Iceberg Support: Enhanced Iceberg connection with AWS config and improved database handling
Glue Integration: Added support for iceberg_glue target and enhanced Glue connection capabilities
DuckDB Updates: Updated DuckDB version and added adjustCol flag for DuckDB and related types
Redshift Enhancement: Added Redshift parquet export functionality

API & Spec Management

API Spec Refactoring: Refactored API specs to use curly braces for variable interpolation
MCP Tools: Enhanced connection and API spec tools with detailed action support
Pagination Fixes: Updated stop_condition in pagination to use strict less than comparison

File System & Storage

S3 Enhancements:
- Enhanced S3 client with custom HTTP settings and retry logic
- Streamlined AWS credential handling by removing unnecessary components
File Management:
- Fixed local temporary file deletion after writing to prevent duplication
- Fixed single file copy operation to prevent filename duplication
- Added support for multiple Azure Storage files replication

Testing & Quality

Test Suite Expansion:
- Added new connection types for DuckLake variants
- Enhanced test cases with output verification
- Added encoding tests for latin1, windows1252, and utf8_bom
- Added transform functions test suite
- Added inspect hook tests for database tables and files
- Added MSSQL to parquet overwrite test
- Added timestamp string casting tests

Performance & Reliability

Streaming Improvements:
- Replaced error logging with LogError for better error handling
- Improved reader robustness and concurrency
Workflow Optimization:
- Increased timeout for build and release jobs (25 minutes)
- Enhanced streaming capabilities

Dependencies & Maintenance

Dependency Updates:
- Updated flarco/g dependency to v0.1.154
- Updated mark3labs/mcp-go to v0.33.0
Snowflake Fix: Fixed temporary file handling with SLING_KEEP_TEMP environment variable

…g in DuckDB. Fix for #588

…handling in DataflowToHttpStream

…plicate copies in WriteDataflowViaDuckDB

…eplication

… update suite.cli.yaml

fix(pipeline): improve error message formatting in step execution

…'connection' and 'object'

…ames

…n-expected results

…ection properties

…e logging

…ve sensitive data fix(database): rename glue_namespace to glue_warehouse for correct property retrieval chore(deps): update iceberg-go dependency to v0.0.0-20250705121323-8242bf566290

…; verify character preservation and garbled output feat(transform): implement encoding transformations for various character sets feat(config): add encoding options to source and target configurations fix(go.mod): update flarco/g dependency to v0.1.153

…mations

…gic; add S3ReaderWrapper for proper resource cleanup

… stability

…y jumps and adding support for anonymous credentials

- prevent dropping views for iceberg connections as they are not supported test(cli): refactor environment variable setup - move YEAR environment variable to dedicated env block for clarity

- use unbuffered channel for `nextRow` to improve backpressure - enhance error handling for channel closure and context cancellation - update `r.10.yaml` test case to reflect parquet reader changes - disable duckdb compute in test `r.10.yaml` for isolation

- bump duckdb version from 1.3.1 to 1.3.2

… set

… parameters and examples

feat(redshift): parquet export

…check

… comparison

flarco and others added 30 commits July 1, 2025 13:59

feat(tests): add new connection types for DuckLake variants in connMap

d3ebade

fix(workflow): increase timeout for release jobs to 25 minutes

0605390

feat(tests): add MSSQL to parquet overwrite test and improve streamin…

5d167a4

…g in DuckDB. Fix for #588

fix(streaming): replace error logging with LogError for better error …

9a2754d

…handling in DataflowToHttpStream

fix(filesys): delete local temporary file after writing to prevent du…

dfffafe

…plicate copies in WriteDataflowViaDuckDB

feat(tests): add new test for MSSQL to Azure Storage multiple files r…

beb67ab

…eplication

feat(tests): add test for timestamp string casting without quotes and…

0a7144b

… update suite.cli.yaml

feat(tests): add inspect hook tests for database tables and files

089afbf

fix(pipeline): improve error message formatting in step execution

refactor(inspect): update inspect steps to use 'location' instead of …

b26778a

…'connection' and 'object'

fix(copy): ensure single file copy operation does not duplicate filen…

b6f98a1

…ames

feat(tests): enhance test cases to include output verification for no…

36e378e

…n-expected results

feat(glue): add support for iceberg_glue target and enhance Glue conn…

aedfe72

…ection properties

feat(database): enhance Iceberg connection with AWS config and improv…

44787a1

…e logging

feat(tests): update stdout output verification in test suite and remo…

c6c3c6f

…ve sensitive data fix(database): rename glue_namespace to glue_warehouse for correct property retrieval chore(deps): update iceberg-go dependency to v0.0.0-20250705121323-8242bf566290

fix(go.mod): update flarco/g dependency to v0.1.154

89fa108

Implement code changes to enhance functionality and improve performance

65e3c28

Refactor API specs to use curly braces for variable interpolation

9683029

feat(tests): add transform functions test suite and validate transfor…

83ca99e

…mations

feat(fs_s3): enhance S3 client with custom HTTP settings and retry lo…

77a37ef

…gic; add S3ReaderWrapper for proper resource cleanup

fix(workflow): increase timeout for build and release jobs to improve…

999dd78

… stability

fix(fs_s3): streamline AWS credential handling by removing unnecessar…

fd8e689

…y jumps and adding support for anonymous credentials

fix TestAPIConnectionRender

ca18ff8

fix(iceberg): handle view drops for iceberg connections

824c029

- prevent dropping views for iceberg connections as they are not supported test(cli): refactor environment variable setup - move YEAR environment variable to dedicated env block for clarity

chore(duckdb): update duckdb version

80e24af

- bump duckdb version from 1.3.1 to 1.3.2

fix(snowflake): remove temporary files only if SLING_KEEP_TEMP is not…

7503fb9

… set

feature: redshift parquet export

bfb6738

fix(dependencies): update mark3labs/mcp-go to v0.33.0

6ccb174

fix(sling): add adjustCol flag for DuckDB and related types

e4b5702

flarco added 6 commits July 9, 2025 07:45

feat(mcp): enhance connection and API spec tools with detailed action…

0614b8d

… parameters and examples

Merge pull request #597 from matanper/feature/redshift-parquet-export

a0c4eea

feat(redshift): parquet export

fix(tests): add delimiter option to csv_full_refresh_delimiter test case

93877c5

fix(api): update stop_condition in pagination to include equal limit …

9ef5914

…check

fix(api): update stop_condition in pagination to use strict less than…

a882a54

… comparison

fix(api): update variable syntax in API spec from ${...} to {...}

51601be

flarco merged commit 91e4051 into main Jul 9, 2025
0 of 2 checks passed

flarco deleted the v1.4.13 branch July 9, 2025 14:57

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Uh oh!

V1.4.13#595

V1.4.13#595
flarco merged 36 commits into
mainfrom
v1.4.13

flarco commented Jul 8, 2025 •

edited

Loading

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Uh oh!

Uh oh!

Conversation

flarco commented Jul 8, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Key Features & Enhancements

Database & Connection Improvements

API & Spec Management

File System & Storage

Testing & Quality

Performance & Reliability

Dependencies & Maintenance

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

flarco commented Jul 8, 2025 •

edited

Loading