Skip to content

write_deltalake with rust engine fails when mode is append and overwrite schema is enabled #2553

Closed
@rtyler

Description

@rtyler

Environment

Delta-rs version: current

Binding: python


Bug

What happened:

When switching a Python writer to use the Rust engine (while testing #2486) I've discovered that the Rust engine doesn't errors on the following code only for the Rust engine:

@pytest.mark.parametrize("engine", ["pyarrow", "rust"])
def test_roundtrip_with_overwrite_schema(
    tmp_path: pathlib.Path, sample_data: pa.Table, engine: Literal["pyarrow", "rust"]
):
    write_deltalake(tmp_path, sample_data, mode='append', overwrite_schema=True, engine=engine)

Fails with:

_internal.DeltaError: Generic DeltaTable error: Schema overwrite not supported for Append

What you expected to happen:

I would expect the engine change to be seamless

More details:

🤕

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

binding/pythonIssues for the Python packagebugSomething isn't working

Type

No type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions