[destination-s3] No more sync_id in filenames

[manuito]

Connector Name

S3 destination

Connector Version

1.0.4

What step the error happened?

During the sync

Relevant information

On airbyte cloud : The sync_id is not anymore present in the generated destination filename for a sync. Everything seems "as usual" but the file is created "without the sync_id", so we have just a file with the run nbr . For example _58 instead of 14235532_58
Our source is shopify
See also https://airbytehq.slack.com/archives/C021JANJ6TY/p1725177438711539

Relevant log output

No response

Contribute

• Yes, I want to contribute

[manuito]

Remark : we are using a jsonl format

[SebastienCY]

Hello,
This happens with a S3 destination configured with S3 Filename pattern = {sync_id}_{part_number}
And very curiously is observed on "random" connections using this destination (not all connections using this destination are impacted), but once a connection is impacted all subsequent sync run are impacted the same.

[SebastienCY]

Although destination is configured with S3 Filename pattern = {sync_id}_{part_number}, the detination log shows
StreamTransferManager(getMultiPartOutputStreams):329 Initiated multipart upload to airbyte-saas-splio-prod-airbyte-saas-xhw9s4/data_sync/xxxxx/shopify/orders/_1872

[guyarad]

@octavia-squidington-iii not sure what does the "community" label mean, but this happens in Airbyte Cloud as well

[edgao]

can I get a link to the cloud connection where this is happening? #44933 seems pretty unlikely to affect the filename, and I don't see an obvious upstream code change that would cause this

I also haven't been able to repro this in my own connection, which is a bit odd

[edgao]

this should be fixed now - there was an unrelated platform update that got rolled out to a subset of users. We rolled back that update, can you try again?

[manuito]

Thank you for your feedback. We will check starting tomorrow. We have already recreated most of our connections to avoid this condition so not sure if we can confirm it until few days