Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add delimiter setting for SFTP and SFTP Bulk connectors #24696

Open
mbrummerstedt opened this issue Mar 30, 2023 · 2 comments
Open

Add delimiter setting for SFTP and SFTP Bulk connectors #24696

mbrummerstedt opened this issue Mar 30, 2023 · 2 comments

Comments

@mbrummerstedt
Copy link

Tell us about the problem you're trying to solve

The current version of the SFTP and SFTP Bulk connector only supports commas as the delimiter. If any other delimiters are used, the connector will fail.

Describe the solution you’d like

I expect you to add a setting for choosing a delimiter where I can choose between comma, tab, pipe, and semicolon.
The Setting should default to comma.

Describe the alternative you’ve considered or used

The options today are to change the csv files in the sftp server to use comma instead of other delimiters.

Additional context

No

Are you willing to submit a PR?

No, the connector is written in Java, and I am not familiar with Java.

@octavia-squidington-iii octavia-squidington-iii added autoteam team/tse Technical Support Engineers labels Mar 31, 2023
@archangelic archangelic added team/db-dw-sources Backlog for Database and Data Warehouse Sources team lang/python and removed team/tse Technical Support Engineers autoteam labels Mar 31, 2023
@archangelic
Copy link
Contributor

Thanks for the suggestion! I have added it to the team's backlog.

I see the SFTP bulk source is actually in python. Would you be willing to submit a PR for that source?

@nataliekwong
Copy link
Contributor

Issue was linked to Harvestr Discovery: Source SFTP: Support selection of delimiter

@rodireich rodireich added team/connectors-python and removed team/db-dw-sources Backlog for Database and Data Warehouse Sources team labels Jan 19, 2024
@girarda girarda added the Icebox label Jun 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

6 participants