CSV file with DelimitedRowFilter filter with list of columns not working as expected

[polasanthoshkumar]

Hi team,

I’m using FilePulseSourceConnector with DelimitedRowFilter type. My source files don’t have any headers.

When I have the following configuration, everything is working fine with file pulse version 2.9.0.

"connector.class": "io.streamthoughts.kafka.connect.filepulse.source.FilePulseSourceConnector", "file.filter.regex.pattern": ".*\\.csv", "filters": "ParseDelimitedRow", "filters.ParseDelimitedRow.columns": "FirstName:STRING;lastFourPhoneNum:STRING;date:STRING;countryCode:STRING;availableBal:STRING", "filters.ParseDelimitedRow.separator": ",", "filters.ParseDelimitedRow.trimColumn": false, "filters.ParseDelimitedRow.type": "io.streamthoughts.kafka.connect.filepulse.filter.DelimitedRowFilter", "fs.listing.class": "io.streamthoughts.kafka.connect.filepulse.fs.AmazonS3FileSystemListing", "fs.listing.filters": "io.streamthoughts.kafka.connect.filepulse.fs.filter.RegexFileListFilter",

After I upgrade the version of file pulse connector with 2.13.0 then the mapping of the fields is not working as expected and is being misinterpreted for the fields defined FirstName:STRING;lastFourPhoneNum:STRING;date:STRING;countryCode:STRING;availableBal:STRING.
i.e.; value for FirstName field is being mapped with availableBal, so on.

Appreciate if this can be checked and fixed?

[polasanthoshkumar]

Hello, does anyone have any solution to this?

[polasanthoshkumar]

Hi Team,

Did anyone got time to look at this issue?