Open
Description
Is there an existing issue for this?
- I have searched the existing issues
Problem statement
We currently only provide format and input location.
This works fine for delta but other formats like csv may require additional options.
Proposed Solution
Extend config, profiler and utils to handle additional spark options when reading input data.
Additional Context
No response
Activity