Add transfer operator S3 to (generic) SQL#29085

Merged

o-nikolas merged 23 commits intoapache:mainfrom

maggesssss:feat_s3_to_sql_transfer_NEW

Jan 23, 2023

Commits on Jan 23, 2023

Released new S3 to SQL Transfer Operator Including Documentation and Tests

root
authored and
potiuk
committed
added missing sql_conn_id parameter to example DAG to make it more clear and explicit

root
authored and
potiuk
committed
fixed non-unique task_ids and operator variable names in S3 to Sql example DAG

root
authored and
potiuk
committed
Added parser

maggesssss
authored and
potiuk
committed
WIP: migrated example DAG to system tests

maggesssss
authored and
potiuk
committed
removed example DAG (migrated to system tests)

maggesssss
authored and
potiuk
committed
Update airflow/providers/amazon/aws/transfers/s3_to_sql.py

authored and
potiuk
committed
Update airflow/providers/amazon/aws/transfers/s3_to_sql.py

authored and
potiuk
committed
changed internal method _get_hook

maggesssss
authored and
potiuk
committed
removed unused imports

maggesssss
authored and
potiuk
committed
changed conn type from s3 to aws

maggesssss
authored and
potiuk
committed
added sql_default conn_id

maggesssss
authored and
potiuk
committed
added seek(0) to tempfile after it was

maggesssss
authored and
potiuk
committed
converted sample_data to raw

maggesssss
authored and
potiuk
committed
added test for bad hook

maggesssss
authored and
potiuk
committed
added provider.yaml entry for new Operator

maggesssss
authored and
potiuk
committed
added explicit local_tempfile.flush()

maggesssss
authored and
potiuk
committed
sorted imports

maggesssss
authored and
potiuk
committed
sorted imports

maggesssss
authored and
potiuk
committed
added type hint to function db_hook and

maggesssss
authored and
potiuk
committed
fixed formatting

maggesssss
authored and
potiuk
committed
add #noqa: E402

maggesssss
authored and
potiuk
committed
removed DbApiHook type hint and modified test to patch

maggesssss
authored and
potiuk
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add transfer operator S3 to (generic) SQL#29085

Add transfer operator S3 to (generic) SQL#29085
o-nikolas merged 23 commits intoapache:mainfrom
maggesssss:feat_s3_to_sql_transfer_NEW

Commits on Jan 23, 2023

Released new S3 to SQL Transfer Operator Including Documentation and Tests

added missing sql_conn_id parameter to example DAG to make it more clear and explicit

fixed non-unique task_ids and operator variable names in S3 to Sql example DAG

Added parser

WIP: migrated example DAG to system tests

removed example DAG (migrated to system tests)

Update airflow/providers/amazon/aws/transfers/s3_to_sql.py

Update airflow/providers/amazon/aws/transfers/s3_to_sql.py

changed internal method _get_hook

removed unused imports

changed conn type from s3 to aws

added sql_default conn_id

added seek(0) to tempfile after it was

converted sample_data to raw

added test for bad hook

added provider.yaml entry for new Operator

added explicit local_tempfile.flush()

sorted imports

sorted imports

added type hint to function db_hook and

fixed formatting

add #noqa: E402

removed DbApiHook type hint and modified test to patch