Use base aws classes in amazon provider Operators/Sensors/Triggers

[Taragolis]

Body

Right now some inconsistency exists between different Operators/Sensors/Triggers which are use AwsBaseGeneric hook.
After #34784 and #34884 we could make all of them (except Transfer Operators) use same subset of generic attributes.

It might make more easier to end users use this objects (don't need to think is it region or region_name or is it even support this arguments), as well as make easier extend by new new hook parameters to all this operators in the one go.

General Approach for solve each case:

• Use AwsBaseOperator for operators, AwsBaseSensor for sensors. In some very specific case e.g. multi inheritance required to use AwsBaseHookMixin (see: AppflowRecordsShortCircuitOperator)
• Provide additional arguments to AwsBaseWaiterTrigger (if required)
• Wrap template_fields parameters
• Attach generic documentation into the service specific page into the Amazon Provider Documentation
• Validate that all parameters propagated to operator/sensor specific hook

All this steps already done for some of the operators, so it could be use as a reference

• Use base aws classes in Amazon AppFlow Operators (Use base aws classes in Amazon AppFlow Operators #35082)
  • operator(s)
• Use base aws classes in Amazon Athena Operators/Sensors/Triggers (Use base aws classes in Amazon Athena Operators/Sensors/Triggers #35133)
  • operator(s)
  • sensor(s)
  • trigger(s)
• Use base aws classes in AWS Batch Operators/Sensors/Triggers (Use base aws classes in AWS Batch Operators/Sensors/Triggers #35226)
  • operator(s) AWS Batch Operators/Sensors inherit AWS Base classes #49172
  • sensor(s) AWS Batch Operators/Sensors inherit AWS Base classes #49172
  • trigger(s)
• Use base aws classes in AWS CloudFormation Operators/Sensors Use base aws classes in AWS CloudFormation Operators/Sensors #36771
  • operator(s)
  • sensor(s)
• Use base aws classes in AWS Datasync Operators Use base aws classes in AWS Datasync Operators #36766
  • operator(s)
• Use base aws classes in AWS DMS Operators/Sensors Use base aws classes in AWS DMS Operators/Sensors #36772
  • operator(s)
  • sensor(s)
• Use base aws classes in Amazon DynamoDB Sensors Use base aws classes in Amazon DynamoDB Sensors #36770
  • sensor(s)
• Use base aws classes in Amazon EC2 Operators/Sensors/Triggers Updating EC2 Operators and Sensors with AWS Base classes #47931
  • operator(s)
  • sensor(s)
  • trigger(s)
• Use base aws classes in Amazon ECS Operators/Sensors/Triggers (Use base aws classes in Amazon ECS Operators/Sensors/Triggers #36393)
  • operator(s)
  • sensor(s)
  • trigger(s)
• Use base aws classes in Amazon EKS Operators/Sensors/Triggers Update EKS Operators and Sensors to inherit AWS base classes #48192
  • operator(s)
  • sensor(s)
  • trigger(s)
• Use base aws classes in Amazon EMR Operators/Sensors/Triggers Amazon EMR Sensors/Operators inherit AWS Base Classes #49486
  • operator(s)
  • sensor(s)
  • trigger(s)
• Use base aws classes in Amazon EventBridge Operators Use base aws classes in Amazon EventBridge Operators #36765
  • operator(s)
• Use base aws classes in AWS Glue Operators/Sensors/Triggers
  • operator(s) Update GlueJobOperator to inherit AWS base class #49750
  • sensor(s) Use base AWS classes in Glue Trigger / Sensor and implement custom waiter #52243
  • trigger(s) Use base AWS classes in Glue Trigger / Sensor and implement custom waiter #52243
• Use base aws classes in AWS Glue Data Catalog Sensors Use base aws classes in AWS Glue Data Catalog Sensors #40492
  • sensor(s)
• Use base aws classes in AWS Glue Crawlers Operators/Sensors/Triggers Use base aws classes in AWS Glue Crawlers Operators/Sensors/Triggers #40504
  • operator(s)
  • sensor(s)
  • trigger(s)
• Use base aws classes in AWS Glue DataBrew Operators/Triggers Use base aws classes in AWS Glue DataBrew Operators/Triggers #41848
  • operator(s)
  • trigger(s)
• Use base aws classes in AWS Lambda Operators/Sensors/Triggers (Use base classes for AWS Lambda Operators/Sensors #34890)
  • operator(s)
  • sensor(s)
  • trigger(s)
• Use base aws classes in Amazon QuickSight Operators/Sensors Use base aws classes in Amazon QuickSight Operators/Sensors #36776
  • operator(s)
  • sensor(s)
• Use base aws classes in Amazon RDS Operators/Sensors/Triggers Update Amazon RDS Operators and Sensors to inherit AWS Base classes #48872
  • operator(s)
  • sensor(s)
  • trigger(s)
• Use base aws classes in Amazon Redshift clusters Operators/Sensors/Triggers
  • operator(s) Update Redshift cluster operator and sensor to inherit AwsBaseOperator #51129
  • sensor(s) Update Redshift cluster operator and sensor to inherit AwsBaseOperator #51129
  • trigger(s)
• Use base aws classes in AWS Redshift Data API Operators Use base aws classes in AWS Redshift Data API Operators #36764
  • operator(s)
• Use base aws classes in Amazon S3 Operators/Sensors/Triggers Base AWS classes - S3 #47321
  • operator(s)
  • sensor(s)
  • trigger(s)
• Use base aws classes in Amazon S3 Glacier Operators/Sensors (Use base aws classes in Amazon S3 Glacier Operators/Sensors #35108)
  • operator(s)
  • sensor(s)
• Use base aws classes in Amazon SageMaker Operators/Sensors/Triggers
  • operator(s) Update Sagemaker Operators and Sensors to inherit Base AWS classes #50321
  • sensor(s) Update Sagemaker Operators and Sensors to inherit Base AWS classes #50321
  • trigger(s)
• Use base aws classes in Amazon SNS Operators Use base aws classes in Amazon SNS Operators #36615
  • operator(s)
• Use base aws classes in Amazon SQS Operators/Sensors/Triggers Use base aws classes in Amazon SQS Operators/Sensors/Triggers #36613
  • operator(s)
  • sensor(s)
  • trigger(s)
• Use base aws classes in AWS Step Functions Operators/Sensors/Triggers Use base aws classes in AWS Step Functions Operators/Sensors/Triggers #36468
  • operator(s)
  • sensor(s)
  • trigger(s)

Committer

• I acknowledge that I am a maintainer/committer of the Apache Airflow project.

[ferruzzi]

Thanks for getting this set up!