DCV-3505 use key-pair authentication in Airflow (#64)

* DCV-3505 use key-pair authentication in Airflow
* Change SC docs to show RSA Keys

Author: BAntonellini

docs/_sidebar.md

@@ -20,6 +20,7 @@
     - [Airflow - Accessing the Airflow API](/how-tos/airflow/use-airflow-api.md)
     - [Airflow - Sync Internal Airflow database](/how-tos/airflow/sync-database.md)
     - [Airflow - Trigger a DAG using Datasets](how-tos/airflow/api-triggered-dag.md)
+    - [Airflow - Use Key-Pair Authentication](how-tos/airflow/use-key-pair-authentication.md)
     - [DAGs - Add Dag Documentation](/how-tos/airflow/create-dag-level-docs.md)
     - [DAGs - Calling External Python Scripts](/how-tos/airflow/external-python-dag.md)
     - [DAGs - Dynamically Set Schedule](/how-tos/airflow/dynamically-set-schedule.md)

docs/how-tos/airflow/assets/airflow_admin_connections.png

@@ -0,0 +1,40 @@
+# Using Key-Pair Authentication in Airflow
+
+> [!NOTE] This documentation will presume you have knowledge of Datacoves' [Service Connections](/how-tos/datacoves/how_to_service_connections.md) and how to configure them.
+
+Using RSA Keys is only supported through Airflow Connections, not Environment Variables. Make sure your Datacoves Service Connection is using this `delivery mode`.
+
+![alt text](assets/delivery_mode_airflow_connection.png)
+
+Also, make sure to select `Authentication mechanism: RSA Key-pair` and [assign the generated key to your Snowflake user](https://docs.snowflake.com/en/user-guide/key-pair-auth#assign-the-public-key-to-a-snowflake-user).
+
+![authentication_mechanism_copy](assets/authentication_mechanism_copy.png)
+
+Once you have properly configured your Service Connection, your Airflow instance will restart. This process may take up to 10 minutes.
+
+To confirm the above worked correctly, you can access your Airflow `Admin -> Connections` menu, and make sure your Service Connection  is now an Airflow Connection.
+
+![airflow_admin_connections](assets/airflow_admin_connections.png)
+
+## Usage
+
+Thanks to our new [`dbt` Airflow Decorator](/reference/airflow/datacoves-decorators.md), you can run dbt against your warehouse using the Airflow Connection you just created, by simply passing the Service Connection name to our decorator's `connection_id` parameter.
+
+
+
+```python
+@dag(
+    [...]
+)
+def dbt_dag():
+
+    @task.datacoves_dbt(
+        connection_id="main_key_pair" # your service connection name
+    )
+    def run_dbt():
+        return "dbt debug" # return any dbt command
+
+    run_dbt()
+
+dbt_dag()
+```

docs/how-tos/airflow/assets/authentication_mechanism_copy.png

@@ -24,6 +24,8 @@ A Service Connection consists of the following fields:
 
 ![Service Connection Connection Details](./assets/serviceconnection_editnew_details.png)
 
+> [!NOTE] Snowflake is [deprecating single-factor password sign-ins](https://docs.snowflake.com/en/user-guide/security-mfa-rollout). For this reason, we encourage users to always use `RSA Key-pair` authentication mechanism for Service Connections.
+
 ## Getting Started Next Steps 
 In the following step, you will update your repository by incorporating the necessary folders and files for Airflow. Specifically, you will add the `orchestrate/dags` directories along with `automate/dbt/profiles.yml`.