Remove connection ID environment variables in favor of simply defining them #2294
Labels
🤖 aspect: dx
Concerns developers' experience with the codebase
🧰 goal: internal improvement
Improvement that benefits maintainers, not users
good first issue
New-contributor friendly
help wanted
Open to participation from the community
🟩 priority: low
Low priority and doesn't need to be rushed
🧱 stack: catalog
Related to the catalog and Airflow DAGs
🔧 tech: airflow
Involves Apache Airflow
Description
We currently have a pattern of defining the connection ID for an Airflow Connection via an environment variable (with a default) in addition to the environment variable for the connection itself. This creates two new configuration values for one connection ID. Below are all of the current examples:
openverse/catalog/dags/common/constants.py
Lines 32 to 36 in a5fb3ea
openverse/catalog/tests/dags/common/popularity/test_sql.py
Line 17 in a5fb3ea
openverse/catalog/tests/dags/common/loader/test_sql.py
Line 26 in a5fb3ea
openverse/catalog/tests/dags/common/test_sql.py
Line 16 in a5fb3ea
These values rarely change (if ever), and do not need to be configured via environment variable.
Instead, we should define these values outright as constants and remove the environment variables from the catalog's
env.template
file.The text was updated successfully, but these errors were encountered: