Problem

All our services log unstructured logs (in other words, they log sentences or blobs of text). This makes it difficult or unreliable to parse and query logs using, for example, Logs Insights, or any other tool that relies on structured logs (Loki, LogStash, etc).

Description

To make log querying easier, we can switch to things like django-structlog (for the API), JSON-log-formatter for the ingestion server (I couldn't find anything unique to Falcon) and Airflow, and a mature logging solution that supports structured logging in Node.

This milestone collects the issues to implement the above suggestions.

In all cases, for ease of reading in local development, we should add a switch to default to flat line style logs when ENVIRONMENT == "local".