Debug logs of tasks are not logged even when logging level is set to DEBUG

[deepak4babu]

Apache Airflow version

Other Airflow 2/3 version (please specify below)

If "Other Airflow 2/3 version" selected, which one?

3.0.6

What happened?

Debug logs of tasks are not logged even when AIRFLOW__LOGGING__LOGGING_LEVEL is set to DEBUG

What you think should happen instead?

Debug logs in tasks should also be printed in logs.

How to reproduce

Create a sampe dag with debug logs like below
Set AIRFLOW__LOGGING__LOGGING_LEVEL to Debug
Run the dag

from datetime import datetime
from airflow.sdk import task, dag
import logging
from time import sleep


log = logging.getLogger(__name__)


@dag(
    schedule="*/5 * * * *",
    start_date=datetime(2021, 1, 1),
    catchup=False,
)
def sample_debug_dag():
    @task()
    def sample_task1():
        for i in range(300):
            log.debug("Debug log", i)
            sleep(1)
        print("Test")

    sample_task1()

sample_debug_dag()

Operating System

PRETTY_NAME="Debian GNU/Linux 12 (bookworm)" NAME="Debian GNU/Linux" VERSION_ID="12" VERSION="12 (bookworm)" VERSION_CODENAME=bookworm ID=debian HOME_URL="https://www.debian.org/" SUPPORT_URL="https://www.debian.org/support" BUG_REPORT_URL="https://bugs.debian.org/"

Versions of Apache Airflow Providers

apache-airflow-providers-celery==3.12.2
apache-airflow-providers-cncf-kubernetes==10.7.0
apache-airflow-providers-common-compat==1.7.3
apache-airflow-providers-common-io==1.6.2
apache-airflow-providers-common-sql==1.27.5
apache-airflow-providers-fab==2.4.1
apache-airflow-providers-ftp==3.13.2
apache-airflow-providers-http==5.3.3
apache-airflow-providers-imap==3.9.2
apache-airflow-providers-postgres==6.2.3
apache-airflow-providers-smtp==2.2.0
apache-airflow-providers-sqlite==4.1.2
apache-airflow-providers-standard==1.6.0

Deployment

Other

Deployment details

We use a slightly modified version of official helm chart

Anything else?

No response

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[justinpakzad]

Hey, I would like to work on this issue.

I ran some tests with the example dag provided and when we have the logger set to the airflow task log:
log = logging.getLogger("airflow.task") the debug output works fine.

I did some digging and I found that in the configure_logging function, the root logger level is hard coded to INFO
config["root"] = { "handlers": ["default"], "level": "INFO", "propagate": True, }

Since the user defined loggers like the one in the example above inherits from the root, it wouldn't pick up the DEBUG level even if AIRFLOW__LOGGING__LOGGING_LEVEL=DEBUG is set.

Is that the expected behavior? If it's a bug then I think the fix would be to replace the hardcoded INFO value with log_level.upper(). Happy to open a PR if that's the case. Thanks.

[potiuk]

It is essentially duplicate of #59634 and it waits for @ashb @kaxil @amoghrajesh feedback on whether it was intentional behaviour - maybe there was a good reason for it

[justinpakzad]

Just circling back on this, I saw that the related/duplicate issue (#59634) was closed, but the root log level is still hard coded as INFO, meaning we still cant use use the DEBUG logs with a user defined logger, so this issue still persists. Based on the conversation in #59634, it seems like it shouldn't be hard coded but I wasn't entirely sure if that was the conclusion. Happy to open a PR to make that change if that's the case.

[amoghrajesh]

@justinpakzad feel free to open up a PR for discussion if the issue you intended isn't fixed. Reviewers will be happier to discuss on the PR