Fix jump to most recent logs and jump by default #54174
Description
Body
By default jump to the most recent logs. And also fix the 'jump' begin / end function. Jumping to the end while the logs are big will start scrolling slowly for a while instead of taking you directly to the end of logs.
For instance the following dag:
from datetime import datetime
from airflow.decorators import dag, task
@dag(
dag_id='log_generator',
description='Generate 40K log lines',
schedule=None,
start_date=datetime(2024, 1, 1),
catchup=False,
)
def log_generator_dag():
@task
def generate_40k_logs():
"""Generate 40K log lines"""
for i in range(40000):
print(f"Log line {i + 1}: This is a test log entry for performance testing")
generate_40k_logs()
log_generator_dag()
The UI toggle allows only 20k rows:
The only way to continue to see the rest of the logs is clicking twice on the down arrow. This will start to present the next log lines one by one which takes forever.
This is very important especially for sensors or KPO which tend to have many log lines of polling status of remote per interval/poke.
I know we can classify this as feature/improvement but from my perspective this is a bug. I don't think it was intentional to limit this capability.
Committer
- I acknowledge that I am a maintainer/committer of the Apache Airflow project.