Skip to content

Commit

Permalink
apache#42442 Make the AWS logging faster by reducing the amount of sleep
Browse files Browse the repository at this point in the history
Longer running tasks with lots of logs were slow to write all of the logs to AWS. This reduces the sleep delay to prevent the issue.
  • Loading branch information
smsm1-ito committed Sep 24, 2024
1 parent 9ec8753 commit 10098c6
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion airflow/providers/amazon/aws/utils/task_log_fetcher.py
Original file line number Diff line number Diff line change
Expand Up @@ -70,7 +70,7 @@ def run(self) -> None:
# timestamp)
# When a slight delay is added before logging the event, that solves the issue
# See https://github.com/apache/airflow/issues/40875
time.sleep(0.1)
time.sleep(0.001)
self.logger.info(self.event_to_str(log_event))
prev_timestamp_event = current_timestamp_event

Expand Down

0 comments on commit 10098c6

Please sign in to comment.