Add microseconds to logging.LogRecord

[jamescasbon]

BPO	46292
Nosy	@vsajip, @jamescasbon
Files	usecs.patch

^{Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.}

Show more details

GitHub fields:

assignee = None
closed_at = None
created_at = <Date 2022-01-07.14:11:50.738>
labels = ['type-feature', 'library', '3.11']
title = 'Add microseconds to logging.LogRecord'
updated_at = <Date 2022-01-12.15:23:32.019>
user = 'https://github.com/jamescasbon'

bugs.python.org fields:

activity = <Date 2022-01-12.15:23:32.019>
actor = 'arwade'
assignee = 'none'
closed = False
closed_date = None
closer = None
components = ['Library (Lib)']
creation = <Date 2022-01-07.14:11:50.738>
creator = 'jamescasbon'
dependencies = []
files = ['50546']
hgrepos = []
issue_num = 46292
keywords = ['patch']
message_count = 2.0
messages = ['409963', '410011']
nosy_count = 3.0
nosy_names = ['vinay.sajip', 'arwade', 'jamescasbon']
pr_nums = []
priority = 'normal'
resolution = None
stage = None
status = 'open'
superseder = None
type = 'enhancement'
url = 'https://bugs.python.org/issue46292'
versions = ['Python 3.11']

[jamescasbon]

LogRecord makes microseconds available via the msecs attribute. This patch adds microseconds via usecs attribute.

Some regulators (eg MIFID II) require accuracy greater than 1ms in some industries.

This patch calls time_ns rather than time so that the usecs and msecs are calculated from int types and then gets the original ct attribute via division.

[vsajip]

Thanks for the patch. We're need to get contributors to sign a Contributor License Agreement (CLA) before we can accept their patches. Would you be willing to do this? The process could be smoother, but it's not too bad, and here's where you get started:

https://www.python.org/psf/contrib/contrib-form/

[askoretskiy]

Any progress here? That would be really helpful feature. Had to implement third-party Formatter class to solve this issue.

Maybe, core team could implement something similar? Or maybe even allow "%f" in the dateFormat?

import logging
from datetime import datetime

class CustomFormatter(logging.Formatter):
    def formatTime(self, record, datefmt=None):
        if not datefmt:
            return super().formatTime(record, datefmt=datefmt)

        return datetime.fromtimestamp(record.created).astimezone().strftime(datefmt)

[vsajip]

Patch partly superseded by #102412 and #120709. Will look into this shortly.

[askoretskiy]

Thanks for merging into Python 3.13.

How fix is shorter:

class CustomFormatter(logging.Formatter):
    # Workaround until https://github.com/python/cpython/issues/90450 is fixed
    def formatTime(self, record, datefmt=None):
        record.usecs = 100_000 * (record.created % 1)
        return super().formatTime(record, datefmt=datefmt)

And usage:

LOGGING = {
    ...,
    "formatters": {
        "verbose": {
            "format": "{asctime},{usecs:06.0f} {levelname:8} {name} {message}",
            "datefmt": "%Y-%m-%d %H:%M:%S",
            "style": "{",
            "class": "CustomFormatter",
        },
}