azure event bus resuse ServiceBusSender similar to azure event bus java

[salman-khandu]

I was trying to resuse ServiceBusSender for topic so that i can save time to ServiceBusSender instance but sometime i got weird error like

INFO:azure.servicebus._servicebus_sender:AMQP error occurred: (MessageSendFailed('Error condition: ErrorCondition.LinkMessageSizeExceeded\n Error Description: The received message (delivery-id:123456, size:286857 bytes) exceeds the limit (262144 bytes) currently allowed on the link. TrackingId:91b3c20e-31fd-42f9-9c4d-c5acf9baad9d_B11, SystemTracker:NoSystemTracker, Timestamp:2024-10-16T04:19:23')), condition: (<ErrorCondition.LinkMessageSizeExceeded: b'amqp:link:message-size-exceeded'>), description: (b'The received message (delivery-id:123456, size:286857 bytes) exceeds the limit (262144 bytes) currently allowed on the link. TrackingId:91b3c20e-31fd-42f9-9c4d-c5acf9baad9d_B11, SystemTracker:NoSystemTracker, Timestamp:2024-10-16T04:19:23').
ERROR:root:Error sending message for 16: The received message (delivery-id:123456, size:286857 bytes) exceeds the limit (262144 bytes) currently allowed on the link. TrackingId:91b3c20e-31fd-42f9-9c4d-c5acf9baad9d_B11, SystemTracker:NoSystemTracker, Timestamp:2024-10-16T04:19:23 Error condition: amqp:link:message-size-exceeded.
INFO:azure.servicebus._pyamqp.link:Link state changed: <LinkState.ATTACHED: 3> -> <LinkState.ERROR: 6>
INFO:root:Service Bus Sender Created for 17
INFO:root:Size of the string in KB: 152.15 KB
INFO:azure.servicebus._base_handler:AMQP error occurred: (AMQPLinkError("Error condition: amqp:decode-error\n Error Description: The format code '0x30' at frame buffer offset '35' is invalid or unexpected.")), condition: (b'amqp:decode-error'), description: (b"The format code '0x30' at frame buffer offset '35' is invalid or unexpected.").

Here is my code snippet

service_bus_sender = ServiceBusClient.from_connection_string(connectionstring, logging_enable=True).get_topic_sender(topic_name="topic_1", socket_timeout=60)
logging.info("Service Bus Client Created")
for i in range(100):
    try:
        time.sleep(10)
        logging.info("Service Bus Sender Created for %d", i)
        body = json.dumps(json_data)
        # Get the size of the string in bytes
        size_in_bytes = sys.getsizeof(body)

            # Convert bytes to kilobytes (KB)
        size_in_kb = size_in_bytes / 1024

        logging.info(f"Size of the string in KB: {size_in_kb:.2f} KB")
        subject = "test.Post.Created"

        # time.sleep(100)
        service_bus_sender.send_messages(
            ServiceBusMessage
            (body=body, subject=subject, content_type="application/json"))
        logging.info("Message Sent for %d successfully", i)
    except Exception as e:
            logging.error("Error sending message for %d: %s", i, str(e))
logging.info("End of Azure Event Bus")

Some messages are send successfully and some are wait or got above error not sure why it say size limit exceeded where i just send 152 kb data every time body is same i.e 152.kb. I also tried with java lib whether it's working fine and able to reuse ServiceBus sender bean.

Please suggest best way to use in optimal way so can take less time to send message

[github-actions]

Thank you for your feedback. Tagging and routing to the team member best able to assist.

[kashifkhan]

hi @salman-khandu, you should be able to use the sender class in the manner described and not have to recreate it for every send.

In the error log you have posted there are a few errors about message size exceeding the allowed limit. Even though the size of your message is 152 kb , there is some overhead with the message wrapper causing the message to go over that limit. To go around those you will have to upgrade your Service Bus level or reduce the size of the message to the limit described.

I would like to narrow down this problem a bit further

• Would you be able to share the message where the sender fails ?
• If you send that message just by itself does it work or it always fails. T
• Does that same message go over the java sdk properly ?

[github-actions]

Hi @salman-khandu. Thank you for opening this issue and giving us the opportunity to assist. To help our team better understand your issue and the details of your scenario please provide a response to the question asked above or the information requested above. This will help us more accurately address your issue.

[salman-khandu]

hi @salman-khandu, you should be able to use the sender class in the manner described and not have to recreate it for every send.

In the error log you have posted there are a few errors about message size exceeding the allowed limit. Even though the size of your message is 152 kb , there is some overhead with the message wrapper causing the message to go over that limit. To go around those you will have to upgrade your Service Bus level or reduce the size of the message to the limit described.

I would like to narrow down this problem a bit further

• Would you be able to share the message where the sender fails ?
• If you send that message just by itself does it work or it always fails. T
• Does that same message go over the java sdk properly ?

with java sdk everything working fine. size issue can be ignore but what i observed is sometime message send takes more time. see below logs which is just send message time ( with resuse sender class).

azure_event_bus_message_sender_service.py - INFO - Time taken to push message to azure event bus: 245.20 milliseconds
azure_event_bus_message_sender_service.py - INFO - Time taken to push message to azure event bus: 242.00 milliseconds
azure_event_bus_message_sender_service.py - INFO - Time taken to push message to azure event bus: 249.21 milliseconds
azure_event_bus_message_sender_service.py - INFO - Time taken to push message to azure event bus: 239.87 milliseconds
azure_event_bus_message_sender_service.py - INFO - Time taken to push message to azure event bus: 233.63 milliseconds
azure_event_bus_message_sender_service.py - INFO - Time taken to push message to azure event bus: 237.95 milliseconds
azure_event_bus_message_sender_service.py - INFO - Time taken to push message to azure event bus: 90871.70 milliseconds
azure_event_bus_message_sender_service.py - INFO - Time taken to push message to azure event bus: 185811.04 milliseconds
azure_event_bus_message_sender_service.py - INFO - Time taken to push message to azure event bus: 457.31 milliseconds
azure_event_bus_message_sender_service.py - INFO - Time taken to push message to azure event bus: 253.70 milliseconds
azure_event_bus_message_sender_service.py - INFO - Time taken to push message to azure event bus: 235.00 milliseconds

See some abnormal time like

azure_event_bus_message_sender_service.py - INFO - Time taken to push message to azure event bus: 90871.70 milliseconds
azure_event_bus_message_sender_service.py - INFO - Time taken to push message to azure event bus: 185811.04 milliseconds