ISSUE: Problem decoding email message: Expected list, got <class 'str'>

[blockloop]

Describe the bug
None of my Amazon packages are properly parsed. With debug logging I get the same error for every message found in the search

Environment (please complete the following information):

• OS: HassOS
• Type of device: Proxmox
• Home Assistant version: latest
• Component version: latest

Logs

2024-11-21 22:57:37.802 DEBUG (SyncWorker_28) [custom_components.mail_and_packages.helpers] Amazon Subject: Your Amazon.com order of "***REDACTED FOR GITHUB***.." has shipped!
2024-11-21 22:57:37.802 DEBUG (SyncWorker_28) [custom_components.mail_and_packages.helpers] Problem decoding email message: Expected list, got <class 'str'>
2024-11-21 22:57:37.806 DEBUG (SyncWorker_28) [custom_components.mail_and_packages.helpers] Email Multipart: False
2024-11-21 22:57:37.806 DEBUG (SyncWorker_28) [custom_components.mail_and_packages.helpers] Content Type: text/html
2024-11-21 22:57:37.806 DEBUG (SyncWorker_28) [custom_components.mail_and_packages.helpers] Amazon Subject: Now arriving today: Your Amazon package will be delivered today.
2024-11-21 22:57:37.806 DEBUG (SyncWorker_28) [custom_components.mail_and_packages.helpers] Problem decoding email message: Expected list, got <class 'str'>
2024-11-21 22:57:37.806 DEBUG (SyncWorker_28) [custom_components.mail_and_packages.helpers] Amazon email search address: order-update@amazon.com
2024-11-21 22:57:37.806 DEBUG (SyncWorker_28) [custom_components.mail_and_packages.helpers] DEBUG subject: None

Additional Context

I also have USPS, UPS, and FedEx enabled and all of those work perfectly fine. This appears to be something specific to Amazon.

[firstof9]

Try replacing the helpers.py in custom_components/mail_and_packages with this file:

https://raw.githubusercontent.com/firstof9/Home-Assistant-Mail-And-Packages/refs/heads/fix-1015/custom_components/mail_and_packages/helpers.py

Then restart HA and see if the errors go away and it starts working correctly.

[blockloop]

2024-11-22 21:30:55.766 ERROR (MainThread) [homeassistant.components.sensor] Error adding entity sensor.mail_image_system_path for domain sensor with platform mail_and_packages
Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/helpers/entity_platform.py", line 599, in _async_add_entities
    await coro
  File "/usr/src/homeassistant/homeassistant/helpers/entity_platform.py", line 918, in _async_add_entity
    await entity.add_to_platform_finish()
  File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 1368, in add_to_platform_finish
    self.async_write_ha_state()
  File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 1007, in async_write_ha_state
    self._async_write_ha_state()
  File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 1132, in _async_write_ha_state
    self.__async_calculate_state()
  File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 1069, in __async_calculate_state
    state = self._stringify_state(available)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 1013, in _stringify_state
    if (state := self.state) is None:
                 ^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/components/sensor/__init__.py", line 544, in state
    value = self.native_value
            ^^^^^^^^^^^^^^^^^
  File "/config/custom_components/mail_and_packages/sensor.py", line 200, in native_value
    path = self._config.data[CONF_PATH]
           ~~~~~~~~~~~~~~~~~^^^^^^^^^^^
KeyError: 'image_path'
2024-11-22 21:30:55.775 ERROR (MainThread) [homeassistant.components.sensor] Error adding entity sensor.mail_image_url for domain sensor with platform mail_and_packages
Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/helpers/entity_platform.py", line 599, in _async_add_entities
    await coro
  File "/usr/src/homeassistant/homeassistant/helpers/entity_platform.py", line 918, in _async_add_entity
    await entity.add_to_platform_finish()
  File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 1368, in add_to_platform_finish
    self.async_write_ha_state()
  File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 1007, in async_write_ha_state
    self._async_write_ha_state()
  File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 1132, in _async_write_ha_state
    self.__async_calculate_state()
  File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 1069, in __async_calculate_state
    state = self._stringify_state(available)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 1013, in _stringify_state
    if (state := self.state) is None:
                 ^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/components/sensor/__init__.py", line 544, in state
    value = self.native_value
            ^^^^^^^^^^^^^^^^^
  File "/config/custom_components/mail_and_packages/sensor.py", line 200, in native_value
    path = self._config.data[CONF_PATH]
           ~~~~~~~~~~~~~~~~~^^^^^^^^^^^
KeyError: 'image_path'
2024-11-22 21:30:55.830 WARNING (MainThread) [homeassistant.components.automation] Error evaluating condition in 'Mail Delivery Notifications':
In 'condition':
  In 'or' (item 1 of 2):
    In 'template' condition: ValueError: Template error: int got invalid input 'unknown' when rendering template '{{ ((as_timestamp(now()) - as_timestamp(states.sensor.mail_usps_mail.last_changed)) < 15 and states('sensor.mail_usps_mail')|int > 0) }}' but no default was specified
  In 'or' (item 2 of 2):
    In 'template' condition: ValueError: Template error: int got invalid input 'unknown' when rendering template '{{ ((as_timestamp(now()) - as_timestamp(states.sensor.mail_packages_in_transit.last_changed)) < 15 and states('sensor.mail_packages_in_transit')|int > 0) }}' but no default was specified
2024-11-22 21:30:55.831 WARNING (MainThread) [homeassistant.components.automation] Error evaluating condition in 'Mail Delivery Notifications':
In 'condition':
  In 'or' (item 1 of 2):
    In 'template' condition: ValueError: Template error: int got invalid input 'unknown' when rendering template '{{ ((as_timestamp(now()) - as_timestamp(states.sensor.mail_usps_mail.last_changed)) < 15 and states('sensor.mail_usps_mail')|int > 0) }}' but no default was specified
  In 'or' (item 2 of 2):
    In 'template' condition: ValueError: Template error: int got invalid input 'unknown' when rendering template '{{ ((as_timestamp(now()) - as_timestamp(states.sensor.mail_packages_in_transit.last_changed)) < 15 and states('sensor.mail_packages_in_transit')|int > 0) }}' but no default was specified

Now it doesn't work at all and I get this log dump. Not sure if this is helpful.

[firstof9]

Install the latest beta, then drop in that helpers.py.

[blockloop]

The latest beta isn't working at all for me. Trying to connect to the server it fails to validate the SSL certificate even though I explicitly disabled checking:

2024-11-25 09:01:02.242 ERROR (MainThread) [custom_components.mail_and_packages.helpers] Error connecting into IMAP Server: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self-signed certificate (_ssl.c:1000)

[firstof9]

I pushed an updated version:

https://raw.githubusercontent.com/firstof9/Home-Assistant-Mail-And-Packages/refs/heads/fix-1015/custom_components/mail_and_packages/helpers.py

Please give it a try.

[blockloop]

Still got this:

2024-11-29 16:21:55.639 DEBUG (SyncWorker_54) [custom_components.mail_and_packages.helpers] Amazon emails found: 1
2024-11-29 16:21:55.646 DEBUG (SyncWorker_54) [custom_components.mail_and_packages.helpers] Email Multipart: False
2024-11-29 16:21:55.646 DEBUG (SyncWorker_54) [custom_components.mail_and_packages.helpers] Content Type: text/html
2024-11-29 16:21:55.646 DEBUG (SyncWorker_54) [custom_components.mail_and_packages.helpers] Amazon Subject: Your Amazon.com order #111-1111111-1111111 has shipped
2024-11-29 16:21:55.646 DEBUG (SyncWorker_54) [custom_components.mail_and_packages.helpers] Problem decoding email message: Expected list, got <class 'str'>
2024-11-29 16:21:55.646 DEBUG (SyncWorker_54) [custom_components.mail_and_packages.helpers] Amazon order: ['111-1111111-1111111']
2024-11-29 16:21:55.646 DEBUG (SyncWorker_54) [custom_components.mail_and_packages.helpers] Sensor: amazon_packages Count: 0
2024-11-29 16:21:55.646 DEBUG (SyncWorker_54) [custom_components.mail_and_packages.helpers] Attempting to find mail from (['donotreply_odd@dhl.com', 'NoReply.ODD@dhl.com', 'noreply@dhl.de', 'pl.no.reply@dhl.com', 'support@dhl.com']) with subject (DHL On Demand Delivery)

[firstof9]

I've pushed another commit for you to try out:

https://raw.githubusercontent.com/firstof9/Home-Assistant-Mail-And-Packages/refs/heads/fix-1015/custom_components/mail_and_packages/helpers.py

Thanks.

[blockloop]

Amazon Subject: Your Amazon.com order #111-1111111-1111111 has shipped
Problem decoding email message: Expected list, got <class 'str'>
Attempting alternative method.
Error updating sensor: amazon_packages reason: Expected list, got <class 'str'>

[blockloop]

Are you trying to parse the email as multipart? Can you use msg.is_multipart()? I believe the message is not multipart which might be causing the issue.

[firstof9]

It's supposed to be multipart that's the problem.