Add support for 'lumi.gateway.mieu01' subdevices

[javicalle]

The EU version of the gateway is supported in the current versión of the library and can be intergated in HA.

Some tests had been made to evaluate subdevices resolution with no success:

(venv)$ python /tmp/test_miio_gateway/gateway_devices.py
Traceback (most recent call last):
  File "/tmp/test_miio_gateway/gateway_devices.py", line 5, in <module>
    gateway.discover_devices()
  File "/opt/DevelopmentSpace/hassio/home-assistant/venv/lib/python3.7/site-packages/miio/gateway.py", line 168, in discover_devices
    devices_raw = self.get_prop("device_list")
  File "/opt/DevelopmentSpace/hassio/home-assistant/venv/lib/python3.7/site-packages/miio/gateway.py", line 207, in get_prop
    return self.send("get_device_prop", ["lumi.0", property])
  File "/opt/DevelopmentSpace/hassio/home-assistant/venv/lib/python3.7/site-packages/miio/device.py", line 147, in send
    command, parameters, retry_count, extra_parameters=extra_parameters
  File "/opt/DevelopmentSpace/hassio/home-assistant/venv/lib/python3.7/site-packages/miio/miioprotocol.py", line 203, in send
    self._handle_error(payload["error"])
  File "/opt/DevelopmentSpace/hassio/home-assistant/venv/lib/python3.7/site-packages/miio/miioprotocol.py", line 263, in _handle_error
    raise DeviceError(error)
miio.exceptions.DeviceError: {'code': -5005, 'message': 'params error'}

where gateway_devices.py:

from miio import Gateway

gateway = Gateway("192.168.1.IP", "tokentokentoken")

gateway.discover_devices()
devices = gateway.devices

for dev in devices:
    dev.update()
    print(dev)

@starkillerOG sugest (home-assistant/core#22078) a new approach with the get_device_list command.

[starkillerOG]

@javicalle alright lets see if we can get this working:

1. try testing this code as a start:

from miio import Gateway
gateway = Gateway("192.168.1.IP", "tokentokentoken")
print(gateway.info())

That will print basic information about your gateway and that will confirm that the communication is okay. (although since it works with the HomeAssistant integration this schould not be a problem)

2. open the gateway.py file of the miio library that schould be located in your virtuel python enviroment (in my case venv) at a path simular to: venv/lib/python3.7/site-packages/miio/gateway.py

3. scroll down to line 151 and add this function in between the def devices(self): and def discover_devices(self): functions (actually the postion where you add it does not matter that much):

    @property
    def test(self):
        return self.send("get_device_list")

4. now try running this test code:

from miio import Gateway
gateway = Gateway("192.168.1.IP", "tokentokentoken")
print(gateway.test())

Hopefully that will print a list of your subdevices..... fingers crossed....

[starkillerOG]

@javicalle actually now that I think of it, steps 2 till 4 can simply be replaced by running this test code:

from miio import Gateway
gateway = Gateway("192.168.1.IP", "tokentokentoken")
print(gateway.send("get_device_list"))

[javicalle]

Here are the results (some values have been obfuscated):

lumi.gateway.mieu01 v3.5.8_147 (AA:BB:CC:DD:EE:FF) @ 192.168.0.166 - token: 12345678901234567890123456789012

and the gateway.send("get_device_list") part:

Got error when receiving: timed out
Traceback (most recent call last):
  File "/opt/DevelopmentSpace/hassio/home-assistant/venv/lib/python3.7/site-packages/miio/miioprotocol.py", line 182, in send
    data, addr = s.recvfrom(1024)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/opt/DevelopmentSpace/hassio/home-assistant/venv/lib/python3.7/site-packages/miio/miioprotocol.py", line 182, in send
    data, addr = s.recvfrom(1024)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/opt/DevelopmentSpace/hassio/home-assistant/venv/lib/python3.7/site-packages/miio/miioprotocol.py", line 182, in send
    data, addr = s.recvfrom(1024)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/opt/DevelopmentSpace/hassio/home-assistant/venv/lib/python3.7/site-packages/miio/miioprotocol.py", line 182, in send
    data, addr = s.recvfrom(1024)
socket.timeout: timed out

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/tmp/test_miio_gateway/gateway_devices.py", line 8, in <module>
    print(gateway.send("get_device_list"))
  File "/opt/DevelopmentSpace/hassio/home-assistant/venv/lib/python3.7/site-packages/miio/device.py", line 147, in send
    command, parameters, retry_count, extra_parameters=extra_parameters
  File "/opt/DevelopmentSpace/hassio/home-assistant/venv/lib/python3.7/site-packages/miio/miioprotocol.py", line 226, in send
    extra_parameters=extra_parameters,
  File "/opt/DevelopmentSpace/hassio/home-assistant/venv/lib/python3.7/site-packages/miio/miioprotocol.py", line 226, in send
    extra_parameters=extra_parameters,
  File "/opt/DevelopmentSpace/hassio/home-assistant/venv/lib/python3.7/site-packages/miio/miioprotocol.py", line 226, in send
    extra_parameters=extra_parameters,
  File "/opt/DevelopmentSpace/hassio/home-assistant/venv/lib/python3.7/site-packages/miio/miioprotocol.py", line 230, in send
    raise DeviceException("No response from the device") from ex
miio.exceptions.DeviceException: No response from the device

[javicalle]

Also tested with same results:

gateway = Gateway("192.168.0.166", "12345678901234567890123456789012", lazy_discover=False, start_id=1000)

[starkillerOG]

Also tested with same results:

gateway = Gateway("192.168.0.166", "12345678901234567890123456789012", lazy_discover=False, start_id=1000)

That was indeed what I was going to sugest ;)

Well it does look like your gateway is recognizing the "get_device_list" command.
If I run the same command on my gateway.v3 I get a replay of:
miio.exceptions.DeviceError: {'code': -32601, 'message': 'Method not found.'}

Could you try running some random fake command like "test123" and see if you then also get the Method not found error, that would comfirm that your gateway recognizes the "get_device_list" command.

How many subdevices do you have connected to your gateway?
The timeout error seems to be very simular to the issue we are currently having with PR: #650

Unfortuanately I do not yet have an idea how to resolve that timeout issue....
Is your gateway updated to the latest firmware available?

[starkillerOG]

@rezmus do you have an idea where this timeout is comming from, is it indeed because too many devices are connected and the response message grows too big for the gateway?

Do you have any ideas how to resolve that?
(sorry for involving you, but you seem to know a lot about these gateways)

[rezmus]

lumi.gateway.miXXXX and lumi.gateway.aqhm0X do not provide a way to get subdevices list. you need to define them yourself.

[javicalle]

I get the same error.

Now the file content is:

from miio import Gateway

gateway = Gateway("192.168.0.166", "12345678901234567890123456789012", lazy_discover=False, start_id=1000)

print(gateway.info())
print('-----')

print(gateway.send("no_method"))

And there are 5 devices connected to gateway.

[starkillerOG]

@javicalle apperently you cannot obtain the device list on the 'lumi.gateway.mieu01' according to @rezmus which is quite a dissapointment...
We could at some point see if sniffing traffic using bluestack and wireshark provides us with some way to discover which devices are connected, but since @rezmus knows a lot about the firmware I guess there is no command.

Although I do find it strage that the gateway does not simply give the "method not found" as response to the "get_device_list" so maybe there is still some hope...

For now lets first test if the subdevices actually work the same way, otherwise it is going to be a big effort to get 'lumi.gateway.mieu01' support.

@javicalle do you know the sid and devicetype of your 5 connected subdevices?
For me I can see them In the MiHome app -->gateway--> ... --> About --> Hub info (the same place where I can find the gateway token).

If so you can try:

from miio import gateway

hub = gateway.Gateway("192.168.0.166", "12345678901234567890123456789012", lazy_discover=False, start_id=1000)


sid = "lumi.SidSidSidSid"
device_type = 19
subdevice_cls = gateway.AqaraHT


dev_info = gateway.SubDeviceInfo(sid, device_type, 1, 1, 3)
dev = subdevice_cls(hub, dev_info)

dev.update()
print(dev)

where sid is the sid of the subdevice
dev_type is the number representing the subdevice type (can be looked up from the model in the gateway.py file in the list on lines 39 to 90 class DeviceType(IntEnum):)
and the subdevice class can also be found in this same list, in the example I used the AqaraHT temperature sensor (lumi.weather.v1)

[javicalle]

I only have 3 different types of devices:

• Mi Window and Door sensor
• Mi Motion Sensor
• Mi Wireless Switch

My "Xiaomi Home" app don't have this option (no 'About' option available), and I have get the device info from others sources.

• modified "Xiaomi Home" app from 'vevs': https://www.kapiba.ru/2017/11/mi-home.html
• HA zha integration: I have a sensor integrated through a ZHA bridge and not from the Xiaomi Hub

The modified app gives to me this info:

Did:		lumi.158d000396cb70
Name:		Mi Window and Door Sensor
Model:		lumi.sensor_magnet.v2

Did:		lumi.158d0003a40c79
Name:		Mi Motion Sensor 2
Model:		lumi.sensor_motion.v2

Did:		lumi.158d0003a476f6
Name:		Mi Wireless Switch
Model:		lumi.sensor_switch.v2

If my interpretation is correct, it does not fit with any of the currently implemented models.

Anyway, I have tested the 2 available implementations with the motion sensor:

• Motion = 2 # lumi.sensor_motion
• AqaraMotion = 52 # lumi.sensor_motion.aq2

(I had to overwrite my venv's gateway class with the last one from the repository)

In both cases I have had the same error:

(venv)$ python /tmp/test_miio_gateway/gateway_subdevices.py
lumi.gateway.mieu01 v3.5.8_147 (AA:BB:CC:DD:EE:FF) @ 192.168.0.166 - token: 12345678901234567890123456789012
-----
Got error when receiving: timed out
Traceback (most recent call last):
  File "/opt/DevelopmentSpace/hassio/home-assistant/venv/lib/python3.7/site-packages/miio/miioprotocol.py", line 182, in send
    data, addr = s.recvfrom(1024)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/opt/DevelopmentSpace/hassio/home-assistant/venv/lib/python3.7/site-packages/miio/miioprotocol.py", line 182, in send
    data, addr = s.recvfrom(1024)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/opt/DevelopmentSpace/hassio/home-assistant/venv/lib/python3.7/site-packages/miio/miioprotocol.py", line 182, in send
    data, addr = s.recvfrom(1024)
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/opt/DevelopmentSpace/hassio/home-assistant/venv/lib/python3.7/site-packages/miio/miioprotocol.py", line 182, in send
    data, addr = s.recvfrom(1024)
socket.timeout: timed out

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/opt/DevelopmentSpace/hassio/home-assistant/venv/lib/python3.7/site-packages/miio/gateway.py", line 777, in send
    return self._gw.send(command, [self.sid])
  File "/opt/DevelopmentSpace/hassio/home-assistant/venv/lib/python3.7/site-packages/miio/device.py", line 147, in send
    command, parameters, retry_count, extra_parameters=extra_parameters
  File "/opt/DevelopmentSpace/hassio/home-assistant/venv/lib/python3.7/site-packages/miio/miioprotocol.py", line 226, in send
    extra_parameters=extra_parameters,
  File "/opt/DevelopmentSpace/hassio/home-assistant/venv/lib/python3.7/site-packages/miio/miioprotocol.py", line 226, in send
    extra_parameters=extra_parameters,
  File "/opt/DevelopmentSpace/hassio/home-assistant/venv/lib/python3.7/site-packages/miio/miioprotocol.py", line 226, in send
    extra_parameters=extra_parameters,
  File "/opt/DevelopmentSpace/hassio/home-assistant/venv/lib/python3.7/site-packages/miio/miioprotocol.py", line 230, in send
    raise DeviceException("No response from the device") from ex
miio.exceptions.DeviceException: No response from the device

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/tmp/test_miio_gateway/gateway_subdevices.py", line 20, in <module>
    print(dev)
  File "/opt/DevelopmentSpace/hassio/home-assistant/venv/lib/python3.7/site-packages/miio/gateway.py", line 725, in __repr__
    self.get_battery(),
  File "/opt/DevelopmentSpace/hassio/home-assistant/venv/lib/python3.7/site-packages/miio/gateway.py", line 850, in get_battery
    self._battery = self.send("get_battery").pop()
  File "/opt/DevelopmentSpace/hassio/home-assistant/venv/lib/python3.7/site-packages/miio/gateway.py", line 781, in send
    ) from ex
miio.gateway.GatewayException: Got an exception while sending command get_battery

I continue doing some tests

[javicalle]

I have modified my gateway.py this way:

class DeviceType(IntEnum):
    """DeviceType matching using the values provided by Xiaomi."""

    Unknown = -1
    Gateway = 0  # lumi.0
    Switch = 1  # lumi.sensor_switch
    Motion = 2  # lumi.sensor_motion
    MotionV2 = 222 # lumi.sensor_motion.v2 for testing purposes
    .../...

    @command()
    def discover_devices(self):
        """
        Discovers SubDevices
        and returns a list of the discovered devices.
        """
        # from https://github.com/aholstenson/miio/issues/26
        device_type_mapping = {
            DeviceType.Switch: Switch,
            DeviceType.Motion: Motion,
            DeviceType.MotionV2: MotionV2, # probably not necessary

class MotionV2(SubDevice):
    """Subdevice Motion specific properties and methods."""

    properties = []
    _zigbee_model = "lumi.sensor_motion.v2"
    _model = "RTCGQ01LM"
    _name = "Motion sensor v2"

The _model value is written on the physical device, so I'm sure it's correct.

Now, my test class is the next one:

from miio import gateway

hub = gateway.Gateway("192.168.0.166", "12345678901234567890123456789012", lazy_discover=False, start_id=1000)

print(hub.info())
print('-----')

sid = "lumi.158d0003a40c79"
device_type = 222
subdevice_cls = gateway.MotionV2

dev_info = gateway.SubDeviceInfo(sid, device_type, 1, 1, 3)
dev = subdevice_cls(hub, dev_info)

dev.update()
print(dev)
print('+++++')

With these changes I get exactly the same error.

[rezmus]

get_battery method is not supported by these hubs.

[javicalle]

I just commented the print(dev) commands and no errors are generated.
But I can't find a send or get_property to validate it's really working against device.