Arduino libraries not found

[bernch1nv]

I'm trying to use Arduino based libraries within the light example.
I followed the install guide here: https://docs.espressif.com/projects/arduino-esp32/en/latest/esp-idf_component.html , but installed the library globally under /esp-idf/components, and it seems to work as I can compile the sample_project in esp-idf/examples/get-started folder.

My project is located in esp-matter/examples, and when I try to include Arduino.h it says "fatal error: Arduino.h: No such file or directory"

I also set "CONFIG_FREERTOS_HZ" in sdkconfig to 1000 (as required by arduino-esp32)
I can find the Arduino Component now under menuconfig (and also tried ticking the box within compatibility options to "Include headers across components as before IDF v4.0" -> made no difference)

Still getting the error that Arduino.h can't be found.

Using ESP-IDF: v4.4.2

Any ideas how Arduino can be correctly added to an esp-matter project?

[sanketwadekar]

Hi @bernch1nv,
I tried the steps you mentioned above and was able to compile the example given here by creating a sample project in esp-matter/examples.
Using IDF Branch: release/v4.4

Is there any other library that you are using with Arduino ?

[bernch1nv]

Hi @sanketwadekar ,
all I'm using is a copy of the light example of esp-matter, where I so far only added #include <Arduino.h> in app_main.cpp . This already causes the error.
Strangely while the idf.py build command is running, it does print that its building some objects which are Arduino-related.
I also did not change anything in the menuconfig regarding the use of setup & loop functions etc., just the include of Arduino.h in app_main.cpp.

[sanketwadekar]

@SuGlider maybe you can provide some help.

[SuGlider]

@bernch1nv -

I followed the install guide here: https://docs.espressif.com/projects/arduino-esp32/en/latest/esp-idf_component.html , but installed the library globally under /esp-idf/components, and it seems to work as I can compile the sample_project in esp-idf/examples/get-started folder.

The libraries shall not go under /esp-idf/components.
An example of folder strucuture is https://github.com/SuGlider/RainMaker_as_Arduino_Component
It is a RainMaker Arduino Project as IDF component.

You should clone Matter in the /yourProject/components
Then you shall add its components to the CMakeList.txt of the project:

# The following lines of boilerplate have to be in your project's
# CMakeLists in this exact order for cmake to work correctly
cmake_minimum_required(VERSION 3.5)

set(EXTRA_COMPONENT_DIRS components/esp-matter/components)

include($ENV{IDF_PATH}/tools/cmake/project.cmake)
project(arduino_matter_test)

[SuGlider]

I was reading the code from https://github.com/espressif/esp-matter/blob/main/examples/light/main/app_main.cpp and it does have already an app_main() function.

Is that code that you want to use and add to it some Arduino API calls?

[bernch1nv]

My goal is to have the device operating (based on a hw-switch) in either Wifi AP-mode for configuration purposes, or in matter-"mode". As I have the AP-mode part already written using libraries like ESPAsyncWebserver, AsyncTCP etc. which are based on arduino-esp32 I somehow need the Arduino.h file in there

[SuGlider]

How is the project structured in the folders?
Is Arduino cloned to the /components folder of your project?

[RoCorbera]

Matter has its own commissioning methods.
WiFi credentials shall be passed to the Matter device using the BLE commissioning secure protocol.

@bernch1nv - What is AP-mode used for in your project?
Matter devices will use WiFi for IPv6 communications over the Matter network.

[bernch1nv]

When I opened this issue, as described I installed arduino globally under {$home}/esp-idf/components (with the intention to being able to use it by multiple projects)
esp-matter was installed under {$home}/esp-matter (so everything should be like the development guide says)
Project was located under {$home}/esp-matter/examples/my_project (which was just a copy of the light example)
This is where i tried to include Arduino.h in my_project/main/app_main.cpp and got that error.

Right now I just removed my existing esp-matter installation, and moved my project to {$home}/esp-projects/my_project

There I now cloned the esp-matter repo into my_project/components/esp-matter, as suggested by @SuGlider
And also cloned arduino in there.

I did not adapt the CMakeLists.txt file though, because i think the current set EXTRA_COMPONENTS_DIRS looks fine for me, as it uses the ESP_MATTER_PATH variable.

With this setup, I now get the Error "Failed to resolve component 'app_reset'", because esp-matter does not contain a CMakeLists.txt file

@RoCorbera AP-mode is hosting a webapp for configuration purposes, for variables that cannot be known in production yet.
But like I said, I want to make it either operating in AP-mode OR matter-mode. The only thing the both modes share would be some variables in NVS.

[SuGlider]

With this setup, I now get the Error "Failed to resolve component 'app_reset'", because esp-matter does not contain a CMakeLists.txt file

app_reset is in Examples/Common, not as a component.
https://github.com/espressif/esp-matter/tree/5ff7d0d7fa9e93d248b557f0c4eee2a7df5410d8/examples/common/app_reset

In the other Matter examples, the CMakeLists.txt adds the common folder to the sources and includes.
https://github.com/espressif/esp-matter/blob/5ff7d0d7fa9e93d248b557f0c4eee2a7df5410d8/examples/light_switch/CMakeLists.txt

You may need to add this folder to your project and fix your project's CMakeLists.txt to add it.

[SuGlider]

@bernch1nv - I've built the esp-matter/examples/light example with an extra line #include <Arduino.h> as requested.

In order to get it done, I followed these steps:

• clone https://github.com/espressif/esp-idf.git in ~/esp-idf

• run git checkout v4.4.2 on esp-idf

• run git submodule update --init on esp-idf

• run esp-idf/install.sh and esp-idf/export.sh

• check idf version with idf.py --version - it shall display v4.4.2

• clone https://github.com/espressif/esp-matter.git in a separated folder like ~/esp-matter

• run esp-matter/install.sh and esp-matter/export.sh

• go to esp-matter/components and git clone --recursive https://github.com/espressif/arduino-esp32.git arduino there

• go to esp-matter/components/arduino and edit CMakeLists.txt on line 227 to remove -DESP32 at https://github.com/espressif/arduino-esp32/blob/master/CMakeLists.txt#L227

• go to esp-matter/examples/light/main and edit CMakeLists.txt to include arduino to the PRIV_REQUIRES_LIST
  https://github.com/espressif/esp-matter/blob/main/examples/light/main/CMakeLists.txt#L1
  set(PRIV_REQUIRES_LIST arduino device esp_matter esp_matter_console route_hook app_reset)

• in esp-matter/examples/light/ edit sdkconfig.defaults to change CONFIG_FREERTOS_HZ=100 to 1000
  remove sdkconfig if it was already created by idf.py build in the past.
  edit sdkconfig.defaults to add these lines at the end of the file:

# Fixes Tick in Arduino
CONFIG_FREERTOS_HZ=1000

• go to esp-matter/examples/light and run idf.py build to check and verify that it builds correctly
• add #include <Arduino.h> to line 19 of esp-matter/examples/light/main/app_main.cpp at https://github.com/espressif/esp-matter/blob/main/examples/light/main/app_main.cpp#L19
• in esp-matter/examples/light run idf.py build again.
• There will be an error of Conflict with INADDR_NONE

To fix this error there are a couple possibilitites:

1. Change the name of INADDR_NONE variable from esp-matter/components/arduino/cores/esp32 and in the WiFi Library (esp-matter/components/arduino/libraries/WiFi/src)
   https://github.com/espressif/arduino-esp32/blob/master/cores/esp32/IPAddress.cpp#L125
   https://github.com/espressif/arduino-esp32/blob/master/cores/esp32/IPAddress.h#L95
   https://github.com/espressif/arduino-esp32/blob/master/libraries/WiFi/src/WiFiAP.cpp#L50
   https://github.com/espressif/arduino-esp32/blob/master/libraries/WiFi/src/WiFiSTA.cpp#L54
   https://github.com/espressif/arduino-esp32/blob/master/libraries/WiFi/src/WiFiGeneric.cpp#L86

2. OR Change the esp-matter file esp-matter/connectedhomeip/connectedhomeip/src/inet/IPAddress.h
   https://github.com/espressif/connectedhomeip/blob/87bee4de25886ba00f1a177cd0f8791a48528a1f/src/inet/IPAddress.h#L51
   it shouldn't include lwip/inet.h and instead just define two symbols that will be enough to compile it.
   Change the line 51 of esp-matter/connectedhomeip/connectedhomeip/src/inet/IPAddress.h to:

//#include <lwip/inet.h>
#define INET6_ADDRSTRLEN  46
#define INET_ADDRSTRLEN   16

Finally, just run idf.py build in the esp-matter/examples/light example and it will get it done fine.

[SuGlider]

@bernch1nv

/home/chbe/esp-idf/components/arduino-esp32/cores/esp32/esp32-hal-cpu.c:47:16: note: in expansion of macro 'MHZ'
const uint32_t MHZ = 1000000;

It seems that the folders are not setup as I instructed.
You have Arduino cloned in the IDF folder instead.
Please delete the whole esp-idf/components/arduino-esp32/ from your IDF envionment.

You should have something like this:

 /myProj
     |
     +-- esp-idf-v4.4.2/                  ==> cloned from esp-idf.git + checkout v4.4.2 + install.sh + export.sh
     |
     +-- esp-matter/                      ==> cloned from esp-matter.git
     +-- esp-matter/components/arduino    ==> cloned from arduino-esp32.git and modified as instructed
     +-- esp-matter/examples/light        ==> add "Arduino.h" and necessary sdkconfig/CMakeLisit.txt changes

[SuGlider]

@bernch1nv - Please let me know if this issue is solved. Thanks,

[bernch1nv]

So the first time I tried this I didn't remove arduino under esp-idf/components, you're right.
Now the build runs as described when including Arduino.h, thanks for that!

However now I just tried to establish a wifi in AP mode, to see if this is really working:

const char* ssid = "examplewifissid";
const char* password = "tenonezero";
WiFi.mode(WIFI_AP);                //Configure Access Point mode
WiFi.softAP(ssid, password);    //Password length minimum 8 char

But I get this error:

/home/chbe/.espressif/tools/xtensa-esp32-elf/esp-2021r2-patch3-8.4.0/xtensa-esp32-elf/bin/../lib/gcc/xtensa-esp32-elf/8.4.0/../../../../xtensa-esp32-elf/bin/ld: esp-idf/arduino/libarduino.a(WiFiGeneric.cpp.obj):(.literal._Z16wifiLowLevelInitb+0x24): undefined reference to `esp_netif_create_default_wifi_ap'
/home/chbe/.espressif/tools/xtensa-esp32-elf/esp-2021r2-patch3-8.4.0/xtensa-esp32-elf/bin/../lib/gcc/xtensa-esp32-elf/8.4.0/../../../../xtensa-esp32-elf/bin/ld: esp-idf/arduino/libarduino.a(WiFiGeneric.cpp.obj): in function `wifiLowLevelInit(bool)':
/home/chbe/esp-matter/components/arduino/libraries/WiFi/src/WiFiGeneric.cpp:624: undefined reference to `esp_netif_create_default_wifi_ap'
collect2: error: ld returned 1 exit status
ninja: build stopped: subcommand failed.
ninja failed with exit code 1