micropython compilation fails in ESP32-Web-Bluetooth/ESP32/micropython/ports/esp32

[chriskuku]

It seems a version of micropython is bundled into the
project ESP32-Web-Bluetooth and I'm trying to get this working.

The problem occurs in a macro expansion

n file included from /Users/me/ESP32-Web-Bluetooth/ESP32/micropython/py/objlist.h:29,
                 from /Users/me/ESP32-Web-Bluetooth/ESP32/micropython/extmod/modnetwork.c:31:
/Users/me/ESP32-Web-Bluetooth/ESP32/micropython/ports/esp32/modnetwork_globals.h:38:54: error: 'WIFI_AUTH_WPA3_EXT_PSK' undeclared here (not in a function); did you mean 'WIFI_AUTH_WPA3_ENT_192'?
   38 | { MP_ROM_QSTR(MP_QSTR_AUTH_WPA3_EXT_PSK), MP_ROM_INT(WIFI_AUTH_WPA3_EXT_PSK) },
      |                                                      ^~~~~~~~~~~~~~~~~~~~~~

Just a question: could I exchange this version of micropython against the current ESP32 port here?

I did that. Copied ports/esp32 into that repo above. The same error occurs.

Next I downloaded microypthon-master.zip and tried compilation in there:

$ make
idf.py -D MICROPY_BOARD=ESP32_GENERIC -D MICROPY_BOARD_DIR="/Users/kuku/Downloads/micropython-master/ports/esp32/boards/ESP32_GENERIC"  -B build-ESP32_GENERIC build || (echo -e "See \033[1;31mhttps://github.com/micropython/micropython/wiki/Build-Troubleshooting\033[0m"; false)
Executing action: all (aliases: build)
Running cmake in directory /Users/kuku/Downloads/micropython-master/ports/esp32/build-ESP32_GENERIC
Executing "cmake -G Ninja -DPYTHON_DEPS_CHECKED=1 -DPYTHON=/Users/kuku/.espressif/python_env/idf5.3_py3.8_env/bin/python -DESP_PLATFORM=1 -DMICROPY_BOARD=ESP32_GENERIC -DMICROPY_BOARD_DIR=/Users/kuku/Downloads/micropython-master/ports/esp32/boards/ESP32_GENERIC -DCCACHE_ENABLE=0 /Users/kuku/Downloads/micropython-master/ports/esp32"...
-- IDF_TARGET not set, using default target: esp32
-- Found Git: /usr/bin/git (found version "2.30.1 (Apple Git-130)") 
-- The C compiler identification is GNU 13.2.0
-- The CXX compiler identification is GNU 13.2.0
-- The ASM compiler identification is GNU
-- Found assembler: /Users/kuku/.espressif/tools/xtensa-esp-elf/esp-13.2.0_20240305/xtensa-esp-elf/bin/xtensa-esp32-elf-gcc
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Check for working C compiler: /Users/kuku/.espressif/tools/xtensa-esp-elf/esp-13.2.0_20240305/xtensa-esp-elf/bin/xtensa-esp32-elf-gcc - skipped
-- Detecting C compile features
-- Detecting C compile features - done
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Check for working CXX compiler: /Users/kuku/.espressif/tools/xtensa-esp-elf/esp-13.2.0_20240305/xtensa-esp-elf/bin/xtensa-esp32-elf-g++ - skipped
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Building ESP-IDF components for target esp32
Processing 2 dependencies:
[1/2] espressif/mdns (1.1.0)
[2/2] idf (5.3.0)
-- Project sdkconfig file /Users/kuku/Downloads/micropython-master/ports/esp32/build-ESP32_GENERIC/sdkconfig
Loading defaults file /Users/kuku/Downloads/micropython-master/ports/esp32/build-ESP32_GENERIC/sdkconfig.combined...
/Users/kuku/Downloads/micropython-master/ports/esp32/build-ESP32_GENERIC/sdkconfig.combined:100 CONFIG_ESP32_WIFI_IRAM_OPT was replaced with CONFIG_ESP_WIFI_IRAM_OPT
/Users/kuku/Downloads/micropython-master/ports/esp32/build-ESP32_GENERIC/sdkconfig.combined:101 CONFIG_ESP32_WIFI_RX_IRAM_OPT was replaced with CONFIG_ESP_WIFI_RX_IRAM_OPT
/Users/kuku/Downloads/micropython-master/ports/esp32/build-ESP32_GENERIC/sdkconfig.combined:141 CONFIG_BT_NIMBLE_TASK_STACK_SIZE was replaced with CONFIG_BT_NIMBLE_HOST_TASK_STACK_SIZE
-- Compiler supported targets: xtensa-esp-elf
-- Found Python3: /Users/kuku/.espressif/python_env/idf5.3_py3.8_env/bin/python (found version "3.8.18") found components: Interpreter 
-- Performing Test C_COMPILER_SUPPORTS_WFORMAT_SIGNEDNESS
-- Performing Test C_COMPILER_SUPPORTS_WFORMAT_SIGNEDNESS - Success
-- App "micropython" version: v1.6.1-802-g2a0d608b-dirty
-- Adding linker script /Users/kuku/Downloads/micropython-master/ports/esp32/build-ESP32_GENERIC/esp-idf/esp_system/ld/memory.ld
-- Adding linker script /Users/kuku/Downloads/micropython-master/ports/esp32/build-ESP32_GENERIC/esp-idf/esp_system/ld/sections.ld.in
-- Adding linker script /Users/kuku/esp/v5.2/esp-idf/components/esp_rom/esp32/ld/esp32.rom.ld
-- Adding linker script /Users/kuku/esp/v5.2/esp-idf/components/esp_rom/esp32/ld/esp32.rom.api.ld
-- Adding linker script /Users/kuku/esp/v5.2/esp-idf/components/esp_rom/esp32/ld/esp32.rom.libgcc.ld
-- Adding linker script /Users/kuku/esp/v5.2/esp-idf/components/esp_rom/esp32/ld/esp32.rom.newlib-data.ld
-- Adding linker script /Users/kuku/esp/v5.2/esp-idf/components/esp_rom/esp32/ld/esp32.rom.syscalls.ld
-- Adding linker script /Users/kuku/esp/v5.2/esp-idf/components/esp_rom/esp32/ld/esp32.rom.newlib-funcs.ld
-- Adding linker script /Users/kuku/esp/v5.2/esp-idf/components/soc/esp32/ld/esp32.peripherals.ld
Found User C Module(s): 
CMake Error at /Users/kuku/Downloads/micropython-master/extmod/extmod.cmake:114 (message):
   MICROPY_PY_BTREE is enabled but the berkeley-db submodule is not initialised.
   Run 'make BOARD=ESP32_GENERIC submodules'
Call Stack (most recent call first):
  esp32_common.cmake:23 (include)
  main_esp32/CMakeLists.txt:11 (include)


-- Configuring incomplete, errors occurred!
See also "/Users/kuku/Downloads/micropython-master/ports/esp32/build-ESP32_GENERIC/CMakeFiles/CMakeOutput.log".
cmake failed with exit code 1, output of the command is in the /Users/kuku/Downloads/micropython-master/ports/esp32/build-ESP32_GENERIC/log/idf_py_stderr_output_70297 and /Users/kuku/Downloads/micropython-master/ports/esp32/build-ESP32_GENERIC/log/idf_py_stdout_output_70297
-e See https://github.com/micropython/micropython/wiki/Build-Troubleshooting
make: *** [all] Error 1
$ make BOARD=ESP32_GENERIC submodules
Use make V=1 or set BUILD_VERBOSE in your environment to increase build verbosity.
Updating submodules: lib/berkeley-db-1.xx lib/micropython-lib
error: pathspec '../../lib/berkeley-db-1.xx' did not match any file(s) known to git
error: pathspec '../../lib/micropython-lib' did not match any file(s) known to git
make[1]: *** [submodules] Error 1
make: *** [submodules] Error 2
$ pwd
/Users/kuku/Downloads/micropython-master/ports/esp32

What is this git thing?

OK, I did a git clone instead and make submodules ran through.

But the above error remains immanent to the current version of the micropython esp32 port. (I'm running esp-idf v5.2)
To me it looks more like an "issue" now :-)

[mohnazemi]

I suggest cloning the Micropython source and then making sure you run git submodule update --init --depth 1

[chriskuku]

Thanks. I did the following:

cd ~/ESP32-Web-Bluetooth/ESP32/
git clone https://github.com/micropython/micropython.git
git submodule update --init --depth 1
cd ~/ESP32-Web-Bluetooth/ESP32/micropython
make -C mpy-cross
cd ports/esp32
make  submodules
make

And the error persists:

[1238/1337] Building C object esp-idf/main_esp32/CMakeFiles/__idf_main_esp32.dir/Users/kuku/ESP32-Web-Bluetooth/ESP32/micropython/extmod/modnetwork.c.obj
FAILED: esp-idf/main_esp32/CMakeFiles/__idf_main_esp32.dir/Users/kuku/ESP32-Web-Bluetooth/ESP32/micropython/extmod/modnetwork.c.obj 

....
In file included from /Users/kuku/ESP32-Web-Bluetooth/ESP32/micropython/py/objlist.h:29,
                 from /Users/kuku/ESP32-Web-Bluetooth/ESP32/micropython/extmod/modnetwork.c:31:
/Users/kuku/ESP32-Web-Bluetooth/ESP32/micropython/ports/esp32/modnetwork_globals.h:38:54: error: 'WIFI_AUTH_WPA3_EXT_PSK' undeclared here (not in a function); did you mean 'WIFI_AUTH_WPA3_ENT_192'?

[mohnazemi]

You are cloning the Micropython master branch. The project you are trying to build is from 2022. The master branch may not be compatible with that project. I suggest checking out a an appropriate older branch of Micropython and IDF that are compatible with that project

[shariltumin]

Are you sure you are compiling with esp-idf-v5.2?

I can see from your build log that it was not the case:

...
Executing "cmake -G Ninja -DPYTHON_DEPS_CHECKED=1 -DPYTHON=/Users/kuku/.espressif/python_env/idf5.3_py3.8_env/bin/python ...
...
...
Processing 2 dependencies:
[1/2] espressif/mdns (1.1.0)
[2/2] idf (5.3.0)
...

As you probably know, idf5.3 is not yet supported. What was your IDF_PATH variable during your build?

[chriskuku]

My IDF_PATH is /Users/kuku/esp/v5.2/esp-idf. But since I (desparately) git cloned - as @mohnazemi correctly stated - the master branch into the project build tree, the idf 5.3.0 occurence is in the micropython tree:
find . | grep -r "5\.3\.0" gives among other hits: ports/esp32/build-ESP32_GENERIC/config.env: "IDF_VERSION": "5.3.0",

I'll start over with cloning the original ESP32-Web-Bluetooth tree from the repo and see, if the error is triggered there.
EDIT: the README says, one should import the micopython build tree from a repo into the project build tree. The version referred is 1.19.1 (which I don't know how to find this in the git repo).

I'd prefer to make the example working somehow with the latest micropython version.