Pyo3 builds on Mac M1 builds failing with undefined symbols for arm64 libintl

[twitu]

I can build a pyo3 project on Mac M1 but when I run or test it, it fails to load or find symbols.

          ld: warning: object file (/Users/twitu/Code/nautilus_trader/nautilus_core/target/debug/deps/libpyo3_ffi-77a14a70a5d0a67c.rlib(accu.o)) was built for newer macOS version (12.3) than being linked (12.0)
          Undefined symbols for architecture arm64:
            "_libintl_bind_textdomain_codeset", referenced from:
                __locale_bind_textdomain_codeset in libpyo3_ffi-77a14a70a5d0a67c.rlib(_localemodule.o)
            "_libintl_bindtextdomain", referenced from:
                __locale_bindtextdomain in libpyo3_ffi-77a14a70a5d0a67c.rlib(_localemodule.o)
            "_libintl_textdomain", referenced from:
                __locale_textdomain in libpyo3_ffi-77a14a70a5d0a67c.rlib(_localemodule.o)
            "_libintl_dcgettext", referenced from:
                __locale_dcgettext in libpyo3_ffi-77a14a70a5d0a67c.rlib(_localemodule.o)
            "_libintl_setlocale", referenced from:
                __locale_setlocale in libpyo3_ffi-77a14a70a5d0a67c.rlib(_localemodule.o)
                __locale_localeconv in libpyo3_ffi-77a14a70a5d0a67c.rlib(_localemodule.o)
            "_libintl_dgettext", referenced from:
                __locale_dgettext in libpyo3_ffi-77a14a70a5d0a67c.rlib(_localemodule.o)
            "_libintl_gettext", referenced from:
                __locale_gettext in libpyo3_ffi-77a14a70a5d0a67c.rlib(_localemodule.o)
          ld: symbol(s) not found for architecture arm64
          clang: error: linker command failed with exit code 1 (use -v to see invocation)

In Mac M1, homebrew has a slightly different prefix. So I had to pass export RUSTFLAGS='-L /opt/homebrew/lib'. Before passing the flag the error is even less descriptive.

dyld[5845]: symbol not found in flat namespace '_libintl_bind_textdomain_codeset'

pyo3 version 0.17.3
rustc version 1.66.0

[messense]

ld: warning: object file (/Users/twitu/Code/nautilus_trader/nautilus_core/target/debug/deps/libpyo3_ffi-77a14a70a5d0a67c.rlib(accu.o)) was built for newer macOS version (12.3) than being linked (12.0)

Have you tried cargo clean first?

_libintl_* symbols are from gettext, right? What's the output of file /opt/homebrew/lib/libintl.8.dylib? Mine is

$ file /opt/homebrew/lib/libintl.8.dylib
/opt/homebrew/lib/libintl.8.dylib: Mach-O 64-bit dynamically linked shared library arm64

[messense]

Make sure your Python installed using pyenv is configured with --enable-shared:

PYTHON_CONFIGURE_OPTS="--enable-shared" pyenv install 3.10.9

See https://pyo3.rs/v0.17.3/getting_started#virtualenvs

[twitu]

I also tried to make a smaller test to reproduce and surprisingly even an empty test (with an empty body) fails with the same linking error.

[messense]

Can you paste the output of python3 -m sysconfig?

[twitu]

Make sure your Python installed using pyenv is configured with --enable-shared:

PYTHON_CONFIGURE_OPTS="--enable-shared" pyenv install 3.10.9

See https://pyo3.rs/v0.17.3/getting_started#virtualenvs

Installing with this sharing enabled worked. Now the tests are passing and there is no linking error.

Thanks a lot for pointing out the fix. I should have read the documentation properly.

[twitu]

Also this flag export RUSTFLAGS='-L /opt/homebrew/lib' is NOT required after installing python with sharing enabled. The tests still work without it.