[BUG] chia v1.2.9 INSTALL ERROR ON FREEBSD 12.2 "Undefined symbol "SSLv3_client_method" PYTHON 3.7 AND 3.8

[srd00]

Describe the bug
I'm having several issues trying to install version v.1.2.9 on a freebsd 12.2 jail.

I tried to follow the steps on https://github.com/Chia-Network/chia-blockchain/wiki/FreeBSD-Install adapting along the way.

I was facing the issues on #7846 so I installed both devel/pybind11 and py38-pybind11

I tried two separate jails, one with python 3.7 and another with python 3.8. Since release info says clvm_rs was bumped to 0.1.14 I'm using that branch.

On the 3.7 jail as needed to follow these steps #1110 to install clvm_rs correctly (maturin build --release and install from wheel). On 3.8 the steps on the tutorial work (maturin develop --release and pip install git+https://github.com/Chia-Network/clvm@use_clvm_rs ).

I tried both downgrading the required cryptography package to 3.3.2 (+ copying cryptography to venv, like the tutorial) and leaving it as is ("cryptography==3.4.7").

With the changes, everything compiles and installs without any issue, but when I run chia I see the error

ImportError: /chia/v129/chia-blockchain/venv/lib/python3.8/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so: Undefined symbol "SSLv3_client_method"

Trace message:

(venv) [xch@xch1 /chia/v129/chia-blockchain]$ chia
Traceback (most recent call last):
File "/chia/v129/chia-blockchain/venv/bin/chia", line 33, in
sys.exit(load_entry_point('chia-blockchain', 'console_scripts', 'chia')())
File "/chia/v129/chia-blockchain/venv/bin/chia", line 25, in importlib_load_entry_point
return next(matches).load()
File "/usr/local/lib/python3.8/importlib/metadata.py", line 77, in load
module = import_module(match.group('module'))
File "/usr/local/lib/python3.8/importlib/init.py", line 127, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "", line 1014, in _gcd_import
File "", line 991, in _find_and_load
File "", line 975, in _find_and_load_unlocked
File "", line 671, in _load_unlocked
File "", line 843, in exec_module
File "", line 219, in _call_with_frames_removed
File "/chia/v129/chia-blockchain/chia/cmds/chia.py", line 7, in
from chia.cmds.init import init_cmd
File "/chia/v129/chia-blockchain/chia/cmds/init.py", line 2, in
from chia.util.keychain import supports_keyring_passphrase
File "/chia/v129/chia-blockchain/chia/util/keychain.py", line 9, in
from chia.util.keyring_wrapper import KeyringWrapper
File "/chia/v129/chia-blockchain/chia/util/keyring_wrapper.py", line 6, in
from chia.util.file_keyring import FileKeyring
File "/chia/v129/chia-blockchain/chia/util/file_keyring.py", line 11, in
from cryptography.hazmat.primitives.ciphers.aead import ChaCha20Poly1305 # pyright: reportMissingModuleSource=false
File "/chia/v129/chia-blockchain/venv/lib/python3.8/site-packages/cryptography/hazmat/primitives/ciphers/aead.py", line 10, in
from cryptography.hazmat.backends.openssl import aead
File "/chia/v129/chia-blockchain/venv/lib/python3.8/site-packages/cryptography/hazmat/backends/openssl/init.py", line 6, in
from cryptography.hazmat.backends.openssl.backend import backend
File "/chia/v129/chia-blockchain/venv/lib/python3.8/site-packages/cryptography/hazmat/backends/openssl/backend.py", line 113, in
from cryptography.hazmat.bindings.openssl import binding
File "/chia/v129/chia-blockchain/venv/lib/python3.8/site-packages/cryptography/hazmat/bindings/openssl/binding.py", line 14, in
from cryptography.hazmat.bindings._openssl import ffi, lib
ImportError: /chia/v129/chia-blockchain/venv/lib/python3.8/site-packages/cryptography/hazmat/bindings/_openssl.abi3.so: Undefined symbol "SSLv3_client_method"

Desktop

• OS: FREEBSD (jail on TrueNAS-12.0-U4)
• OS Version/Flavor: 12.2-RELEASE-p6

[emlowe]

The steps are known to work for freebsd native (that is not in a jail) - further support for freebsd jails at this time needs to come from the community.

[perrin4869]

The steps are hugely out of date by now though
I do have the latest 1.2.10 running on a 12.2 jail, but it wasn't trivial to get it working. I could try reproducing the steps and contribute them back, but I'm sure a chia dev could do it way easier than i could

[srd00]

The steps are hugely out of date by now though I do have the latest 1.2.10 running on a 12.2 jail, but it wasn't trivial to get it working. I could try reproducing the steps and contribute them back, but I'm sure a chia dev could do it way easier than i could

Please, could you reproduce them? Based on @emlowe response freebsd jail doesn't seem to be a priority for the team.

[perrin4869]

I could try tomorrow for sure, but I don't see why this is a jail specific problem. I think the current instructions will fail for chia > 1.2.6 even in non jail environments

[perrin4869]

ok I've had luck running the 1.2.10 node and getting it to syncing status on a 12.2 jail only slightly modifying the current instructions.

It is a matter of updating all references to python 3.7 to 3.8, updating clvm_rs to use 0.1.4 and also installing pkg install devel/pybind11

Here is a mock script:

❯ cat chia_jail.sh
#!/bin/bash

sudo iocage exec chia-repro /bin/sh

# Update your packages and ports; if ports are already installed as part of your fresh install run portsnap update instead of fetch/extract.
pkg update
portsnap fetch && portsnap extract

# Install bash if you have not; the default csh will not suffice for the build scripts.
pkg install bash
# change your shell to bash
chsh -s /usr/local/bin/bash
# run bash
/usr/local/bin/bash

pkg install lang/gcc9 gcc gmake cmake
pkg install lang/python38 py38-pip py38-setuptools py38-wheel py38-sqlite3 py38-cffi py38-virtualenv py38-maturin python
pkg install node npm git openssl

# chiapos fails otherwise
pkg install devel/pybind11

cd ~

# Clone the latest chia-blockchain repository, via HTTP:
git clone https://github.com/Chia-Network/chia-blockchain.git -b latest
# or with SSH:
# git clone [email protected]:Chia-Network/chia-blockchain.git -b latest
# Note: you can specify the branch by adding "--branch <version>" like: git clone http://github.com/Chia-Network/chia-blockchain.git --branch 1.0.1

cd chia-blockchain
python3 -m venv venv
source venv/bin/activate

pip install --upgrade pip

deactivate

cd /usr/ports/security/py-cryptography

# Instruct 'make' that the SSL library is openssl.
# Also force the Python version in case the port tries for a higher one
echo "DEFAULT_VERSIONS+=ssl=openssl python=3.8 python3=3.8" >> /etc/make.conf

make

cd ~/chia-blockchain
source venv/bin/activate

git clone http://github.com/Chia-Network/clvm_rs.git --branch 0.1.14
cd clvm_rs
maturin develop --release
pip install git+https://github.com/Chia-Network/clvm@use_clvm_rs

cd ..

cp -R /usr/ports/security/py-cryptography/work-py38/stage/usr/local/lib/python3.8/site-packages/cryptography ${VIRTUAL_ENV}/lib/python3.8/site-packages/cryptography
cp -R /usr/ports/security/py-cryptography/work-py38/stage/usr/local/lib/python3.8/site-packages/cryptography-3.3.2-py3.7.egg-info ${VIRTUAL_ENV}/lib/python3.8/site-packages/cryptography-3.3.2-py3.8.egg-info

find ${VIRTUAL_ENV}/lib/python3.8/site-packages/cryptography -name __pycache__ | xargs -I{} rm -rf "{}"

# modify setup.yml to use cryptography 3.3.2

sh install.sh

chia init
chia keys generate
chia start node

@emlowe If you could confirm that this is working and update the instructions it will be a huge help to people coming in now.
I could help also in the future, but honestly I'm barely competent in python, chia, and freebsd, I can't imagine none of the chia devs can spare 1 hour of their time to make the tiny changes that I outlined up there... sorry for the negativity but this does make me question my support on this project...

[perrin4869]

Ah and I forgot, with 1.2.10 it is no longer necessary to do the whole keyring file editing that is explained in the current guide, should be removed! Was really happy to see that improvement :)

[pgammel]

I had to modify this to use Python 3.9. I replaced

cp -R /usr/ports/security/py-cryptography/work-py38/stage/usr/local/lib/python3.8/site-packages/cryptography ${VIRTUAL_ENV}/lib/python3.8/site-packages/cryptography

cp -R /usr/ports/security/py-cryptography/work-py38/stage/usr/local/lib/python3.8/site-packages/cryptography-3.3.2-py3.7.egg-info ${VIRTUAL_ENV}/lib/python3.8/site-packages/cryptography-3.3.2-py3.8.egg-info

with
cp -R /usr/ports/security/py-cryptography/work-py39/stage/usr/local/lib/python3.9/site-packages/cryptography ${VIRTUAL_ENV}/lib/python3.9/site-packages/cryptography

cp -R /usr/ports/security/py-cryptography/work-py39/stage/usr/local/lib/python3.9/site-packages/cryptography-3.3.2-py3.7.egg-info ${VIRTUAL_ENV}/lib/python3.9/site-packages/cryptography-3.3.2-py3.9.egg-info

I'm getting this error when I tried to generate keys:

Traceback (most recent call last):
  File "/chia-blockchain/venv/bin/chia", line 8, in <module>
    sys.exit(main())
  File "/chia-blockchain/chia/cmds/chia.py", line 136, in main
    cli()  # pylint: disable=no-value-for-parameter
  File "/chia-blockchain/venv/lib/python3.9/site-packages/click/core.py", line 1130, in __call__
    return self.main(*args, **kwargs)
  File "/chia-blockchain/venv/lib/python3.9/site-packages/click/core.py", line 1055, in main
    rv = self.invoke(ctx)
  File "/chia-blockchain/venv/lib/python3.9/site-packages/click/core.py", line 1657, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/chia-blockchain/venv/lib/python3.9/site-packages/click/core.py", line 1654, in invoke
    super().invoke(ctx)
  File "/chia-blockchain/venv/lib/python3.9/site-packages/click/core.py", line 1404, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/chia-blockchain/venv/lib/python3.9/site-packages/click/core.py", line 760, in invoke
    return __callback(*args, **kwargs)
  File "/chia-blockchain/venv/lib/python3.9/site-packages/click/decorators.py", line 26, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "/chia-blockchain/chia/cmds/keys.py", line 20, in keys_cmd
    if ctx.obj["force_legacy_keyring_migration"] and not asyncio.run(migrate_keys(root_path, True)):
  File "/usr/local/lib/python3.9/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.9/asyncio/base_events.py", line 647, in run_until_complete
    return future.result()
  File "/chia-blockchain/chia/cmds/keys_funcs.py", line 279, in migrate_keys
    legacy_keyring = Keychain(force_legacy=True)
  File "/chia-blockchain/chia/util/keychain.py", line 265, in __init__
    KeyringWrapper.get_legacy_instance() if force_legacy else KeyringWrapper.get_shared_instance()
  File "/chia-blockchain/chia/util/keyring_wrapper.py", line 187, in get_legacy_instance
    return KeyringWrapper(force_legacy=True)
  File "/chia-blockchain/chia/util/keyring_wrapper.py", line 115, in __init__
    if check_legacy_keyring_keys_present(legacy_keyring):
  File "/chia-blockchain/chia/util/keyring_wrapper.py", line 58, in check_legacy_keyring_keys_present
    credential: Optional[Credential] = keyring.get_credential(keychain_service, current_user)
AttributeError: 'NoneType' object has no attribute 'get_credential'