Skip to content

PYMC/Arviz failing to install on Databricks #7832

@brawth

Description

@brawth

Describe the issue:

Good Afternoon,

Wanted to check if anyone's else's workflows on Databricks are failing to install pymc== 5.23.0 on 14.3 lts + clusters on Databricks as of earlier today.

Both within notebook installation via pip and installation via pyPi on DB are failing for me-with (sadly) not terribly helpful error messages.

Reproduceable code example:

%pip install pymc

Error message:

Collecting pymc==5.23.0
  Using cached pymc-5.23.0-py3-none-any.whl.metadata (16 kB)
Collecting arviz>=0.13.0 (from pymc==5.23.0)
  Using cached arviz-0.21.0-py3-none-any.whl.metadata (8.8 kB)
Requirement already satisfied: cachetools>=4.2.1 in /databricks/python3/lib/python3.12/site-packages (from pymc==5.23.0) (5.3.3)
Requirement already satisfied: cloudpickle in /databricks/python3/lib/python3.12/site-packages (from pymc==5.23.0) (2.2.1)
Requirement already satisfied: numpy>=1.25.0 in /databricks/python3/lib/python3.12/site-packages (from pymc==5.23.0) (1.26.4)
Requirement already satisfied: pandas>=0.24.0 in /local_disk0/.ephemeral_nfs/cluster_libraries/python/lib/python3.12/site-packages (from pymc==5.23.0) (2.3.0)
Collecting pytensor<2.32,>=2.31.2 (from pymc==5.23.0)
  Using cached pytensor-2.31.3-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.9 kB)
Collecting rich>=13.7.1 (from pymc==5.23.0)
  Using cached rich-14.0.0-py3-none-any.whl.metadata (18 kB)
Requirement already satisfied: scipy>=1.4.1 in /databricks/python3/lib/python3.12/site-packages (from pymc==5.23.0) (1.13.1)
Requirement already satisfied: threadpoolctl<4.0.0,>=3.1.0 in /local_disk0/.ephemeral_nfs/cluster_libraries/python/lib/python3.12/site-packages (from pymc==5.23.0) (3.6.0)
Requirement already satisfied: typing-extensions>=3.7.4 in /local_disk0/.ephemeral_nfs/cluster_libraries/python/lib/python3.12/site-packages (from pymc==5.23.0) (4.14.0)
Requirement already satisfied: setuptools>=60.0.0 in /usr/local/lib/python3.12/dist-packages (from arviz>=0.13.0->pymc==5.23.0) (74.0.0)
Requirement already satisfied: matplotlib>=3.5 in /databricks/python3/lib/python3.12/site-packages (from arviz>=0.13.0->pymc==5.23.0) (3.8.4)
Requirement already satisfied: packaging in /databricks/python3/lib/python3.12/site-packages (from arviz>=0.13.0->pymc==5.23.0) (24.1)
Collecting xarray>=2022.6.0 (from arviz>=0.13.0->pymc==5.23.0)
  Using cached xarray-2025.6.1-py3-none-any.whl.metadata (12 kB)
Collecting h5netcdf>=1.0.2 (from arviz>=0.13.0->pymc==5.23.0)
  Using cached h5netcdf-1.6.1-py3-none-any.whl.metadata (13 kB)
Collecting xarray-einstats>=0.3 (from arviz>=0.13.0->pymc==5.23.0)
  Using cached xarray_einstats-0.9.1-py3-none-any.whl.metadata (5.9 kB)
Requirement already satisfied: python-dateutil>=2.8.2 in /databricks/python3/lib/python3.12/site-packages (from pandas>=0.24.0->pymc==5.23.0) (2.9.0.post0)
Requirement already satisfied: pytz>=2020.1 in /databricks/python3/lib/python3.12/site-packages (from pandas>=0.24.0->pymc==5.23.0) (2024.1)
Requirement already satisfied: tzdata>=2022.7 in /local_disk0/.ephemeral_nfs/cluster_libraries/python/lib/python3.12/site-packages (from pandas>=0.24.0->pymc==5.23.0) (2025.2)
Requirement already satisfied: filelock>=3.15 in /usr/local/lib/python3.12/dist-packages (from pytensor<2.32,>=2.31.2->pymc==5.23.0) (3.15.4)
Collecting etuples (from pytensor<2.32,>=2.31.2->pymc==5.23.0)
  Using cached etuples-0.3.9.tar.gz (30 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting logical-unification (from pytensor<2.32,>=2.31.2->pymc==5.23.0)
  Using cached logical-unification-0.4.6.tar.gz (31 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting miniKanren (from pytensor<2.32,>=2.31.2->pymc==5.23.0)
  Using cached minikanren-1.0.4.tar.gz (21 kB)
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'error'
  error: subprocess-exited-with-error
  
  × Getting requirements to build wheel did not run successfully.
  │ exit code: 1
  ╰─> [36 lines of output]
      Traceback (most recent call last):
        File "/local_disk0/.ephemeral_nfs/envs/pythonEnv-5d1139e6-59ac-454b-8cc5-dd49c0cef86b/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 353, in <module>
          main()
        File "/local_disk0/.ephemeral_nfs/envs/pythonEnv-5d1139e6-59ac-454b-8cc5-dd49c0cef86b/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 335, in main
          json_out['return_val'] = hook(**hook_input['kwargs'])
                                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/local_disk0/.ephemeral_nfs/envs/pythonEnv-5d1139e6-59ac-454b-8cc5-dd49c0cef86b/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 118, in get_requires_for_build_wheel
          return hook(config_settings)
                 ^^^^^^^^^^^^^^^^^^^^^
        File "/usr/local/lib/python3.12/dist-packages/setuptools/build_meta.py", line 332, in get_requires_for_build_wheel
          return self._get_build_requires(config_settings, requirements=[])
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/usr/local/lib/python3.12/dist-packages/setuptools/build_meta.py", line 302, in _get_build_requires
          self.run_setup()
        File "/usr/local/lib/python3.12/dist-packages/setuptools/build_meta.py", line 318, in run_setup
          exec(code, locals())
        File "<string>", line 1, in <module>
        File "/usr/local/lib/python3.12/dist-packages/setuptools/__init__.py", line 117, in setup
          return distutils.core.setup(**attrs)
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/usr/local/lib/python3.12/dist-packages/setuptools/_distutils/core.py", line 158, in setup
          dist.parse_config_files()
        File "/local_disk0/.ephemeral_nfs/envs/pythonEnv-5d1139e6-59ac-454b-8cc5-dd49c0cef86b/lib/python3.12/site-packages/_virtualenv.py", line 22, in parse_config_files
          result = old_parse_config_files(self, *args, **kwargs)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/usr/local/lib/python3.12/dist-packages/setuptools/dist.py", line 608, in parse_config_files
          pyprojecttoml.apply_configuration(self, filename, ignore_option_errors)
        File "/usr/local/lib/python3.12/dist-packages/setuptools/config/pyprojecttoml.py", line 71, in apply_configuration
          config = read_configuration(filepath, True, ignore_option_errors, dist)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/usr/local/lib/python3.12/dist-packages/setuptools/config/pyprojecttoml.py", line 136, in read_configuration
          validate(subset, filepath)
        File "/usr/local/lib/python3.12/dist-packages/setuptools/config/pyprojecttoml.py", line 60, in validate
          raise ValueError(f"{error}\n{summary}") from None
      ValueError: invalid pyproject.toml config: `project`.
      configuration error: `project` must not contain {'license-files'} properties
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error

× Getting requirements to build wheel did not run successfully.
│ exit code: 1
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.

PyMC version information:

pymc==5.23.0

Context for the issue:

(please note, no changes have been made to workflow-issue seems to be on the DB side as far as I can tell, as I can install locally on my other machine)

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions