[Feature]: Support namespace packaging

[kvklink]

Contact Details

No response

What should we build?

Convert the package definition of the orchestrator module into something that supports namespace packages

Namespace packages are a mechanism for splitting a single Python package across multiple directories on disk.

This will enable the development and packaging of extra modules outside of orchestrator-core like orchestrator-optical.
With it, we can have:

1. uv add orchestrator-core
2. uv add orchestrator-optical
3. from orchestrator.optical.products import OpticalProduct
4. Profit

Implementation

For the implementation of this feature, relevant docs in this section of PEP 420. It comes down to removing the __init__.py from the orchestrator main module. Flit should readily support implicit namespace packages like here.

Relevant pseudo code

[kvklink]

Come to think of it, we could then also apply this pattern to modules for the agentic orchestrator, allowing for separate versioning.