Skip to content

Conversation

@dcamron
Copy link
Contributor

@dcamron dcamron commented Aug 6, 2025

A few changes I think will drastically speed up your environment generation.

  1. Before Pythia "mystified", we had old theme dependencies that fell out of maintenance. These have conflicts with other major python and package versions and can drastically slow down environment generation. You might notice your environment has an older Python version than you expect.
  2. PyTorch has retired support for their official pytorch conda channel. You can find community maintained pytorch-cpu and pytorch-gpu packages on conda-forge, or you can add the following to install from pip. Here I've opted for conda-forge.
# from environment.yml
# ...
- xbatcher
- pip:
  - torch

If you need to install from pip with more complex steps (specific wheels for specific drivers/hardware etc.) you can use pip install --no-cache-dir torch ... from within your conda environment.

@github-actions
Copy link

github-actions bot commented Aug 6, 2025

👋 Thanks for opening this PR! The Cookbook will be automatically built with GitHub Actions. To see the status of your deployment, click below.
🔍 Git commit SHA: 14cda22
✅ Deployment Preview URL: https://ProjectPythia.github.io/xbatcher-deep-learning/_preview/5

@s-kganz
Copy link
Collaborator

s-kganz commented Aug 6, 2025

Ty for the guidance! We are up and running on development, but this will speed us along during the week.

@s-kganz s-kganz merged commit f42cf64 into ProjectPythia:main Aug 6, 2025
2 checks passed
github-actions bot pushed a commit that referenced this pull request Aug 6, 2025
@dcamron
Copy link
Contributor Author

dcamron commented Aug 6, 2025

Let me know if this does help!

@s-kganz
Copy link
Collaborator

s-kganz commented Aug 6, 2025

Can confirm this cuts the build time from ~5 minutes to ~2 minutes. Pulling the built image still takes some time, but a big improvement.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants