Open
Conversation
Migrate VistaDream (single-image 3D scene reconstruction) from standalone repo into the monorepo as packages/vistadream. Includes pixi.toml feature with CUDA/gsplat deps, source code, CLI tools, example data, and lint fixes for ops/ code. Vendored Flux code gets per-file ruff ignores. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
gsplat's runtime CUDA extension build needs cuda_runtime.h and cicc, which live in conda-forge's targets/x86_64-linux/ and nvvm/bin/ dirs respectively. Set CUDA_HOME, CPATH, and PATH in vistadream activation so the host compiler and nvcc can find them. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This pull request introduces the initial project structure and core functionality for the
vistadreampackage, focusing on the integration and sampling of the Flux generative model. It includes project configuration, core API and CLI for Flux-based image generation, and utility modules for model versioning and initialization. The most important changes are grouped below.Project setup and configuration:
pyproject.tomlfor project metadata, dependencies, build system configuration, and development tool settings. This includes dependencies oneinopsandmonopriors, and configures tools likerufffor linting.Flux model integration and API:
fluxsubpackage with the following modules:api.py: Provides anImageRequestclass for interacting with a remote Flux API, including input validation, request/response handling, and image download utilities.cli.py: Implements a CLI for local sampling from the Flux model, supporting interactive and batch modes, prompt parsing, and NSFW filtering.__main__.py: Entrypoint for CLI execution._version.py: Auto-generated version information for the Flux subpackage.__init__.py: Handles version import and package root path setup.VistaDream core and outpainting:
api/flux_outpainting.py, which defines aFluxOutpaintingConfigdataclass and amainfunction to perform outpainting using the Flux model, including depth prediction, camera parameter logging, and visualization via Rerun.Development and runtime utilities:
__init__.pyto enable runtime type checking withbeartypewhen thePIXI_DEV_MODEenvironment variable is set.