Skip to content

Some details #7

@set-soft

Description

@set-soft

Thanks for this node, simple to use, small model and usable.

Some details:

  1. Please comment in the README.md where is the model to download, https://github.com/facefusion/facefusion-assets/releases/download/models-3.0.0/kim_vocal_2.onnx
  2. Allow downloading it somewhere in ComfyUI/models/, perhaps ComfyUI/models/audio, separating code from data is important
  3. Having dependencies with fixed versions is a very bad idea, will break something soon or latter. Copy the current requirements.txt to somethings like requirements_strict.txt and remove the versions for the audio tools (librosa and soundfile). I have soundfile 0.13.1 and librosa 0.11.0, they work without problems. Just mention to use requirements_strict.txt if something goes wrong and to report it so you can adjust the code.
  4. Did you try converting the ONNX model to Pytorch and saving it as safetensors? If this can be achieved you can remove all the (nasty) ONNX dependencies.
  5. Your setup.py is trying to install everything for CUDA 11.8, I'm using 12.6 and all works. I didn't even tried to run it because it could simply try to install GBs of things that I already have. This looks quite dangerous: run_pip("torch", "torchvision", "torchaudio", "--extra-index-url", "https://download.pytorch.org/whl/cu118") and I can't imagine a ComfyUI setup that doesn't have torch installed. If you take a look at ComfyUI requeriments.txt file you'll see these torch libs, trying to install them is asking for troubles.

In a nutshell: try to make the model loadable by Pytorch and this will reduce your requiements.txt to:

librosa
soundfile

Which are widely used by audio nodes. Then you can just instruct how to download the model and add an auto-downloader. With this the node can be installed fast and safe.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions