Feature request: Please, add face restoration for Desktop version of Upscayl.

[JohnClaw]

...

[NayamAmarshe]

Not possible for now, sorry. We can't integrate something like that easily in a desktop app for all platforms, it's a HUGE task for a team of 2 developers.

[etlweather]

Ah, two devs - I might start helping then!

[NayamAmarshe]

It'd still be extremely difficult to get it working. Dealing with python scripts, installing modules correctly, setting up the dev environment on users' machines is a lot of work and can be buggy or simply might not work for most.

[JohnClaw]

It'd still be extremely difficult to get it working. Dealing with python scripts, installing modules correctly, setting up the dev environment on users' machines is a lot of work and can be buggy or simply might not work for most.

And what about c++ versions of face restorators? Do they exist?

[JohnClaw]

I found at least one c++ restorator: https://github.com/dianhsu/swin-transformer-cpp

[JohnClaw]

Also there are ONNX codeformer and GFPGAN models: https://github.com/harisreedhar/Face-Upscalers-ONNX/releases/tag/Models
CPP resources to implement ONNX runtime:
Microsoft C++ ONNX Runtime for CPU: https://www.nuget.org/packages/Microsoft.ML.OnnxRuntime
https://github.com/hpc203/CodeFormer-onnxrun-cpp-py
https://github.com/xmba15/onnx_runtime_cpp

[JohnClaw]

Maybe this tool will help to convert ONNX to NCNN:

https://github.com/Tencent/ncnn/blob/master/tools/onnx/onnx2ncnn.cpp

[JohnClaw]

This site also can convert ONNX to NCNN:

https://convertmodel.com/

[aaronliu0130]

huggingface.co/facefusion/models/resolve/main/GFPGANv1.4.onnx

I'm pretty sure that's the exact same model I tried to convert

https://convertmodel.com/

https://github.com/Tencent/ncnn/blob/master/tools/onnx/onnx2ncnn.cpp

[JohnClaw]

I'm just attempting to find GFPGAN.cpp.exe or Codeformer.cpp.exe or any other CLI.exe that can do face restoration. Planning to use it with images generated in Stable-diffusion.cpp.exe (https://github.com/leejet/stable-diffusion.cpp) and zoomed in Upscayl. Unfortunately, my searchings for such app are unsuccessful.

[NayamAmarshe]

I'm just attempting to find GFPGAN.cpp.exe or Codeformer.cpp.exe or any other CLI.exe that can do face restoration. Planning to use it with images generated in Stable-diffusion.cpp.exe (https://github.com/leejet/stable-diffusion.cpp) and zoomed in Upscayl. Unfortunately, my searchings for such app are unsuccessful.

Yep, it's not an easy task to create such things. Even the ncnn vulkan project was created by a senior AI researcher.

[JohnClaw]

I'm pretty sure that's the exact same model I tried to convert

Ok. I don't lose hope and found some more variants that may solve the problem:

https://github.com/magicse/GFPGANv1.3-to-ncnn
https://github.com/FeiGeChuanShu/GFPGAN-ncnn
https://github.com/onuralpszr/GFPGAN-ncnn-vulkan
https://github.com/Qengineering/GFPGAN-ncnn-Raspberry-Pi-4

[RafaelLinux]

I came here precisely because I'm an Upscayl user, but there are cases where, in the default models, faces end up being "restored" into grotesque faces. I thought adding the GFPGAN model would be easy, but the first thing I found was this discussion thread, abandoned since 2023... Has anyone found a way to use GFPGAN from within Upscayl?