Skip to content

[Feature Request] Text Based Inpainting Masks (YOLOv8-seg) #13

@iwr-redmond

Description

@iwr-redmond

At present inpainting requires a drawn mask, and an attempt is made to launch a basic HTML interface is initiated if the user does not provide one. However, text based masking in such instances would be preferable, especially for remote interference.

Bryce Drennan's imaginAIry CLI package incorporated ClipSeg for this purpose (enhancers/clip_masking.py) while also allowing mask files to be inputted (see manual). In the case of stablepy, as YOLOv8 is already used for detailfix, it should be reasonably straightforward to incorporate the segmentation model into the package as a fallback.

The inference code returns boxes and masks, of which the latter will be relevant for stablepy.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions