(Works nice!) CLIP Interrogator 2.1 by @pharmapsychotic

[specblades]

Can we add it in a1111?

CLIP Interrogator 2.1 by @pharmapsychotic

https://colab.research.google.com/github/pharmapsychotic/clip-interrogator/blob/main/clip_interrogator.ipynb

a1111 interrogator VS 2.1 @pharmapsychotic

original image

1. a1111 interrogator
   a pink dog lollipop on a stick with a blue sky in the background and a blue sky in the background, by Salvador Dali
   
2. 2.1 @pharmapsychotic
   a fluffy pink dog sitting on top of a cotton candy floss, an album cover, inspired by Louis-Michel van Loo, gothcore
   

no cherrypick

[pharmapsychotic]

I could help with integration. It's a library now that can be pip install'd or git clone'd and imported. I notice in the webui it has code to unload models from VRAM. I can add method to Interrogator for that.

[specblades]

It will be great improvement for a1111!
I literrally cant help, my skills are... python is a snake, ya?

[cgessai]

pharmapsychotic, was there ever movement on this idea to integrate your system into Automatic1111? I don't think your interrogator should completely replace the existing one but I love it and frequently use the collab for it. I would love to see the older one and yours being choices to choose from in settings.

[specblades]

I think it also should be very useful for creating captions for TI trainting.

[specblades]

input

old:
a man in armor holding a sword in front of a crowd of people in a futuristic city with neon lights

2.1:
a close up of a person holding a sword, by Mór Than, fantasy art, throwing cards in the air, explosions and purple lasers, from witcher (2021), cd cover artwork, violet spiders, geralt, heavily upvoted, as a tarot card, epic action shot, fisting, gary

FISTING GARY

no cherrypick

[andykaufseo]

definitely need to add this to the webui, as the current clip is kinda crappy, and yes, it will help with captions

[musicurgy]

Yes, please add this

[cgessai]

I don't think it should replace the existing one but instead be one of a number of options to choose from in settings? I use pharmapsychotic's clip interrogator collab quite a bit and it's awesome, but the current one can sometime produce different interpretations which I find more useful.

[razvan-nicolae]

any updates? We still don't have a good CLIP interrogator in A1111 to my knowledge.

[pharmapsychotic]

There is CLIP Interrogator extension now https://github.com/pharmapsychotic/clip-interrogator-ext

[razvan-nicolae]

I saw it and installed right after I wrote my message. One problem - is it normal to be missing exactly 300MB on a 4090 (24GB ram) in order to be able to run blip2 6.7b or the other 15GB size models. Super disappointed I couldn’t test those. Vram usage never went above 22.5GB on my end so really unclear why it fails. On 26 Mar 2023, at 20:12, pharmapsychotic ***@***.***> wrote:  There is CLIP Interrogator extension now https://github.com/pharmapsychotic/clip-interrogator-ext — Reply to this email directly, view it on GitHub<#4572 (reply in thread)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AESH55QNOSEU4WOK47GGTN3W6B2FVANCNFSM6AAAAAAR43NXLY>. You are receiving this because you commented.Message ID: ***@***.***>

…

_________________________________________________________________________________________________________________________ Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration, Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci. This message and its attachments may contain confidential or privileged information that may be protected by law; they should not be distributed, used or copied without authorisation. If you have received this email in error, please notify the sender and delete this message and its attachments. As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified. Thank you.