gpt-neo with spacy?

[Huehnerbrust]

Hi all,

I am just starting my space journey, and wondered if it is possible to use the new gpt-neo and later gpt-neox modells with spacy. If yes, are there any examples?

Sorry, if this is a total noob question...

Regards

[polm]

Those models have just been released a week or two, so I'm not aware of anyone using them with spaCy yet. Since there's a HuggingFace version of it you should be able to use it the way you would with any Transformers model - see the docs for an overview of that.

That said, if you want to use GPT-Neo in the way it's typically demonstrated, as completing a prompt, that will require some work. spaCy isn't designed for text generation like that, so you'd need to write a component that sets a custom attribute or something.