Created Groq Plugin

[Geoff-Robin]

No description provided.

[blythed]

Hello @Geoff-Robin - nice work! A question: wouldn't it be possible to connect to this model directly with the openai API? You can use our superduper_openai plugin for that.

[Geoff-Robin]

Hi @blythed, you can definitely call Groq models through superduper_openai plugin but inference time is significantly slower through OpenAI API Client. This is mostly due to Groq's custom LPU that makes it a lot faster.

[blythed]

@Geoff-Robin can you look at the CI?

[Geoff-Robin]

@blythed seems like i forgot to run the lint and type checks, there were a few docstring style errors that are all fixed

[Geoff-Robin]

I made a description mistake in the commit message
I didn't add cassette files, it was already there.
I changed the record_mode from "all" to "once" considering workflow didn't set a groq api key.

[Geoff-Robin]

@blythed Could you run the CI if you're available at the moment. I'd like to see if there are more issues with the pull request.