Skip to content

Commit 95763ca

Browse files
committed
Update readme with other text base LLMs
1 parent b8adda6 commit 95763ca

File tree

2 files changed

+6
-49
lines changed

2 files changed

+6
-49
lines changed

README.md

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -222,6 +222,12 @@ See [examples](./examples/src/voice_fn_examples/) for more usages.
222222
- **OpenAI**
223223
- Models: `gpt-4o-mini`(fastest, cheapest), `gpt-4`, `gpt-3.5-turbo` and more
224224
- Features: Function calling, streaming responses
225+
- **Google**
226+
- Models: `gemini-2.0-flash`(fastest, cheapest), `gemini-2.5-flash`, and more
227+
- Features: Function calling, streaming responses, thinking
228+
- **Groq**
229+
- Models: `llama-3.2-3b-preview` `llama-3.1-8b-instant` `llama-3.3-70b-versatile` etc
230+
- Features: Function calling, streaming responses, thinking
225231

226232

227233
## Key Concepts

src/simulflow/processors/groq.clj

Lines changed: 0 additions & 49 deletions
Original file line numberDiff line numberDiff line change
@@ -15,55 +15,6 @@
1515
(def groq-api-url "https://api.groq.com/openai/v1")
1616
(def groq-completions-url (str groq-api-url "/chat/completions"))
1717

18-
(defn stream-groq-chat-completion
19-
[{:keys [api-key messages tools model]}]
20-
(:body (request/sse-request {:request {:url groq-completions-url
21-
:headers {"Authorization" (str "Bearer " api-key)
22-
"Content-Type" "application/json"}
23-
24-
:method :post
25-
:body (u/json-str (cond-> {:messages messages
26-
:stream true
27-
:model model}
28-
(pos? (count tools)) (assoc :tools tools)))}
29-
:params {:stream/close? true}})))
30-
31-
(defn normal-chat-completion
32-
[{:keys [api-key messages tools model]}]
33-
(http/request {:url groq-completions-url
34-
:headers {"Authorization" (str "Bearer " api-key)
35-
"Content-Type" "application/json"}
36-
37-
:throw-on-error? false
38-
:method :post
39-
:body (u/json-str (cond-> {:messages messages
40-
:stream true
41-
:model model}
42-
(pos? (count tools)) (assoc :tools tools)))}))
43-
44-
(comment
45-
46-
(map u/token-content (a/<!! (a/into [] (stream-groq-chat-completion
47-
{:model "llama-3.3-70b-versatile"
48-
:api-key (secret [:groq :api-key])
49-
:messages [{:role "system" :content "Ești un agent vocal care funcționează prin telefon. Răspunde doar în limba română și fii succint. Inputul pe care îl primești vine dintr-un sistem de speech to text (transcription) care nu este intotdeauna eficient și poate trimite text neclar. Cere clarificări când nu ești sigur pe ce a spus omul."}
50-
{:role "user" :content "Salutare ma auzi?"}]}))))
51-
52-
,)
53-
54-
(comment
55-
56-
(->> (http/get (str groq-api-url "/models")
57-
{:headers {"Authorization" (str "Bearer " (secret [:groq :api-key]))
58-
"Content-Type" "application/json"}})
59-
:body
60-
u/parse-if-json
61-
:data
62-
(map :id))
63-
,)
64-
65-
(def delta (comp :delta first :choices))
66-
6718
(def GroqLLMConfigSchema
6819
[:map
6920
{:closed true

0 commit comments

Comments
 (0)