Skip to content

Commit c94eb9d

Browse files
takuya-otakuya-o
committed
✨ New feature (src/adapters/GoogleGeminiAdapter.ts): Support tools by v1beta version of Google Gemini API
GoogleGeminiAdapter.ts uses the v1beta version of the Google Gemini API. and added support for tools. This allows us to take advantage of new features in the API and provide more advanced functionality. We also improved the way responses are handled and implemented logic to format them to match OpenAI's format.
1 parent 96370a7 commit c94eb9d

12 files changed

+894
-470
lines changed

‎.env-sample

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -15,7 +15,7 @@ OPENAI_API_KEY=sk-234234234234234234
1515
# AZURE_OPENAI_API_KEY=0123456789abcdefghijklmno
1616
# AZURE_OPENAI_API_INSTANCE_NAME=example-name
1717
# AZURE_OPENAI_API_DEPLOYMENT_NAME=gpt-35-turbo
18-
# AZURE_OPENAI_API_VERSION=2023-12-01-preview
18+
# AZURE_OPENAI_API_VERSION=2024-03-01-preview
1919

2020
# AZURE_OPENAI_IMAGE_API_KEY=0123456789abcdefghijklmno
2121
# AZURE_OPENAI_IMAGE_API_INSTANCE_NAME=example-name

‎README.md

Lines changed: 7 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
## Enhanced from the [original yGuy/chatgpt-mattermost-bot](https://github.com/yGuy/chatgpt-mattermost-bot)
22

3-
* Expimental support Cohere Command R+ and Google Gemini 1.5 Pro API. Text chat only.
3+
* Experimental support Cohere Command R+ that input is text only and Google Gemini 1.5 Pro API that can input text and image
44
* Support GPT-4V Vision API
55
+ Realization of multimodal text and images in conjunction with image plugins. **Limitation**: The plugins are not possible in threads that have been image attached, Under the 1106 gpt-4-vision-vewview.
66
![The screenshot depicts a fictional chat in Mattermost where a user asks a bot to describe a zoo scene, and to create an image that evokes positive emotions; the bot responds with a colorful zoo illustration and a vivid sunset beach scene.](./mattermost-gpt4v.png)
@@ -46,24 +46,24 @@ or when [running the docker image](#using-the-ready-made-docker-image) or when c
4646
| MATTERMOST_TOKEN | yes | `abababacdcdcd` | The authentication token from the logged in mattermost bot |
4747
| OPENAI_API_KEY | yes | `sk-234234234234234234` | The OpenAI API key to authenticate with OpenAI |
4848
| OPENAI_API_BASE | no | `http://example.com:8080/v1` | The address of an OpenAI compatible API. Overrides the default base path (`https://api.openai.com`) |
49-
| OPENAI_MODEL_NAME | no | `gpt-3.5-turbo` | The OpenAI or Cohere language model to use, defaults to `gpt-3.5-turbo` |
49+
| OPENAI_MODEL_NAME | no | `gpt-3.5-turbo` | The OpenAI or Cohere language model to use, defaults to `gpt-3.5-turbo` |
5050
| OPENAI_MAX_TOKENS | no | `2000` | The maximum number of tokens to pass to the OpenAI API, defaults to 2000 |
5151
| OPENAI_TEMPERATURE | no | `0.2` | The sampling temperature to use, between 0 and 2, defaults to 1. Higher values like 0.8 will make the output more random, while lower values like 0.2 will make it more focused and deterministic. |
5252
| MAX_PROMPT_TOKENS | no | `2096` | Maximum number of prompt tokens, default to 2000. For example on GPT-4 = 8196 - OPENAI_MAX_TOKENS. |
5353
| OPENAI_VISION_MODEL_NAME | no | `gpt-4-vision-preview` | The OpenAI VISION model to use, defaults to use OPENAI_MODEL_NAME. Use this when you want to change the model when attaching an image. |
5454
| OPENAI_IMAGE_MODEL_NAME | no | `dall-e-2` | The OpenAI IMAGE model to use, defaults to `dall-e-3` |
55-
| AZURE_OPENAI_API_KEY | no | `0123456789abcdefghijklmno` | The Azure OpenAI Service API key to authoenticate. If OPENAI_API_KEY is also set, the original OpenAI is used for vision or image generation. |
55+
| AZURE_OPENAI_API_KEY | no | `0123456789abcdefghijklmno` | The Azure OpenAI Service API key to authenticate. If OPENAI_API_KEY is also set, the original OpenAI is used for vision or image generation. |
5656
| AZURE_OPENAI_API_INSTANCE_NAME | no | `example-name` | The instance name on the Azure OpenAI Service |
5757
| AZURE_OPENAI_API_DEPLOYMENT_NAME | no | `gpt-35-turbo` | The name of the deployed model on the Azure OpenAI Service |
58-
| AZURE_OPENAI_API_VERSION | no | `2023-12-01-preview` | The Azure OpenAI version |
58+
| AZURE_OPENAI_API_VERSION | no | `2024-03-01-preview` | The Azure OpenAI version |
5959
| AZURE_OPENAI_API_VISION_KEY | no | `0123456789abcdefghijklmno` | The Azure OpenAI Service API key to authoenticate. If this is set, Azure OpenAI is used for vision. |
6060
| AZURE_OPENAI_API_VISION_INSTANCE_NAME | no | `example-name` | The instance name on the Azure OpenAI Service for Vision API if specially needed |
6161
| AZURE_OPENAI_API_VISION_DEPLOYMENT_NAME | no | `gpt-4v` | The name of the deployed model on the Azure OpenAI Service for Vision API if specially needed |
6262
| AZURE_OPENAI_API_IMAGE_KEY | no | `0123456789abcdefghijklmno` | The Azure OpenAI Service API key to authoenticate. If this is set, Azure OpenAI is used for image generation. |
6363
| AZURE_OPENAI_API_IMAGE_INSTANCE_NAME | no | `example-name` | The instance name on the Azure OpenAI Service for Image API if specially needed |
64-
| AZURE_OPENAI_API_IMAGE_DEPLOYMENT_NAME | no | `Dalle3` | The name of the deployed model on the Azure OpenAI Service for Iamge API if specially needed. DALL-E 3 require 2023-12-01-preview API Version at least |
65-
| COHERE_API_KEY | no | `0123456789abcdefghijklmno` | The Cohere API key to authoenticate. If OPENAI_API_KEY is also set, the original OpenAI is used for vision or image generation. |
66-
| GOOGLE_API_KEY | no | `0123456789abcdefghijklmno` | The Gemini API key to authoenticate. If OPENAI_API_KEY is also set, the original OpenAI is used for vision or image generation. Tested model is only 'gemini-1.5-pro-latest' |
64+
| AZURE_OPENAI_API_IMAGE_DEPLOYMENT_NAME | no | `Dalle3` | The name of the deployed model on the Azure OpenAI Service for Image API if specially needed. DALL-E 3 require 2023-12-01-preview API Version at least |
65+
| COHERE_API_KEY | no | `0123456789abcdefghijklmno` | The Cohere API key to authenticate. If OPENAI_API_KEY is also set, the original OpenAI is used for vision or image generation. |
66+
| GOOGLE_API_KEY | no | `0123456789abcdefghijklmno` | The Gemini API key to authenticate. If OPENAI_API_KEY is also set, the original OpenAI is used for vision or image generation. Tested model is only 'gemini-1.5-pro-latest'' |
6767
| YFILES_SERVER_URL | no | `http://localhost:3835` | The URL to the yFiles graph service for embedding auto-generated diagrams. |
6868
| NODE_EXTRA_CA_CERTS | no | `/file/to/cert.crt` | a link to a certificate file to pass to node.js for authenticating self-signed certificates |
6969
| MATTERMOST_BOTNAME | no | `"@chatgpt"` | the name of the bot user in Mattermost, defaults to '@chatgpt' |

‎compose.yaml

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
---
22
services:
33
chatcpt:
4-
image: ${CI_REGISTRY_IMAGE:-gitlab.example.com/user/chatgpt-mattermost-bot}:${CI_COMMIT_REF_NAME:+local}
4+
image: ${CI_REGISTRY_IMAGE:-gitlab.example.com/user/chatgpt-mattermost-bot}:${CI_COMMIT_REF_NAME:-local}
55
build:
66
context: .
77
args:
@@ -29,7 +29,7 @@ services:
2929
# DEBUG_COLORS: ${DEBUG_COLORS}
3030

3131
cohere:
32-
image: ${CI_REGISTRY_IMAGE:-gitlab.example.com/user/chatgpt-mattermost-bot}:${CI_COMMIT_REF_NAME:+local}
32+
image: ${CI_REGISTRY_IMAGE:-gitlab.example.com/user/chatgpt-mattermost-bot}:${CI_COMMIT_REF_NAME:-local}
3333
build:
3434
context: .
3535
args:
@@ -38,7 +38,7 @@ services:
3838
env_file: .env.cohere
3939

4040
gemini:
41-
image: ${CI_REGISTRY_IMAGE:-gitlab.example.com/user/chatgpt-mattermost-bot}:${CI_COMMIT_REF_NAME:+local}
41+
image: ${CI_REGISTRY_IMAGE:-gitlab.example.com/user/chatgpt-mattermost-bot}:${CI_COMMIT_REF_NAME:-local}
4242
build:
4343
context: .
4444
args:

0 commit comments

Comments
 (0)