Skip to content

Commit 93dad6d

Browse files
daisyfaithaumadaisyfaithauma
authored
[AI Gateway] custom costs changelog (#16757)
* Added custom costs to changelog * Added custom costs to changelog
1 parent 1a0a258 commit 93dad6d

File tree

1 file changed

+71
-68
lines changed

1 file changed

+71
-68
lines changed

‎src/content/changelogs/ai-gateway.yaml‎

Lines changed: 71 additions & 68 deletions
Original file line numberDiff line numberDiff line change
@@ -5,72 +5,75 @@ productLink: "/ai-gateway/"
55
productArea: Developer platform
66
productAreaLink: /workers/platform/changelog/platform/
77
entries:
8+
- publish_date: "2024-09-10"
9+
title: Custom costs
10+
description: |-
11+
* **Configuration**: AI Gateway now allows you to set custom costs at the request level [custom costs](/ai-gateway/configuration/custom-costs/) to requests, accurately reflect your unique pricing, overriding the default or public model costs.
12+
- publish_date: "2024-08-02"
13+
title: Mistral AI
14+
description: |-
15+
* **Providers**: Added [Mistral AI](/ai-gateway/providers/mistral/) as a new provider.
816
9-
- publish_date: '2024-08-02'
10-
title: Mistral AI
11-
description: |-
12-
* **Providers**: Added [Mistral AI](/ai-gateway/providers/mistral/) as a new provider.
13-
14-
- publish_date: '2024-07-23'
15-
title: Google AI Studio
16-
description: |-
17-
* **Providers**: Added [Google AI Studio](/ai-gateway/providers/google-ai-studio/) as a new provider.
18-
19-
- publish_date: '2024-07-10'
20-
title: Custom metadata
21-
description: |-
22-
AI Gateway now supports adding [custom metadata](/ai-gateway/configuration/custom-metadata/) to requests, improving tracking and analysis of incoming requests.
23-
24-
- publish_date: '2024-07-09'
25-
title: Logs
26-
description: |-
27-
[Logs](/ai-gateway/observability/analytics/#logging) are now available for the last 24 hours.
28-
29-
- publish_date: '2024-06-24'
30-
title: Custom cache key headers
31-
description: |-
32-
AI Gateway now supports [custom cache key headers](/ai-gateway/configuration/caching/#custom-cache-key-cf-aig-cache-key).
33-
34-
- publish_date: '2024-06-18'
35-
title: Access an AI Gateway through a Worker
36-
description: |-
37-
Workers AI now natively supports [AI Gateway](/ai-gateway/providers/workersai/#worker).
38-
39-
- publish_date: '2024-05-22'
40-
title: AI Gateway is now GA
41-
description: |-
42-
AI Gateway is moving from beta to GA.
43-
44-
- publish_date: '2024-05-16'
45-
46-
description: |-
47-
* **Providers**: Added [Cohere](/ai-gateway/providers/cohere/) and [Groq](/ai-gateway/providers/groq/) as new providers.
48-
49-
- publish_date: '2024-05-09'
50-
51-
description: |-
52-
* Added new endpoints to the [REST API](/api/operations/aig-config-create-gateway).
53-
54-
- publish_date: '2024-03-26'
55-
56-
description: |-
57-
* [LLM Side Channel vulnerability fixed](https://blog.cloudflare.com/ai-side-channel-attack-mitigated)
58-
* **Providers**: Added Anthropic, Google Vertex, Perplexity as providers.
59-
60-
- publish_date: '2023-10-26'
61-
62-
description: |-
63-
* **Real-time Logs**: Logs are now real-time, showing logs for the last hour. If you have a need for persistent logs, please let the team know on Discord. We are building out a persistent logs feature for those who want to store their logs for longer.
64-
* **Providers**: Azure OpenAI is now supported as a provider!
65-
* **Docs**: Added Azure OpenAI example.
66-
* **Bug Fixes**: Errors with costs and tokens should be fixed.
67-
68-
- publish_date: '2023-10-09'
69-
70-
description: |-
71-
* **Logs**: Logs will now be limited to the last 24h. If you have a use case that requires more logging, please reach out to the team on Discord.
72-
* **Dashboard**: Logs now refresh automatically.
73-
* **Docs**: Fixed Workers AI example in docs and dash.
74-
* **Caching**: Embedding requests are now cacheable. Rate limit will not apply for cached requests.
75-
* **Bug Fixes**: Identical requests to different providers are not wrongly served from cache anymore. Streaming now works as expected, including for the Universal endpoint.
76-
* **Known Issues**: There's currently a bug with costs that we are investigating.
17+
- publish_date: "2024-07-23"
18+
title: Google AI Studio
19+
description: |-
20+
* **Providers**: Added [Google AI Studio](/ai-gateway/providers/google-ai-studio/) as a new provider.
21+
22+
- publish_date: "2024-07-10"
23+
title: Custom metadata
24+
description: |-
25+
AI Gateway now supports adding [custom metadata](/ai-gateway/configuration/custom-metadata/) to requests, improving tracking and analysis of incoming requests.
26+
27+
- publish_date: "2024-07-09"
28+
title: Logs
29+
description: |-
30+
[Logs](/ai-gateway/observability/analytics/#logging) are now available for the last 24 hours.
31+
32+
- publish_date: "2024-06-24"
33+
title: Custom cache key headers
34+
description: |-
35+
AI Gateway now supports [custom cache key headers](/ai-gateway/configuration/caching/#custom-cache-key-cf-aig-cache-key).
36+
37+
- publish_date: "2024-06-18"
38+
title: Access an AI Gateway through a Worker
39+
description: |-
40+
Workers AI now natively supports [AI Gateway](/ai-gateway/providers/workersai/#worker).
41+
42+
- publish_date: "2024-05-22"
43+
title: AI Gateway is now GA
44+
description: |-
45+
AI Gateway is moving from beta to GA.
46+
47+
- publish_date: "2024-05-16"
48+
49+
description: |-
50+
* **Providers**: Added [Cohere](/ai-gateway/providers/cohere/) and [Groq](/ai-gateway/providers/groq/) as new providers.
51+
52+
- publish_date: "2024-05-09"
53+
54+
description: |-
55+
* Added new endpoints to the [REST API](/api/operations/aig-config-create-gateway).
56+
57+
- publish_date: "2024-03-26"
58+
59+
description: |-
60+
* [LLM Side Channel vulnerability fixed](https://blog.cloudflare.com/ai-side-channel-attack-mitigated)
61+
* **Providers**: Added Anthropic, Google Vertex, Perplexity as providers.
62+
63+
- publish_date: "2023-10-26"
64+
65+
description: |-
66+
* **Real-time Logs**: Logs are now real-time, showing logs for the last hour. If you have a need for persistent logs, please let the team know on Discord. We are building out a persistent logs feature for those who want to store their logs for longer.
67+
* **Providers**: Azure OpenAI is now supported as a provider!
68+
* **Docs**: Added Azure OpenAI example.
69+
* **Bug Fixes**: Errors with costs and tokens should be fixed.
70+
71+
- publish_date: "2023-10-09"
72+
73+
description: |-
74+
* **Logs**: Logs will now be limited to the last 24h. If you have a use case that requires more logging, please reach out to the team on Discord.
75+
* **Dashboard**: Logs now refresh automatically.
76+
* **Docs**: Fixed Workers AI example in docs and dash.
77+
* **Caching**: Embedding requests are now cacheable. Rate limit will not apply for cached requests.
78+
* **Bug Fixes**: Identical requests to different providers are not wrongly served from cache anymore. Streaming now works as expected, including for the Universal endpoint.
79+
* **Known Issues**: There's currently a bug with costs that we are investigating.

0 commit comments

Comments
 (0)