Skip to content

Conversation

@kathayl
Copy link
Contributor

@kathayl kathayl commented Nov 5, 2024

caching updates

Summary

Screenshots (optional)

Documentation checklist

  • The documentation style guide has been adhered to.
  • If a larger change - such as adding a new page- an issue has been opened in relation to any incorrect or out of date information that this PR fixes.
  • Files which have changed name or location have been allocated redirects.

@kathayl kathayl requested review from a team, G4brym, daisyfaithauma and mchenco as code owners November 5, 2024 23:33
@github-actions github-actions bot added product:ai-gateway AI Gateway: https://developers.cloudflare.com/ai-gateway/ size/s labels Nov 5, 2024
@kathayl
Copy link
Contributor Author

kathayl commented Nov 5, 2024

I've updated the page with

  1. the new updated headers
  2. the minimum time to live of 60 seconds and max of 1 month
  3. changed the example from milliseconds to seconds

Daisy, can you

  1. figure out how the best way to say that the old headers still work but we have new names. While the old headers will still work, we recommend updating to the new headers to ensure compatibility with future releases:
  • cf-cache-ttl has been replaced by cf-aig-cache-ttl
  • cf-skip-cache has been replaced by cf-aig-skip-cache
  1. need to add this note in about caching behavior
    Note: Cache in AI Gateway is volatile. If two identical requests are sent simultaneously, the first request may not cache in time for the second to use it, causing the second request to retrieve data from the original source.

@cloudflare-workers-and-pages
Copy link

cloudflare-workers-and-pages bot commented Nov 5, 2024

Deploying cloudflare-docs with  Cloudflare Pages  Cloudflare Pages

Latest commit: 2dd89df
Status: ✅  Deploy successful!
Preview URL: https://c0e26026.cloudflare-docs-7ou.pages.dev
Branch Preview URL: https://kathayl-patch-1.cloudflare-docs-7ou.pages.dev

View logs

@github-actions
Copy link
Contributor

github-actions bot commented Nov 5, 2024

Copy link
Contributor

@hyperlint-ai hyperlint-ai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

2 files reviewed, 1 total issue(s) found.

Co-authored-by: hyperlint-ai[bot] <154288675+hyperlint-ai[bot]@users.noreply.github.com>
Copy link
Contributor

@hyperlint-ai hyperlint-ai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

2 files reviewed, 1 total issue(s) found.

@kathayl kathayl merged commit 28a0806 into production Nov 8, 2024
13 checks passed
@kathayl kathayl deleted the kathayl-patch-1 branch November 8, 2024 18:22
harshil1712 pushed a commit that referenced this pull request Dec 3, 2024
* Update limits.mdx

* Edited footnotes

* Update caching.mdx

caching updates

* Update caching.mdx

* Update src/content/docs/ai-gateway/reference/limits.mdx

Co-authored-by: hyperlint-ai[bot] <154288675+hyperlint-ai[bot]@users.noreply.github.com>

* merge conflict

* merge conflict

* merge conflict

---------

Co-authored-by: daisyfaithauma <[email protected]>
Co-authored-by: hyperlint-ai[bot] <154288675+hyperlint-ai[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

product:ai-gateway AI Gateway: https://developers.cloudflare.com/ai-gateway/ size/s

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants