Skip to content

Endpoint caching optimization #8

@velocitatem

Description

@velocitatem

image

Every time a DataStorage run endpoint is hit, the generation of the query can take a while. To speed this up we can:

  • Save the query with the request properties
  • Send a new endpoint back to the user (The user can then use the same link to get that data)

What would be nice if if we can modify the specific value of the request, and build a variable storage of the requests.

@startuml
User -> Server
Server -> LLM
LLM -> Server: DocumentDB Query String
Server -> DB: Executes
Server -> Cache: Stores the request and query
DB -> Server
Server -> User
== NEXT TIME ==
User -> Server
Server -> Cache: Redirects to the cache, rather than re-generate the query
Cache -> DB
DB -> Server
Server -> User
@enduml

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions