TODO List for the first v0.1.0 release

[doujiang24]

• OpenAI protocol

  • improve openai-go to parsing data.

• Service discovery

  • support k8s service

• Load balancer

  • approximate cache-aware

• control plane

  • intergate istio

• CI

  • code coverage