Cost Estimate #77
Description
Description
vCache should give a cost estimate.
Impact
- Who: End user
- What: Cost estimate
- Why: Value add
Proposed Solution
Stats engine should output approx cost savings based on model and input/output.
Acceptance Criteria
- Followed coding conventions
- Implemented or updated tests
- Input: Model, token input/output
- Output: Cost without cache, Cost with cache,...
Risks & Dependencies
That this works across models
Additional Context
--