v0.0.0beta28

What's Changed

• Tool completion respect num new tokens by @yunfeng-scale in #469
• Azure fixes + additional asks by @squeakymouse in #468
• Metrics for stuck async requests by @squeakymouse in #471
• Fix cacher by @yunfeng-scale in #472
• Add retries to deflake integration tests by @squeakymouse in #473
• add suffix to integration tests by @saiatmakuri in #474
• fix docs tests gateway endpoint by @saiatmakuri in #475
• Guided decoding by @yunfeng-scale in #476

Full Changelog: v0.0.0beta27...v0.0.0beta28