v0.0.0.beta12

What's Changed

• Enhancements to hosting docs. by @acmatscale in #124
• Fix CI run_unit_tests_server by @ruizehung-scale in #123
• Updates to cookbook by @seanshi-scale in #127
• Update README.md by @rkaplan in #126
• Play With It section in self hosting doc by @ruizehung-scale in #128
• Documentation update for llama-v2 by @yunfeng-scale in #129
• Update cookbook for llamav2 by @seanshi-scale in #130
• Doc enhancements to use llama-2 by @acmatscale in #131
• Clarified current self-hosting features. by @acmatscale in #134
• Add more models to model zoo by @yunfeng-scale in #135
• Add back Model.create by @yunfeng-scale in #125
• Update allowed types on hyperparameter values by @seanshi-scale in #140
• Can create LLM endpoints by @ruizehung-scale in #132
• Refetch API key dynamically by @jihan-yin in #142
• Add fine_tuned_model field to Get/ListFineTuneResponse by @seanshi-scale in #145
• Update fine_tuning.md by @gargutsav in #147
• Bump pip package version from 0.0.0.beta3 -> 0.0.0.beta4 by @song-william in #154
• Example notebook for fine-tuning Llama-2 7B on ScienceQA by @jihan-yin in #148
• Bump version to 0.0.0b5 by @seanshi-scale in #158
• Add llm endpoint creation and inference sample code to self hosting d… by @ruizehung-scale in #153
• Patch Integration Test in CI by @song-william in #161
• updating fine_tune_id to id by @ian-scale in #174
• Update unit test instruction by @ruizehung in #176
• Add llm-engine suffix to Spellbook URL by @squeakymouse in #173
• adding required dependency installs to scienceqa by @ian-scale in #177
• fix fine_tune_id to be id in scienceqa example by @ian-scale in #179
• Bump version to 0.0.0.beta7 by @squeakymouse in #178
• updating api key settings so that we can set api key without environm… by @ian-scale in #180
• Correct A100 tag by @yunfeng-scale in #183
• Support checkpoint_path for endpoint creation by @yunfeng-scale in #181
• Fix typo in roles.py by @eltociear in #150
• Bump aiohttp from 3.8.4 to 3.8.5 in /clients/python by @dependabot in #151
• Add llama 2 70B in model zoo by @yunfeng-scale in #185
• Add CNAME to docs by @phil-scale in #191
• File API functions by @squeakymouse in #160
• Fix File documentation by @squeakymouse in #192
• Deploy docs from CI by @phil-scale in #190
• Some improvements to completions APIs by @yunfeng-scale in #194
• bump beta8 -> beta9 by @song-william in #195
• Link to HF greedy search by @yunfeng-scale in #198
• Integrate finetune with wandb by @yunfeng-scale in #199
• Bump version by @yunfeng-scale in #201
• Add documentation on pointing llmengine client to self-hosted infrastructure by @ruizehung-scale in #200
• adding status field to model get response by @ian-scale in #202
• Add integrations doc page by @yunfeng-scale in #203
• Update docs to reflect maximum suffix length by @seanshi-scale in #207
• adding download api to launch client, updating example by @ian-scale in #196
• Ianmacleod/update download docs by @ian-scale in #210
• Faster s5cmd download by @yunfeng-scale in #212
• Latest model-engine updates by @phil-scale in #214
• Bump aiohttp from 3.8.4 to 3.8.5 in /model-engine by @dependabot in #217
• Bump waitress from 2.0.0 to 2.1.2 in /model-engine/model_engine_server/inference by @dependabot in #215
• Bump certifi from 2023.5.7 to 2023.7.22 in /clients/python by @dependabot in #216
• Bump certifi from 2023.5.7 to 2023.7.22 in /model-engine by @dependabot in #218
• Add readme to model-engine folder by @phil-scale in #220
• Add pre-commit hooks for mypy, semgrep, and trufflehog by @phil-scale in #219
• Fix docs building by @phil-scale in #223
• Update service template by @yunfeng-scale in #222
• Ensure successful helm installation in integration test by @phil-scale in #224
• Update helm charts by @phil-scale in #226
• Fix API calls on Windows by @saiatmakuri in #225
• Sync scale from zero, part 1 by @seanshi-scale in #229
• Doc add fine tune support for llama 2 70b by @yunfeng-scale in #232
• add file upload guidance to fine-tune docs by @saiatmakuri in #231
• Update LICENSE by @saiatmakuri in #235

New Contributors

• @acmatscale made their first contribution in #124
• @jihan-yin made their first contribution in #142
• @ian-scale made their first contribution in #174
• @ruizehung made their first contribution in #176
• @eltociear made their first contribution in #150
• @saiatmakuri made their first contribution in #225

Full Changelog: https://github.com/scaleapi/llm-engine/commits/v0.0.0.beta12