|
| 1 | +--- |
| 2 | +title: What's new in Azure AI Studio? |
| 3 | +titleSuffix: Azure AI Studio |
| 4 | +description: This article provides you with information about new releases and features. |
| 5 | +manager: nitinme |
| 6 | +keywords: Release notes |
| 7 | +ms.service: azure-ai-studio |
| 8 | +ms.topic: overview |
| 9 | +ms.date: 2/7/2024 |
| 10 | +ms.reviewer: eur |
| 11 | +ms.author: eur |
| 12 | +author: eric-urban |
| 13 | +--- |
| 14 | + |
| 15 | +# What's new in Azure AI Studio? |
| 16 | + |
| 17 | +[!INCLUDE [Azure AI Studio preview](./includes/preview-ai-studio.md)] |
| 18 | + |
| 19 | +Azure AI Studio is updated on an ongoing basis. To stay up-to-date with recent developments, this article provides you with information about new releases and features. |
| 20 | + |
| 21 | +## February 2024 |
| 22 | + |
| 23 | +### Azure AI hub |
| 24 | + |
| 25 | +Azure AI resource is renamed Azure AI hub resource. For additional information about the Azure AI hub resource, check out [the Azure AI hub resource documentation](./concepts/ai-resources.md). |
| 26 | + |
| 27 | +## January 2024 |
| 28 | + |
| 29 | +### Benchmarks |
| 30 | + |
| 31 | +New models, datasets, and metrics are released for benchmarks. For additional information about the benchmarks experience, check out [the model catalog documentation](./how-to/model-catalog.md). |
| 32 | + |
| 33 | +Added models: |
| 34 | +- `microsoft-phi-2` |
| 35 | +- `mistralai-mistral-7b-instruct-v01` |
| 36 | +- `mistralai-mistral-7b-v01` |
| 37 | +- `codellama-13b-hf` |
| 38 | +- `codellama-13b-instruct-hf` |
| 39 | +- `codellama-13b-python-hf` |
| 40 | +- `codellama-34b-hf` |
| 41 | +- `codellama-34b-instruct-hf` |
| 42 | +- `codellama-34b-python-hf` |
| 43 | +- `codellama-7b-hf` |
| 44 | +- `codellama-7b-instruct-hf` |
| 45 | +- `codellama-7b-python-hf` |
| 46 | + |
| 47 | +Added datasets: |
| 48 | +- `truthfulqa_generation` |
| 49 | +- `truthfulqa_mc1` |
| 50 | + |
| 51 | +Added metrics: |
| 52 | +- `Coherence` |
| 53 | +- `Fluency` |
| 54 | +- `GPTSimilarity` |
| 55 | + |
| 56 | +## November 2023 |
| 57 | + |
| 58 | +### Benchmarks |
| 59 | + |
| 60 | +Benchmarks are released as public preview in Azure AI Studio. For additional information about the Benchmarks experience, check out [the model catalog documentation](./how-to/model-catalog.md). |
| 61 | + |
| 62 | +Added models: |
| 63 | +- `gpt-35-turbo-0301` |
| 64 | +- `gpt-4-0314` |
| 65 | +- `gpt-4-32k-0314` |
| 66 | +- `llama-2-13b-chat` |
| 67 | +- `llama-2-13b` |
| 68 | +- `llama-2-70b-chat` |
| 69 | +- `llama-2-70b` |
| 70 | +- `llama-2-7b-chat` |
| 71 | +- `llama-2-7b` |
| 72 | + |
| 73 | +Added datasets: |
| 74 | +- `boolq` |
| 75 | +- `gsm8k` |
| 76 | +- `hellaswag` |
| 77 | +- `human_eval` |
| 78 | +- `mmlu_humanities` |
| 79 | +- `mmlu_other` |
| 80 | +- `mmlu_social_sciences` |
| 81 | +- `mmlu_stem` |
| 82 | +- `openbookqa` |
| 83 | +- `piqa` |
| 84 | +- `social_iqa` |
| 85 | +- `winogrande` |
| 86 | + |
| 87 | +Added tasks: |
| 88 | +- `Question Answering` |
| 89 | +- `Text Generation` |
| 90 | + |
| 91 | +Added metrics: |
| 92 | +- `Accuracy` |
| 93 | + |
| 94 | +## Related content |
| 95 | + |
| 96 | +- Learn more about the [Azure AI Studio](./what-is-ai-studio.md). |
| 97 | +- Learn about [what's new in Azure OpenAI Service](../ai-services/openai/whats-new.md). |
0 commit comments