|
| 1 | +# AI Quick Actions Release Notes |
| 2 | + |
| 3 | +## v1.0.6b (Released February 28, 2025) |
| 4 | +**Highlights:** |
| 5 | +- **Cached Model Upgrade:** |
| 6 | + - Introduced Llama 3.1 as a service cached model. |
| 7 | +- **Container Enhancements:** |
| 8 | + - Upgraded managed containers are now running [vLLM 0.7.1](https://github.com/vllm-project/vllm/releases/tag/v0.7.1) and [llama.cpp 0.3.2](https://github.com/abetlen/llama-cpp-python/releases/tag/v0.3.2). |
| 9 | + |
| 10 | +To get this version of AI Quick Actions, deactivate and reactivate your notebook sessions. |
| 11 | + |
| 12 | +For more details, refer to the corresponding [Oracle release notes](https://docs.oracle.com/en-us/iaas/releasenotes/data-science/ai-quick-actions-106-b.htm). |
| 13 | + |
| 14 | +--- |
| 15 | + |
| 16 | +## v1.0.6a (Released January 30, 2025) |
| 17 | +**Enhancements and Features:** |
| 18 | + |
| 19 | +- Expanded multiple inference endpoint support |
| 20 | + - You can now use the chat completion endpoint in the inference playground. |
| 21 | + - You can select Copy payload in the inference playground to get the model endpoint and get code sample to invoke the model with the CLI that corresponds to the completion or chat completion inference format. |
| 22 | +- Exclusion of files during model registration |
| 23 | + - You have the option to exclude files based on file format during the model registration process. This is helpful when you want to bring in a model from Hugging Face to AI Quick Actions and want to exclude certain files from being downloaded such as .txt and .pdf files. |
| 24 | +- Addition of copy model ocid feature in model details page |
| 25 | + - After registering the model, you can find and copy the model ocid in the model details page without navigating to the Console to find the model ocid. |
| 26 | +- Model details actions button UI changes |
| 27 | +- Tool calling support |
| 28 | + - AI Quick Actions now has a version of vllm container that supports tool calling capabilities. Tool calling lets a model invoke external functions during inference, enhancing its ability to provide context-specific answers. |
| 29 | + |
| 30 | +To get this version of AI Quick Actions, deactivate and reactivate your notebook sessions. |
| 31 | + |
| 32 | +For more details, refer to the corresponding [Oracle release notes](https://docs.oracle.com/en-us/iaas/releasenotes/data-science/aqua-106-a.htm). |
| 33 | + |
| 34 | +--- |
| 35 | + |
| 36 | +## v1.0.5 (Released January 30, 2025) |
| 37 | + |
| 38 | +**Enhancements and Features:** |
| 39 | +- Expanded multiple inference endpoint support |
| 40 | + - You can now use the chat completion endpoint in the inference playground. |
| 41 | + - You can select Copy payload in the inference playground to get the model endpoint and get code sample to invoke the model with the CLI that corresponds to the completion or chat completion inference format. |
| 42 | +- Exclusion of files during model registration |
| 43 | + - You have the option to exclude files based on file format during the model registration process. This is helpful when you want to bring in a model from Hugging Face to AI Quick Actions and want to exclude certain files from being downloaded such as .txt and .pdf files. |
| 44 | +- Addition of copy model ocid feature in model details page |
| 45 | + - After registering the model, you can find and copy the model ocid in the model details page without navigating to the Console to find the model ocid. |
| 46 | +- Model details actions button UI changes |
| 47 | +- Tool calling support |
| 48 | + - AI Quick Actions now has a version of vllm container that supports tool calling capabilities. Tool calling lets a model invoke external functions during inference, enhancing its ability to provide context-specific answers. |
| 49 | + |
| 50 | +To get this version of AI Quick Actions, deactivate and reactivate your notebook sessions. |
| 51 | + |
| 52 | +For more details, refer to the corresponding [Oracle release notes](https://docs.oracle.com/iaas/releasenotes/data-science/aqua-105-fast-follow.htm). |
| 53 | + |
| 54 | +--- |
| 55 | + |
| 56 | +## v1.0.4 (Released October 04, 2024) |
| 57 | + |
| 58 | +**Enhancements and Features:** |
| 59 | +- With AI Quick Actions v 1.0.4, Data Science now supports the following evaluation metrics: |
| 60 | + - perplexity score |
| 61 | + - text readability |
| 62 | +- The following ready to register models are now supported and are available in all regions bar in the EU: |
| 63 | + - meta-llama/Meta-Llama-3.1-8B |
| 64 | + - meta-llama/Meta-Llama-3.1-8B-Instruct |
| 65 | + - meta-llama/Meta-Llama-3.1-70B |
| 66 | + - meta-llama/Meta-Llama-3.1-70B-Instruct |
| 67 | + - meta-llama/Meta-Llama-3.1-405B-Instruct-FP8 |
| 68 | + - meta-llama/Meta-Llama-3.1-405B-FP8 |
| 69 | + - meta-llama/Llama-3.2-1B |
| 70 | + - meta-llama/Llama-3.2-1B-Instruct |
| 71 | + - meta-llama/Llama-3.2-3B |
| 72 | + - meta-llama/Llama-3.2-3B-Instruct |
| 73 | + - meta-llama/Llama-3.2-11B-Vision |
| 74 | + - meta-llama/Llama-3.2-90B-Vision |
| 75 | + - meta-llama/Llama-3.2-11B-Vision-Instruct |
| 76 | + - meta-llama/Llama-3.2-90B-Vision-Instruct |
| 77 | +To get this version of AI Quick Actions, deactivate and reactivate your notebook sessions. |
| 78 | + |
| 79 | +For more details, refer to the corresponding [Oracle release notes](https://docs.oracle.com/iaas/releasenotes/data-science/aqua-104.htm). |
| 80 | + |
| 81 | +--- |
| 82 | + |
| 83 | +## v1.0.3 (Released August 23, 2024) |
| 84 | + |
| 85 | +**Enhancements and Features:** |
| 86 | +- Arm compute shapes |
| 87 | +- The llama.cpp container |
| 88 | +- Importing models from Hugging Face. |
| 89 | + |
| 90 | + |
| 91 | +For more details, refer to the corresponding [Oracle release notes](https://docs.oracle.com/iaas/releasenotes/data-science/aqua-103.htm). |
| 92 | + |
| 93 | +--- |
0 commit comments