Skip to content

Commit 80ff4ce

Browse files
authored
Merge pull request #207708 from santiagxf/santiagxf/aml-mlflow-view-metrics
AML MLflow refactor of log metrics
2 parents 17ffd3e + 88d5d46 commit 80ff4ce

File tree

7 files changed

+159
-147
lines changed

7 files changed

+159
-147
lines changed

articles/machine-learning/how-to-deploy-mlflow-models.md

Lines changed: 11 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -26,23 +26,16 @@ In this article, learn how to deploy your [MLflow](https://www.mlflow.org) model
2626
For no-code-deployment, Azure Machine Learning
2727

2828
* Dynamically installs Python packages provided in the `conda.yaml` file, this means the dependencies are installed during container runtime.
29-
* The base container image/curated environment used for dynamic installation is `mcr.microsoft.com/azureml/mlflow-ubuntu18.04-py37-cpu-inference` or `AzureML-mlflow-ubuntu18.04-py37-cpu-inference`
3029
* Provides a MLflow base image/curated environment that contains the following items:
3130
* [`azureml-inference-server-http`](how-to-inference-server-http.md)
3231
* [`mlflow-skinny`](https://github.com/mlflow/mlflow/blob/master/README_SKINNY.rst)
33-
* `pandas`
3432
* The scoring script baked into the image.
3533

3634
> [!IMPORTANT]
3735
> If you are used to deploying models using scoring scripts and custom environments and you are looking to know how to achieve the same functionality using MLflow models, we recommend reading [Using MLflow models for no-code deployment](how-to-log-mlflow-models.md).
3836
3937
> [!NOTE]
40-
> Consider the following limitations when deploying MLflow models to Azure Machine Learning:
41-
> - Spark flavor is not supported at the moment for deployment.
42-
> - Data type `mlflow.types.DataType.Binary` is not supported as column type in signatures. For models that work with images, we suggest you to use or (a) tensors inputs using the [TensorSpec input type](https://mlflow.org/docs/latest/python_api/mlflow.types.html#mlflow.types.TensorSpec), or (b) `Base64` encoding schemes with a `mlflow.types.DataType.String` column type, which is commonly used when there is a need to encode binary data that needs be stored and transferred over media.
43-
> - Signatures with tensors with unspecified shapes (`-1`) is only supported at the batch size by the moment. For instance, a signature with shape `(-1, -1, -1, 3)` is not supported but `(-1, 300, 300, 3)` is.
44-
45-
For more information about how to specify requests to online endpoints, view [Considerations when deploying to real-time inference](#considerations-when-deploying-to-real-time-inference). For more information about the supported file types in batch endpoints, view [Considerations when deploying to batch inference](#considerations-when-deploying-to-batch-inference).
38+
> For information about inputs format and limitation in online endpoints, view [Considerations when deploying to real-time inference](#considerations-when-deploying-to-real-time-inference). For more information about the supported file types in batch endpoints, view [Considerations when deploying to batch inference](#considerations-when-deploying-to-batch-inference).
4639
4740
## Deployment tools
4841

@@ -408,6 +401,16 @@ Your inputs should be submitted inside a JSON payload containing a dictionary wi
408401
}
409402
```
410403

404+
### Limitations
405+
406+
The following limitations apply to real time inference deployments:
407+
408+
> [!NOTE]
409+
> Consider the following limitations when deploying MLflow models to Azure Machine Learning:
410+
> - Spark flavor is not supported at the moment for deployment.
411+
> - Data type `mlflow.types.DataType.Binary` is not supported as column type in signatures. For models that work with images, we suggest you to use or (a) tensors inputs using the [TensorSpec input type](https://mlflow.org/docs/latest/python_api/mlflow.types.html#mlflow.types.TensorSpec), or (b) `Base64` encoding schemes with a `mlflow.types.DataType.String` column type, which is commonly used when there is a need to encode binary data that needs be stored and transferred over media.
412+
> - Signatures with tensors with unspecified shapes (`-1`) is only supported at the batch size by the moment. For instance, a signature with shape `(-1, -1, -1, 3)` is not supported but `(-1, 300, 300, 3)` is.
413+
411414
## Considerations when deploying to batch inference
412415

413416
Azure Machine Learning supports no-code deployment for batch inference in [managed endpoints](concept-endpoints.md). This represents a convenient way to deploy models that require processing of big amounts of data in a batch-fashion.

0 commit comments

Comments
 (0)