Merge branch 'main' of https://github.com/MicrosoftDocs/azure-stack-docs-pr into amlfs-templates

Author: pauljewellmsft

.openpublishing.publish.config.json

@@ -92,6 +92,12 @@
       "branch": "main",
       "branch_mapping": {}
     },
+    {
+      "path_to_root": "azure-reference-other-repo",
+      "url": "https://github.com/MicrosoftDocs/azure-reference-other-pr",
+      "branch": "main",
+      "branch_mapping": {}
+    },
     {
       "path_to_root": "quickstart-templates",
       "url": "https://github.com/Azure/azure-quickstart-templates",

azure-managed-lustre/TOC.yml

@@ -44,6 +44,12 @@
       href: configure-network-security-group.md
     - name: Use customer-managed encryption keys
       href: customer-managed-encryption-keys.md
+- name: Monitoring metrics and logs
+  items:
+    - name: Monitor a file system
+      href: monitor-file-system.md
+    - name: Monitoring reference for metrics and logs
+      href: monitor-file-system-reference.md
 - name: Availability and disaster recovery
   items:
   - name: Recover from a regional outage

azure-managed-lustre/monitor-file-system-reference.md

@@ -0,0 +1,62 @@
+---
+title: Monitoring data reference for Azure Managed Lustre
+description: This article contains important reference material you need when you monitor Azure Managed Lustre.
+ms.date: 08/16/2024
+ms.custom: horz-monitor
+ms.topic: reference
+author: pauljewellmsft
+ms.author: pauljewell
+ms.service: azure-managed-lustre
+---
+
+# Azure Managed Lustre monitoring data reference
+
+[!INCLUDE [horz-monitor-ref-intro](~/../azure-stack/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-ref-intro.md)]
+
+See [Monitor Azure Managed Lustre](monitor-file-system.md) for details on the data you can collect for Azure Managed Lustre and how to use it.
+
+[!INCLUDE [horz-monitor-ref-metrics-intro](~/../azure-stack/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-ref-metrics-intro.md)]
+
+### Supported metrics for Microsoft.StorageCache/amlFilesystems
+
+The following table lists the metrics available for the Microsoft.StorageCache/amlFilesystems resource type.
+
+[!INCLUDE [horz-monitor-ref-metrics-tableheader](~/../azure-stack/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-ref-metrics-tableheader.md)]
+
+[!INCLUDE [Microsoft.StorageCache/amlFilesystems](~/../azure-reference-other-repo/azure-monitor-ref/supported-metrics/includes/microsoft-storagecache-amlfilesystems-metrics-include.md)]
+
+> [!NOTE]
+> The metric `OSTBytesUsed` represents the total capacity consumed on the file system, including all metadata and overhead associated with the files. The value for `OSTBytesUsed` might be greater than the result of running `lfs df` on the file system, as `df` output for **Used** only attempts to capture the data that the end user has placed on the file system.
+
+[!INCLUDE [horz-monitor-ref-metrics-dimensions-intro](~/../azure-stack/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-ref-metrics-dimensions-intro.md)]
+
+[!INCLUDE [horz-monitor-ref-metrics-dimensions](~/../azure-stack/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-ref-metrics-dimensions.md)]
+
+### Dimensions specific to Azure Managed Lustre
+
+| Dimension name | Description |
+| --- | --- |
+| `ostnum` | Object Storage Target (OST) index number |
+| `mdtnum` | Metadata Target (MDT) index number |
+| `operation` | Type of operation performed |
+
+### Supported resource logs for Microsoft.StorageCache/amlFilesystems
+
+[!INCLUDE [Microsoft.StorageCache/amlFilesystems](~/../azure-reference-other-repo/azure-monitor-ref/supported-logs/includes/microsoft-storagecache-amlfilesystems-logs-include.md)]
+
+### Azure Monitor Logs tables
+
+This section lists the Azure Monitor Logs tables relevant to this service, which are available for query by Log Analytics using Kusto queries.
+
+- [AFSAuditLogs](/azure/azure-monitor/reference/tables/AFSAuditLogs)
+- [AzureActivity](/azure/azure-monitor/reference/tables/azureactivity)
+- [AzureMetrics](/azure/azure-monitor/reference/tables/azuremetrics)
+
+[!INCLUDE [horz-monitor-ref-activity-log](~/../azure-stack/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-ref-activity-log.md)]
+
+- [Microsoft.StorageCache permissions](/azure/role-based-access-control/permissions/storage#microsoftstoragecache)
+
+## Related content
+
+- See [Monitor Azure Managed Lustre](monitor-file-system.md) for a description of monitoring Azure Managed Lustre.
+- See [Monitor Azure resources with Azure Monitor](/azure/azure-monitor/essentials/monitor-azure-resource) for details on monitoring Azure resources.

azure-managed-lustre/monitor-file-system.md

@@ -0,0 +1,80 @@
+---
+title: Monitor Azure Managed Lustre
+description: Start here to learn how to monitor Azure Managed Lustre.
+ms.date: 08/16/2024
+ms.custom: horz-monitor
+ms.topic: conceptual
+author: pauljewellmsft
+ms.author: pauljewell
+ms.service: azure-managed-lustre
+---
+
+# Monitor Azure Managed Lustre
+
+[!INCLUDE [horz-monitor-intro](~/../azure-stack/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-intro.md)]
+
+[!INCLUDE [horz-monitor-resource-types](~/../azure-stack/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-resource-types.md)]
+
+For more information about the resource types for Azure Managed Lustre, see [Azure Managed Lustre monitoring data reference](monitor-file-system-reference.md).
+
+[!INCLUDE [horz-monitor-data-storage](~/../azure-stack/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-data-storage.md)]
+
+[!INCLUDE [horz-monitor-platform-metrics](~/../azure-stack/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-platform-metrics.md)]
+
+For a list of available metrics for Azure Managed Lustre, see [Azure Managed Lustre monitoring data reference](monitor-file-system-reference.md#metrics).
+
+[!INCLUDE [horz-monitor-resource-logs](~/../azure-stack/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-resource-logs.md)]
+
+For the available resource log categories, their associated Log Analytics tables, and the log schemas for Azure Managed Lustre, see [Azure Managed Lustre monitoring data reference](monitor-file-system-reference.md#supported-resource-logs-for-microsoftstoragecacheamlfilesystems).
+
+[!INCLUDE [horz-monitor-activity-log](~/../azure-stack/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-activity-log.md)]
+
+[!INCLUDE [horz-monitor-analyze-data](~/../azure-stack/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-analyze-data.md)]
+
+[!INCLUDE [horz-monitor-external-tools](~/../azure-stack/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-external-tools.md)]
+
+[!INCLUDE [horz-monitor-kusto-queries](~/../azure-stack/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-kusto-queries.md)]
+
+This section shows queries that you can enter in the **Log search** bar to help you monitor your Managed Lustre file system.
+
+- **Aggregate operations query**: List all the UnsuspendAmlFilesystem requests for a given time duration.
+
+    ```kusto
+    AFSAuditLogs
+    // The OperationName below can be replaced by obtain other operations such as "RebootAmlFilesystemNode" or "AmlFSRefreshHSMToken".
+    | where OperationName has "UnsuspendAmlFilesystem"
+    | project TimeGenerated, _ResourceId, ActivityId, ResultSignature, ResultDescription, Location
+    | sort by TimeGenerated asc
+    | limit 100
+    ```
+
+- **Unauthorized requests query**: Count of failed AMLFilesystems requests due to unauthorized access.
+
+    ```kusto
+    AFSAuditLogs
+    // 401 below could be replaced by other result signatures to obtain different operation results.
+    // For example, 'ResultSignature == 202' to obtain accepted requests.
+    | where ResultSignature == 401
+    | summarize count() by _ResourceId, OperationName
+    ```
+
+[!INCLUDE [horz-monitor-alerts](~/../azure-stack/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-alerts.md)]
+
+### Azure Managed Lustre alert rules
+
+The following table lists some suggested alert rules for Azure Managed Lustre. The alerts in this table are just examples. You can set alerts for any metric, log entry, or activity log entry listed in the [Azure Managed Lustre monitoring data reference](monitor-file-system-reference.md).
+
+| Alert type | Condition | Description  |
+| --- | --- | --- |
+| Metric | (**OST Bytes Used** / **OST Bytes Total**) > 0.85 | Storage capacity usage for the file system has exceeded 85% of total|
+| Metric | (**OST Files Used** / **OST Files Total**) > 0.85 | Number of files in the file system has exceeded 85% of total |
+
+> [!NOTE]
+> The threshold value of 85% is used as an example to show an alert before the file system reaches full capacity. You can adjust the threshold based on your requirements.
+
+[!INCLUDE [horz-monitor-advisor-recommendations](~/../azure-stack/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-advisor-recommendations.md)]
+
+## Related content
+
+- See [Azure Managed Lustre monitoring data reference](monitor-file-system-reference.md) for a reference of the metrics, logs, and other important values created for Azure Managed Lustre.
+- See [Monitoring Azure resources with Azure Monitor](/azure/azure-monitor/essentials/monitor-azure-resource) for general details on monitoring Azure resources.

azure-stack/hci/upgrade/about-upgrades-23h2.md

@@ -21,10 +21,10 @@ Throughout this article, we refer to Azure Stack HCI, version 23H2 as the *new*
 
 Azure Stack HCI, version 23H2 is the latest version of the Azure Stack HCI solution. This version integrates the Azure Arc infrastructure that provisions and manages the workloads such as Arc VMs, Azure Kubernetes Services, and Azure Virtual Desktop. For more information, see [What's new in Azure Stack HCI, version 23H2](../whats-new.md#features-and-improvements-in-2311).
 
-With version 23H2, Azure Stack HCI evolved from a cloud connected operating system (OS) to an Arc enabled solution. The OS forms the base layer of this solution, with the Arc and the Orchestrator (also known as the Lifecycle Manager) components layered on top. These components are packaged together into a solution that follows an [Infrastructure as code (IaC)](/devops/deliver/what-is-infrastructure-as-code) model.
+With version 23H2, Azure Stack HCI evolved from a cloud-connected operating system (OS) to an Arc-enabled solution. The OS forms the base layer of this solution, with the Arc and the Orchestrator (also known as the Lifecycle Manager) components layered on top. These components are packaged together into a solution that follows an [Infrastructure as code (IaC)](/devops/deliver/what-is-infrastructure-as-code) model.
 
-- This IaC model takes a set of input parameters that are specific to each customer and the environment.
-- The lifecycle manager then orchestrates the desired state across all the layers to meet the desired state and the version.
+- This IaC model takes a set of input parameters that are specific to each customer and environment.
+- The lifecycle manager then orchestrates the desired state across all the layers to meet the desired state and version.
 
 The following diagram illustrates the components of an Azure Stack HCI, version 23H2 system:
 
@@ -34,15 +34,15 @@ The following diagram illustrates the components of an Azure Stack HCI, version
 
 An upgrade is a whole new version of software that represents a significant change or major improvement. An update, on the other hand, is a process of applying a set of changes to the software to improve its performance, security, or stability.
 
-The Azure Stack HCI, version 23H2, is a whole new version of the solution with a multitude of new capabilities. To move from Azure Stack HCI, version 22H2 to version 23H2, you need to upgrade your existing cluster. On the other hand, to ensure that you have the most recent features and security improvements for your current version of Azure Stack HCI, you would need to update your existing cluster.
+Azure Stack HCI, version 23H2, is a whole new version of the solution with a multitude of new capabilities. To move from Azure Stack HCI, version 22H2 to version 23H2, you need to upgrade your existing cluster. On the other hand, to ensure that you have the most recent features and security improvements for your current version of Azure Stack HCI, you would need to update your existing cluster.
 
 ## High-level steps for Azure Stack HCI upgrade
 
 To upgrade your Azure Stack HCI from an old version, follow these high-level steps:
 
 1. Upgrade the *old* OS to the *new* OS using one of the following methods:
-    - [Via the PowerShell (recommended)](./upgrade-22h2-to-23h2-powershell.md).
-    - [Via the Windows Admin Center](./upgrade-22h2-to-23h2-windows-admin-center.md).
+    - [Via PowerShell (recommended)](./upgrade-22h2-to-23h2-powershell.md).
+    - [Via Windows Admin Center](./upgrade-22h2-to-23h2-windows-admin-center.md).
     - [Via other manual methods](./upgrade-22h2-to-23h2-other-methods.md).
 
 1. Perform post-OS upgrade tasks.
@@ -55,9 +55,12 @@ The following diagram illustrates the Azure Stack HCI upgrade process:
 
 :::image type="content" source="./media/about-upgrades-23h2/update-os-to-23h2-and-apply-the-solution-update.png" alt-text="Diagram that illustrates the two steps to update the Azure Stack HCI OS and then apply the solution update." lightbox="./media/about-upgrades-23h2/update-os-to-23h2-and-apply-the-solution-update.png":::
 
+> [!IMPORTANT]
+> If you were running AKS workloads on your Azure Stack HCI cluster, you must remove Azure Kubernetes Service and all the settings from AKS enabled by Azure Arc before you apply the solution upgrade. Kubernetes versions are incompatible between Azure Stack HCI, version 22H2, and version 23H2. Additionally, Preview versions of Arc VMs can't be updated.
+
 ## Next steps
 
 Choose one of the following options to upgrade your Azure Stack HCI, version 22H2 to Azure Stack HCI, version 23H2:
 - [Use PowerShell](./upgrade-22h2-to-23h2-powershell.md).
 - [Use Windows Admin Center](./upgrade-22h2-to-23h2-windows-admin-center.md).
-- [Use other methods](./upgrade-22h2-to-23h2-other-methods.md).
+- [Use other methods](./upgrade-22h2-to-23h2-other-methods.md).

azure-stack/hci/upgrade/post-upgrade-steps.md

@@ -35,7 +35,7 @@ Before you begin, make sure that:
 
 Follow these steps on your client to connect to one of the servers of your Azure Stack HCI cluster.
 
-1. Run PowerShell as administrator on the client that you're using to connect to your cluster.
+1. Run PowerShell as Administrator on the client that you're using to connect to your cluster.
 2. Open a remote PowerShell session to a server on your Azure Stack HCI cluster. Run the following command and provide the credentials of your server when prompted:
 
    ```powershell
@@ -140,4 +140,4 @@ You're now ready to apply the solution upgrade.
 ## Next steps
 
 - [Optional: Install and enable Network ATC on your cluster.](./install-enable-network-atc.md)
-- [Learn how to assess the solution upgrade readiness.](./validate-solution-upgrade-readiness.md)
+- [Learn how to assess the solution upgrade readiness.](./validate-solution-upgrade-readiness.md)