You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/ai-studio/concepts/fine-tuning-overview.md
+15-3Lines changed: 15 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -99,6 +99,7 @@ There isn't a single right answer to this question, but you should have clearly
99
99
100
100
Now that you know when to leverage fine-tuning for your use-case, you can go to Azure AI Studio to find several models available to fine-tune including:
101
101
- Azure OpenAI models
102
+
- Phi-3 family of models
102
103
- Meta Llama 2 family models
103
104
- Meta Llama 3.1 family of models
104
105
@@ -119,22 +120,33 @@ The following Azure OpenAI models are supported in Azure AI Studio for fine-tuni
119
120
120
121
Please note for fine-tuning Azure OpenAI models, you must add a connection to an Azure OpenAI resource with a supported region to your project.
121
122
123
+
### Phi-3 family models
124
+
The following Phi-3 family models are supported in Azure AI Studio for fine-tuning:
125
+
-`Phi-3-mini-4k-instruct`
126
+
-`Phi-3-mini-128k-instruct`
127
+
-`Phi-3-medium-4k-instruct`
128
+
-`Phi-3-medium-128k-instruct`
129
+
130
+
Fine-tuning of Phi-3 models is currently supported in projects located in East US2.
131
+
122
132
### Llama 2 family models
123
133
The following Llama 2 family models are supported in Azure AI Studio for fine-tuning:
124
134
-`Meta-Llama-2-70b`
125
135
-`Meta-Llama-2-7b`
126
136
-`Meta-Llama-2-13b`
127
137
128
-
Fine-tuning of Llama 2 models is currently supported in projects located in West US 3.
138
+
Fine-tuning of Llama 2 models is currently supported in projects located in West US3.
129
139
130
140
### Llama 3.1 family models
131
141
The following Llama 3.1 family models are supported in Azure AI Studio for fine-tuning:
132
142
-`Meta-Llama-3.1-70b-Instruct`
133
-
-`Meta-Llama-3.1-7b-Instruct`
143
+
-`Meta-Llama-3.1-8b-Instruct`
134
144
135
-
Fine-tuning of Llama 3.1 models is currently supported in projects located in West US 3.
145
+
Fine-tuning of Llama 3.1 models is currently supported in projects located in West US3.
136
146
137
147
## Related content
138
148
139
149
-[Learn how to fine-tune an Azure OpenAI model in Azure AI Studio](../../ai-services/openai/how-to/fine-tuning.md?context=/azure/ai-studio/context/context)
140
150
-[Learn how to fine-tune a Llama 2 model in Azure AI Studio](../how-to/fine-tune-model-llama.md)
151
+
-[Learn how to fine-tune a Phi-3 model in Azure AI Studio](../how-to/fine-tune-phi-3.md)
152
+
-[How to deploy Phi-3 family of small language models with Azure AI Studio](../how-to/deploy-models-phi-3.md)
Copy file name to clipboardExpand all lines: articles/azure-monitor/agents/azure-monitor-agent-troubleshoot-linux-vm.md
+2-11Lines changed: 2 additions & 11 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -26,7 +26,6 @@ Follow the steps below to troubleshoot the latest version of the Azure Monitor a
26
26
```
27
27
3. Wait for 10-15 minutes as extension maybe in transitioning status. If it still doesn't show up as above, [uninstall and install the extension](./azure-monitor-agent-manage.md) again.
28
28
4. Check if you see any errors in extension logs located at `/var/log/azure/Microsoft.Azure.Monitor.AzureMonitorLinuxAgent/` on your machine
29
-
5. If none of the above helps, [file a ticket](#file-a-ticket) with **Summary** as 'AMA extension fails to install or provision' and **Problem type** as 'I need help with Azure Monitor Linux Agent'.
30
29
31
30
3. **Verify that the agent is running**:
32
31
1. Check if the agent is emitting heartbeat logs to Log Analytics workspace using the query below. Skip if 'Custom Metrics' is the only destination in the DCR:
@@ -37,19 +36,15 @@ Follow the steps below to troubleshoot the latest version of the Azure Monitor a
37
36
```
38
37
systemctl status azuremonitoragent
39
38
```
40
-
3. Check if you see any errors in core agent logs located at `/var/opt/microsoft/azuremonitoragent/log/mdsd.*` on your machine
41
-
3. If none of the above helps, [file a ticket](#file-a-ticket) with **Summary** as 'AMA extension provisioned but not running' and **Problem type** as 'I need help with Azure Monitor Linux Agent'.
39
+
3. Check if you see any errors in core agent logs located at `/var/opt/microsoft/azuremonitoragent/log/mdsd.*` on your machine
42
40
43
41
4. **Verify that the DCR exists and is associated with the virtual machine:**
44
42
1. If using Log Analytics workspace as destination, verify that DCR exists in the same physical region as the Log Analytics workspace.
45
43
2. Open Azure portal > select your data collection rule > Open **Configuration** : **Resources** from the pane on the left > You should see the virtual machine listed here.
46
44
3. If not listed, click 'Add' and select your virtual machine from the resource picker. Repeat across all DCRs.
47
-
4. If none of the above helps, [file a ticket](#file-a-ticket) with **Summary** as 'DCR not found or associated' and **Problem type** as 'I need help configuring data collection from a VM'.
48
45
49
46
5. **Verify that agent was able to download the associated DCR(s) from AMCS service:**
50
47
1. Check if you see the latest DCR downloaded at this location `/etc/opt/microsoft/azuremonitoragent/config-cache/configchunks/`
51
-
2. If not, [file a ticket](#file-a-ticket) with **Summary** as 'AMA unable to download DCR config' and **Problem type** as 'I need help with Azure Monitor Linux Agent'.
52
-
53
48
54
49
55
50
## Issues collecting Syslog
@@ -80,13 +75,12 @@ For more information on how to troubleshoot syslog issues with Azure Monitor Age
80
75
2. The parsed configuration is stored at `/etc/opt/microsoft/azuremonitoragent/config-cache/configchunks/`. Check that Syslog collection is defined and the log destinations are the same as constructed in DCR UI / DCR JSON.
81
76
1. If yes, proceed to step 3. If not, the issue is in the configuration workflow.
82
77
2. Investigate `mdsd.err`,`mdsd.warn`, `mdsd.info` files under `/var/opt/microsoft/azuremonitoragent/log` for possible configuration errors.
83
-
3. If none of the above helps, [file a ticket](#file-a-ticket) with **Summary** as 'Syslog DCR not available' and **Problem type** as 'I need help configuring data collection from a VM'.
78
+
84
79
3. Validate the layout of the Syslog collection workflow to ensure all necessary pieces are in place and accessible:
85
80
1. For `rsyslog` users, ensure the `/etc/rsyslog.d/10-azuremonitoragent.conf` file is present, isn't empty, and is accessible by the `rsyslog` daemon (syslog user).
86
81
1. Check your rsyslog configuration at `/etc/rsyslog.conf` and `/etc/rsyslog.d/*` to see if you have any inputs bound to a non-default ruleset, as messages from these inputs won't be forwarded to Azure Monitor Agent. For instance, messages from an input configured with a non-default ruleset like `input(type="imtcp" port="514" `**`ruleset="myruleset"`**`)` won't be forward.
87
82
2. For `syslog-ng` users, ensure the `/etc/syslog-ng/conf.d/azuremonitoragent.conf` file is present, isn't empty, and is accessible by the `syslog-ng` daemon (syslog user).
88
83
3. Ensure the file `/run/azuremonitoragent/default_syslog.socket` exists and is accessible by `rsyslog` or `syslog-ng` respectively.
89
-
4. Check for a corresponding drop in count of processed syslog events in `/var/opt/microsoft/azuremonitoragent/log/mdsd.qos`. If such drop isn't indicated in the file, [file a ticket](#file-a-ticket) with **Summary** as 'Syslog data dropped in pipeline' and **Problem type** as 'I need help with Azure Monitor Linux Agent'.
90
84
5. Check that syslog daemon queue isn't overflowing, causing the upload to fail, by referring the guidance here: [Rsyslog data not uploaded due to Full Disk space issue on AMA Linux Agent](./azure-monitor-agent-troubleshoot-linux-vm-rsyslog.md)
91
85
4. To debug syslog events ingestion further, you can append trace flag **-T 0x2002** at the end of **MDSD_OPTIONS** in the file `/etc/default/azuremonitoragent`, and restart the agent:
92
86
```
@@ -95,9 +89,6 @@ For more information on how to troubleshoot syslog issues with Azure Monitor Age
95
89
5. After the issue is reproduced with the trace flag on, you'll find more debug information in `/var/opt/microsoft/azuremonitoragent/log/mdsd.info`. Inspect the file for the possible cause of syslog collection issue, such as parsing / processing / configuration / upload errors.
96
90
> [!WARNING]
97
91
> Ensure to remove trace flag setting **-T 0x2002** after the debugging session, since it generates many trace statements that could fill up the disk more quickly or make visually parsing the log file difficult.
98
-
6. If none of the above helps, [file a ticket](#file-a-ticket) with **Summary** as 'AMA fails to collect syslog events' and **Problem type** as 'I need help with Azure Monitor Linux Agent'.
99
92
100
93
## Troubleshooting issues on Arc-enabled server
101
94
If after checking basic troubleshooting steps you don't see the Azure Monitor Agent emitting logs or find **'Failed to get MSI token from IMDS endpoint'** errors in `/var/opt/microsoft/azuremonitoragent/log/mdsd.err` log file, it's likely `syslog` user isn't a member of the group `himds`. Add `syslog` user to `himds` user group if the user isn't a member of this group. Create user `syslog` and the group `syslog`, if necessary, and make sure that the user is in that group. For more information check out Azure Arc-enabled server authentication requirements [here](../../azure-arc/servers/managed-identity-authentication.md).
Copy file name to clipboardExpand all lines: articles/azure-monitor/agents/azure-monitor-agent-troubleshoot-windows-arc.md
+2-13Lines changed: 2 additions & 13 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -32,10 +32,8 @@ Follow the steps below to troubleshoot the latest version of the Azure Monitor a
32
32
GC Service (gcarcservice) : running
33
33
Extension Service (extensionservice) : running
34
34
```
35
-
If instead you see `Agent Status: Disconnected` or any other status, [file a ticket](#file-a-ticket) with **Summary** as 'Arc agent or extensions service not working' and **Problem type** as 'I need help with Azure Monitor Windows Agent'.
36
35
3. Wait for 10-15 minutes as extension maybe in transitioning status. If it still doesn't show up, [uninstall and install the extension](./azure-monitor-agent-manage.md) again and repeat the verification to see the extension show up.
37
36
4. If not, check if you see any errors in extension logs located at `C:\ProgramData\GuestConfig\extension_logs\Microsoft.Azure.Monitor.AzureMonitorWindowsAgent` on your machine
38
-
5. If none of the above works, [file a ticket](#file-a-ticket) with **Summary** as 'AMA extension fails to install or provision' and **Problem type** as 'I need help with Azure Monitor Windows Agent'.
39
37
40
38
3. **Verify that the agent is running**:
41
39
1. Check if the agent is emitting heartbeat logs to Log Analytics workspace using the query below. Skip if 'Custom Metrics' is the only destination in the DCR:
@@ -44,22 +42,19 @@ Follow the steps below to troubleshoot the latest version of the Azure Monitor a
44
42
```
45
43
2. If not, open Task Manager and check if 'MonAgentCore.exe' process is running. If it is, wait for 5 minutes for heartbeat to show up.
46
44
3. If not, check if you see any errors in core agent logs located at `C:\Resources\Directory\AMADataStore\Configuration` on your machine
47
-
4. If none of the above helps, [file a ticket](#file-a-ticket) with **Summary** as 'AMA extension provisioned but not running' and **Problem type** as 'I need help with Azure Monitor Windows Agent'.
48
45
49
46
4. **Verify that the DCR exists and is associated with the Arc-enabled server:**
50
47
1. If using Log Analytics workspace as destination, verify that DCR exists in the same physical region as the Log Analytics workspace.
51
48
2. On your Arc-enabled server, verify the existence of the file `C:\Resources\Directory\AMADataStore\mcs\mcsconfig.latest.xml`. If this file doesn't exist, the Arc-enabled server may not be associated with a DCR.
52
49
3. Open Azure portal > select your data collection rule > Open **Configuration** : **Resources** from the pane on the left > You should see the Arc-enabled server listed here
53
50
4. If not listed, click 'Add' and select your Arc-enabled server from the resource picker. Repeat across all DCRs.
54
-
5. If none of the above helps, [file a ticket](#file-a-ticket) with **Summary** as 'DCR not found or associated' and **Problem type** as 'I need help configuring data collection from a VM'.
55
51
56
52
5. **Verify that agent was able to download the associated DCR(s) from AMCS service:**
57
53
1. Check if you see the latest DCR downloaded at this location `C:\Resources\Directory\AMADataStore\mcs\configchunks`
58
-
2. If not, [file a ticket](#file-a-ticket) with **Summary** as 'AMA unable to download DCR config' and **Problem type** as 'I need help with Azure Monitor Windows Agent'.
59
54
60
55
## Issues collecting Performance counters
61
56
1. Check that your DCR JSON contains a section for 'performanceCounters'. If not, fix your DCR. See [how to create DCR](./azure-monitor-agent-data-collection.md) or [sample DCR](./data-collection-rule-sample-agent.md).
62
-
2. Check that the file `C:\Resources\Directory\AMADataStore\mcs\mcsconfig.lkg.xml` exists. If it doesn't exist, [file a ticket](#file-a-ticket) with **Summary** as 'AMA didn't run long enough to mark and **Problem type** as 'I need help with Azure Monitor Windows Agent'.
57
+
2. Check that the file `C:\Resources\Directory\AMADataStore\mcs\mcsconfig.lkg.xml` exists.
63
58
3. Open the file and check if it contains `CounterSet` nodes as shown in the example below:
64
59
```xml
65
60
<CounterSet storeType="Local" duration="PT1M"
@@ -71,8 +66,6 @@ Follow the steps below to troubleshoot the latest version of the Azure Monitor a
71
66
<Counter>\PhysicalDisk(_Total)\Avg. Disk Queue Length</Counter>
72
67
</CounterSet>
73
68
```
74
-
If there are no `CounterSet` nodes, then the DCR wasn't parsed correctly. [File a ticket](#file-a-ticket) with **Summary** as 'AMA unable to parse DCR config' and **Problem type** as 'I need help with Azure Monitor Windows Agent'.
75
-
76
69
77
70
78
71
### Issues using 'Custom Metrics' as destination
@@ -97,11 +90,10 @@ Follow the steps below to troubleshoot the latest version of the Azure Monitor a
97
90
6. Collect logs by running the command `C:\Packages\Plugins\Microsoft.Azure.Monitor.AzureMonitorWindowsAgent\<version-number>\Monitoring\Agent\table2csv.exe C:\Resources\Directory\AMADataStore\Tables\MaMetricsExtensionEtw.tsf`
98
91
1. The command will generate the file 'MaMetricsExtensionEtw.csv'
99
92
2. Open it and look for any Level 2 errors and try to fix them.
100
-
7. If none of the above helps, [file a ticket](#file-a-ticket) with **Summary** as 'AMA unable to collect custom metrics' and **Problem type** as 'I need help with Azure Monitor Windows Agent'.
101
93
102
94
## Issues collecting Windows event logs
103
95
1. Check that your DCR JSON contains a section for 'windowsEventLogs'. If not, fix your DCR. See [how to create DCR](./azure-monitor-agent-data-collection.md) or [sample DCR](./data-collection-rule-sample-agent.md).
104
-
2. Check that the file `C:\Resources\Directory\AMADataStore\mcs\mcsconfig.lkg.xml` exists. If it doesn't exist, [file a ticket](#file-a-ticket) with **Summary** as 'AMA didn't run long enough to mark and **Problem type** as 'I need help with Azure Monitor Windows Agent'.
96
+
2. Check that the file `C:\Resources\Directory\AMADataStore\mcs\mcsconfig.lkg.xml` exists.
105
97
3. Open the file and check if it contains `Subscription` nodes as shown in the example below:
@@ -114,6 +106,3 @@ Follow the steps below to troubleshoot the latest version of the Azure Monitor a
114
106
</Column>
115
107
</Subscription>
116
108
```
117
-
If there are no `Subscription` nodes, then the DCR wasn't parsed correctly. [File a ticket](#file-a-ticket) with **Summary** as 'AMA unable to parse DCR config' and **Problem type** as 'I need help with Azure Monitor Windows Agent'.
0 commit comments