Skip to content

Commit 9d09991

Browse files
authored
Merge branch 'main' into jaga/insecure_tempfile_fix
2 parents 54a8bfb + 05dcd4c commit 9d09991

File tree

20 files changed

+2318
-6
lines changed

20 files changed

+2318
-6
lines changed

cli/README.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -211,6 +211,10 @@ path|status|description
211211
[jobs/parallel/1a_oj_sales_prediction/pipeline.yml](jobs/parallel/1a_oj_sales_prediction/pipeline.yml)|[![jobs/parallel/1a_oj_sales_prediction/pipeline](https://github.com/Azure/azureml-examples/workflows/cli-jobs-parallel-1a_oj_sales_prediction-pipeline/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/cli-jobs-parallel-1a_oj_sales_prediction-pipeline.yml)|The hello world pipeline job with partition by key
212212
[jobs/parallel/2a_iris_batch_prediction/pipeline.yml](jobs/parallel/2a_iris_batch_prediction/pipeline.yml)|[![jobs/parallel/2a_iris_batch_prediction/pipeline](https://github.com/Azure/azureml-examples/workflows/cli-jobs-parallel-2a_iris_batch_prediction-pipeline/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/cli-jobs-parallel-2a_iris_batch_prediction-pipeline.yml)|The hello world pipeline job with inline parallel job
213213
[jobs/parallel/3a_mnist_batch_identification/pipeline.yml](jobs/parallel/3a_mnist_batch_identification/pipeline.yml)|[![jobs/parallel/3a_mnist_batch_identification/pipeline](https://github.com/Azure/azureml-examples/workflows/cli-jobs-parallel-3a_mnist_batch_identification-pipeline/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/cli-jobs-parallel-3a_mnist_batch_identification-pipeline.yml)|The hello world pipeline job with inline parallel job
214+
[finetuning-model-as-a-service-chat-completion](jobs/finetuning/standalone/model-as-a-service/chat-completion/chat-completion-finetuning.yaml)|[![finetuning-model-as-a-service-chat-completion](https://github.com/Azure/azureml-examples/workflows/cli-jobs-finetuning-standalone-model-as-a-service-chat-completion/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/cli-jobs-finetuning-standalone-model-as-a-service-chat-completion.yml)|No description
215+
[finetuning-model-as-a-service-text-generation](jobs/finetuning/standalone/model-as-a-service/text-generation/text-generation-finetuning.yaml)|[![finetuning-model-as-a-service-text-generation](https://github.com/Azure/azureml-examples/workflows/cli-jobs-finetuning-standalone-model-as-a-service-text-generation/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/cli-jobs-finetuning-standalone-model-as-a-service-text-generation.yml)|No description
216+
[finetuning-model-as-a-platform-chat-completion](jobs/finetuning/standalone/model-as-a-service/chat-completion/chat-completion-finetuning.yaml)|[![finetuning-model-as-a-platform-chat-completion](https://github.com/Azure/azureml-examples/workflows/cli-jobs-finetuning-standalone-model-as-a-platform-chat-completion/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/cli-jobs-finetuning-standalone-model-as-a-platform-chat-completion.yml)|No description
217+
[finetuning-model-as-a-platform-text-generation](jobs/finetuning/standalone/model-as-a-service/text-generation/text-generation-finetuning.yaml)|[![finetuning-model-as-a-platform-text-generation](https://github.com/Azure/azureml-examples/workflows/cli-jobs-finetuning-standalone-model-as-a-platform-text-generation/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/cli-jobs-finetuning-standalone-model-as-a-platform-text-generation.yml)|No description
214218
[cli\foundation-models\azure_openai\oai-v1\openai_completions_finetune\openai_completions_finetune_spec.yaml](cli\foundation-models\azure_openai\oai-v1\openai_completions_finetune\openai_completions_finetune_spec.yaml)|[![cli\foundation-models\azure_openai\oai-v1\openai_completions_finetune\openai_completions_finetune_spec.yaml](https://github.com/Azure/azureml-examples/workflows/cli-foundation-models-azure_openai-oai-v1-openai_completions_finetune.yml/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/cli-foundation-models-azure_openai-oai-v1-openai_completions_finetune.yml)|The hello world pipeline job with inline parallel job
215219
[cli\foundation-models\azure_openai\oai-v2\openai_completions_finetune_pipeline\openai_completions_finetune_pipeline_spec.yaml](cli\foundation-models\azure_openai\oai-v2\openai_completions_finetune_pipeline\openai_completions_finetune_pipeline_spec.yaml)|[![cli\foundation-models\azure_openai\oai-v2\openai_completions_finetune_pipeline\openai_completions_finetune_pipeline_spec.yaml](https://github.com/Azure/azureml-examples/workflows/cli-foundation-models-azure_openai-oai-v2-openai_completions_finetune.yml/badge.svg?branch=main)](https://github.com/Azure/azureml-examples/actions/workflows/cli-foundation-models-azure_openai-oai-v2-openai_completions_finetune.yml)|The hello world pipeline job with inline parallel job
216220

cli/jobs/finetuning/standalone/finetuning-job-cliv2-readme.md

Lines changed: 10 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -47,10 +47,16 @@ Note that these files are for demo purposes only.
4747
4848
Sample Yaml file for generating FineTuningJob using azureml CLIV2
4949
50-
**Text Generation FineTuning (Model-As-A-Service)**
51-
1. [finetuning-with-amlcompute](./model-as-a-service/text-generation/text-generation-finetuning.yaml)
50+
**Text Generation FineTuning (Model-As-A-Platform)**
51+
1. [finetuning-with-amlcompute](./model-as-a-platform/text-generation/text-generation-finetuning-amlcompute.yaml)
52+
2. [finetuning-with-instance-types](./model-as-a-platform/text-generation/text-generation-finetuning-instance-types.yaml)
5253
53-
**ChatCompletion FineTuning (Model-As-A-Service)**
54-
1. [finetuning-with-amlcompute](./model-as-a-service/chat-completion/chat-completion-finetuning.yaml)
54+
**ChatCompletion FineTuning (Model-As-A-Platform)**
55+
1. [finetuning-with-amlcompute](./model-as-a-platform/chat/chat-completion-finetuning-amlcompute.yaml)
56+
2. [finetuning-with-instance-types](./model-as-a-platform/chat/chat-completion-finetuning-instance-types.yaml)
5557
58+
**Text Generation FineTuning (Model-As-A-Service)**
59+
1. [finetuning](./model-as-a-service/text-generation/text-generation-finetuning.yaml)
5660
61+
**ChatCompletion FineTuning (Model-As-A-Service)**
62+
1. [finetuning](./model-as-a-service/chat-completion/chat-completion-finetuning.yaml)
Lines changed: 27 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,27 @@
1+
type: finetuning
2+
3+
name: "Phi-3-mini-4k-instruct-with-amlcompute"
4+
experiment_name: "Phi-3-mini-4k-instruct-finetuning-experiment"
5+
display_name: "Phi-3-mini-4k-instruct-display-name"
6+
task: chat_completion
7+
model_provider: custom
8+
model:
9+
path: "azureml://registries/azureml/models/Phi-3-mini-4k-instruct/versions/14"
10+
type: mlflow_model
11+
compute: "lowpri-a100"
12+
training_data: train.jsonl
13+
validation_data:
14+
path: validation.jsonl
15+
type: uri_file
16+
hyperparameters:
17+
num_train_epochs: "1"
18+
per_device_train_batch_size: "1"
19+
learning_rate: "0.00002"
20+
properties:
21+
my_property: "my_value"
22+
tags:
23+
foo_tag: "bar"
24+
outputs:
25+
registered_model:
26+
name: "Phi-3-mini-4k-instruct-finetuned-model"
27+
type: mlflow_model
Lines changed: 32 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,32 @@
1+
type: finetuning
2+
3+
name: "Phi-3-mini-4k-instruct-with-instance-types"
4+
experiment_name: "Phi-3-mini-4k-instruct-finetuning-experiment-instance-types"
5+
display_name: "Phi-3-mini-4k-instruct-display-name"
6+
task: chat_completion
7+
model_provider: custom
8+
model:
9+
path: "azureml://registries/azureml/models/Phi-3-mini-4k-instruct/versions/14"
10+
type: mlflow_model
11+
resources:
12+
instance_types:
13+
# You can specify multiple instance types for the training job
14+
# Backend will decide which instance type to use based on the constraints on training job.
15+
- "Standard_NC96ads_A100_v4"
16+
- "Standard_E4s_v3"
17+
training_data: train.jsonl
18+
validation_data:
19+
path: validation.jsonl
20+
type: uri_file
21+
hyperparameters:
22+
num_train_epochs: "1"
23+
per_device_train_batch_size: "1"
24+
learning_rate: "0.00002"
25+
properties:
26+
my_property: "my_value"
27+
tags:
28+
foo_tag: "bar"
29+
outputs:
30+
registered_model:
31+
name: "Phi-3-mini-4k-instruct-finetuned-model"
32+
type: mlflow_model
Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
1+
## How to run FineTuningJob using AzureML CLIV2?
2+
[Running FineTuningJob Using AzureML CLIV2](../../finetuning-job-cliv2-readme.md)

0 commit comments

Comments
 (0)