SDK_CLI_test by raghu-microsoft · Pull Request #3623 · Azure/azureml-examples

raghu-microsoft · 2025-06-20T06:45:22Z

Description

Checklist

I have read the contribution guidelines.
- General
- SDK
- CLI
I have coordinated with the docs team (mldocs@microsoft.com) if this PR deletes files or changes any file names or file extensions.
Pull request includes test coverage for the included changes.
This notebook or file is added to the CODEOWNERS file, pointing to the author or the author's team.

* Add grpo job example * Replace client info with generics * Add missing copyright * newline at end of aml_setup.py * Fix black formatting issues and reduce dataset * Update sdk/python/jobs/grpo/src/grpo_trainer_rewards.py Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Update sdk/python/jobs/grpo/src/BldDemo_Reasoning_Train.py Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Update sdk/python/jobs/grpo/src/BldDemo_Reasoning_Train.py Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Fix duplicated cell * Add to CODEOWNERS * Fix agenda image and dataset string * Replace demo with example * Update sdk/python/jobs/grpo/launch_grpo_command_job-med-mcqa-commented.ipynb Co-authored-by: Gayatri Penumetsa <181455625+gpenumetsa-msft@users.noreply.github.com> * Update sdk/python/jobs/grpo/launch_grpo_command_job-med-mcqa-commented.ipynb Co-authored-by: Gayatri Penumetsa <181455625+gpenumetsa-msft@users.noreply.github.com> * Update sdk/python/jobs/grpo/launch_grpo_command_job-med-mcqa-commented.ipynb Co-authored-by: Gayatri Penumetsa <181455625+gpenumetsa-msft@users.noreply.github.com> * Update sdk/python/jobs/grpo/launch_grpo_command_job-med-mcqa-commented.ipynb Co-authored-by: Gayatri Penumetsa <181455625+gpenumetsa-msft@users.noreply.github.com> * Address deployment related comments * Add README * Update sdk/python/jobs/grpo/launch_grpo_command_job-med-mcqa-commented.ipynb Co-authored-by: Gayatri Penumetsa <181455625+gpenumetsa-msft@users.noreply.github.com> * Remove duplicated model info section * Update sdk/python/jobs/grpo/launch_grpo_command_job-med-mcqa-commented.ipynb Co-authored-by: Gayatri Penumetsa <181455625+gpenumetsa-msft@users.noreply.github.com> * Update sdk/python/jobs/grpo/launch_grpo_command_job-med-mcqa-commented.ipynb Co-authored-by: Gayatri Penumetsa <181455625+gpenumetsa-msft@users.noreply.github.com> * Change dataset description --------- Co-authored-by: Sharvin Jondhale <shjondhale@microsoft.com> Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> Co-authored-by: Gayatri Penumetsa <181455625+gpenumetsa-msft@users.noreply.github.com>

Co-authored-by: Mohd Javed Ansari <moansa@microsoft.com>

Add yeshwanth and harsha to code owners for GRPO

Changed Agenda to 'Plan of Action'

* Followup improvements to GRPO job example * Add more docs to the readme * Update sdk/python/jobs/grpo/README.md Co-authored-by: Gayatri Penumetsa <181455625+gpenumetsa-msft@users.noreply.github.com> * Update sdk/python/jobs/grpo/README.md Co-authored-by: Gayatri Penumetsa <181455625+gpenumetsa-msft@users.noreply.github.com> * Update README.md --------- Co-authored-by: Sharvin Jondhale <shjondhale@microsoft.com> Co-authored-by: Gayatri Penumetsa <181455625+gpenumetsa-msft@users.noreply.github.com>

Co-authored-by: Mohd Javed Ansari <moansa@microsoft.com>

* fail sdk installation workflow temporarily

* Replace azureml-defaults with azureml-inference-server-http==1.4.0 in environment configuration files * update azureml-inference-server-http * update inference-schema and joblib in conda.yaml * Replace azureml-defaults with azureml-inference-server-http==1.4.0 in environment configuration files * update azureml-inference-server-http * update inference-schema and joblib in conda.yaml --------- Co-authored-by: Salman Arshad <v-saarshad@microsoft.com>

* Adding mcp server content * updating content * add more content to it * adding more details * adding pr details * formating * updating readme file * updating readme * formating the content * formatting * applying formatng * applying formating * applying formatting * adding more ocntent

* Add config for single node runs * Fix notebook metadata * Run black formatter --------- Co-authored-by: Sharvin Jondhale <shjondhale@microsoft.com>

* [Fix]: Add accuracy also and reword informative assertions

* remove responsibleai-vision notebooks and related workflows

github-advanced-security · 2025-06-24T07:00:55Z

This pull request sets up GitHub code scanning for this repository. Once the scans have completed and the checks have passed, the analysis results for this pull request branch will appear on this overview. Once you merge this pull request, the 'Security' tab will show more code scanning analysis results (for example, for the default branch). Depending on your configuration and choice of analysis tool, future pull requests will be annotated with code scanning analysis results. For more information about GitHub code scanning, check out the documentation.

sdk/python/jobs/grpo/aml_setup.py

+from azure.identity import InteractiveBrowserCredential, DefaultAzureCredential
+
+try:
+    credential = DefaultAzureCredential()


sdgilley

these changes will not break the docs builds.

* update rai-tabular environment version in rai tabular notebooks

* Bump up version for tabular components * update * revert

Co-authored-by: Salman Arshad <v-saarshad@microsoft.com>

* Submitting a job in env with private python packages * basic sanity notebooks of SDK & CLI * black fixes * Task 4123398: Add sdk and cli notebooks and raise sev2 if sdk/cli is not installable (#3579) * Submitting a job in env with private python packages * basic sanity notebooks of SDK & CLI * black fixes * cron update to every 5 min & readme exclusion * Sanity monitor (#3581) * Submitting a job in env with private python packages * basic sanity notebooks of SDK & CLI * black fixes * cron update to every 5 min & readme exclusion * adding README.md for cli and sdk * Sanity monitor (#3583) * Submitting a job in env with private python packages * basic sanity notebooks of SDK & CLI * black fixes * cron update to every 5 min & readme exclusion * adding README.md for cli and sdk * fix README.md for cli and sdk (#3584) * Sanity monitor (#3586) * fix README.md for cli and sdk * fix README.md for sdk * fix README.md for sdk * Sanity monitor (#3587) * fix README.md for cli and sdk * fix README.md for sdk * fix README.md for sdk * fix exclusions and workflows * Sanity monitor (#3588) * fix README.md for cli and sdk * fix README.md for sdk * fix README.md for sdk * fix exclusions and workflows * fix sdk nb * fix nb and remove readme * fix nb for ws list * fail sdk installation workflow temporarily * Pass the failing workflow * Fail the workflow intentionally to test the monitor

Co-authored-by: Salman Arshad <v-saarshad@microsoft.com> Co-authored-by: Arun <arunsu@microsoft.com>

* [Feat]: Adding example for grpo pipeline job trigger * [update]: format with black

* Adding an example notebook for gpt-oss finetuning * black file formatting

- Demonstrates a multi-step pipeline with dummy inputs and outputs - Replicates the step sequence functionality available in AzureML SDK v1 - Serves as a reference for migrating pipelines from SDK v1 to SDK v2

* New Ubuntu image * update EOL images pt2

* Update online-endpoints-managed-identity-sai.ipynb * Update online-endpoints-managed-identity-uai.ipynb * update EOL images --------- Co-authored-by: kshitij-microsoft <kchawla@microsoft.com> Co-authored-by: Kshitij Chawla <166698309+kshitij-microsoft@users.noreply.github.com>

* ncv3 retirement update * review comment

…3713) * Refactor deploy-and-run script for MNIST classifier * Refactor deploy-and-run script for MNIST classifier Refactor deployment script for MNIST classifier to streamline endpoint creation and model registration. * Use variable for ImageNet sample URI in script * Update SAMPLE_INPUT_URI for mnist-classifier * Change IMAGENET_SAMPLE_URI to new blob storage URL Updated IMAGENET_SAMPLE_URI to a new data source. * Update ImageNet sample URI variable in script

Co-authored-by: Saanika Gupta <saanikagupta@microsoft.com>

* [BES] - public data stored in github for BES notebooks * clean output from notebooks

Co-authored-by: Salman Arshad <v-saarshad@microsoft.com>

…lar environment version 28 (#3734)

…cuda12.6` (#3735) * env migration * remove nebulaml references * attempt to download and then register data * Revert "attempt to download and then register data" This reverts commit ed8e3b9.

…efore recreating model (#3743) * Update model cleanup to use DELETE API Replaced model archiving with DELETE API calls for cleanup.

* fix: Update rerank notebook for latest models * Update sdk/python/foundation-models/cohere/rerank-cohere-client.ipynb Co-authored-by: Michael <michael.kozakov@gmail.com> * fix typo * remove empty cell * refine base_url for clarity * fix formatting --------- Co-authored-by: Michael <michael.kozakov@gmail.com>

sharvin2187 and others added 16 commits May 28, 2025 14:40

update deployment env to ubuntu22.04 for automl notebook jobs (#3598)

920e2c5

Co-authored-by: Mohd Javed Ansari <moansa@microsoft.com>

Update CODEOWNERS (#3601)

7724e99

Add yeshwanth and harsha to code owners for GRPO

Update launch_grpo_command_job-med-mcqa-commented.ipynb (#3599)

539744e

Changed Agenda to 'Plan of Action'

Ignore warnings for Notebook test runs (#3603)

f6e39a4

Co-authored-by: Mohd Javed Ansari <moansa@microsoft.com>

fix deployment env image (#3606)

06204c0

Co-authored-by: Mohd Javed Ansari <moansa@microsoft.com>

fix broken link for SDK installation (#3605)

7f21365

Fail workflow of sdk install temporarily to test monitor (#3611)

794431a

* fail sdk installation workflow temporarily

Add config for single node runs (#3604)

047ef25

* Add config for single node runs * Fix notebook metadata * Run black formatter --------- Co-authored-by: Sharvin Jondhale <shjondhale@microsoft.com>

[Fix]: Add accuracy also and reword informative assertions (#3617)

642661c

* [Fix]: Add accuracy also and reword informative assertions

Create copilot-instructions.md (#3620)

7694c8c

Qunsong/remove image notebooks (#3621)

9473226

* remove responsibleai-vision notebooks and related workflows

remove rai-text notebooks and related workflows (#3622)

2cd3cb6

raghu-microsoft requested review from achauhan-scc, imatiach-msft, jayesh-tanna and kingernupur as code owners June 20, 2025 06:45

github-advanced-security bot found potential problems Jun 24, 2025

View reviewed changes

Spark upgrade (#3629)

65eceac

kshitij-microsoft requested review from a team, ahughes-msft, nemanjarajic and yunjie-hub as code owners June 27, 2025 09:15

sdgilley approved these changes Jun 30, 2025

View reviewed changes

qusongms and others added 2 commits July 3, 2025 11:09

update tabular env version 2 (#3636)

feebd26

* update rai-tabular environment version in rai tabular notebooks

Update sdk-deploy-and-test.ipynb (#3637)

eb107dc

nishalagnes27 and others added 15 commits July 28, 2025 14:33

Bump up version for tabular components (#3649)

cf36459

* Bump up version for tabular components * update * revert

Update Dockerfile (#3653)

73c78a3

Co-authored-by: Salman Arshad <v-saarshad@microsoft.com>

Pass the failing workflow (#3655)

958aac3

Update scipy version (#3654)

85e88b4

Co-authored-by: Salman Arshad <v-saarshad@microsoft.com> Co-authored-by: Arun <arunsu@microsoft.com>

Update spark runtime version (#3638)

87ddd59

[Feat]: Adding example for grpo pipeline job trigger (#3663)

9029297

* [Feat]: Adding example for grpo pipeline job trigger * [update]: format with black

fix cred scan issue (#3677)

82e1bca

Adding an example notebook for gpt-oss finetuning (#3678)

4df413c

* Adding an example notebook for gpt-oss finetuning * black file formatting

Sample Pipeline: StepSequence Migration SDK v1 to SDK v2 (#3667)

e5ed2b3

- Demonstrates a multi-step pipeline with dummy inputs and outputs - Replicates the step sequence functionality available in AzureML SDK v1 - Serves as a reference for migrating pipelines from SDK v1 to SDK v2

Updating EOL images in Notebooks (#3682)

76c34dd

* New Ubuntu image * update EOL images pt2

Fix RAI CLI examples in azureml-examples (#3687)

97570aa

update codeowners (#3688)

61425b6

NCv3 VM retirement update (#3696)

334bb09

* ncv3 retirement update * review comment

PratibhaShrivastav18 requested a review from jmerkow as a code owner October 30, 2025 14:57

Iyer-Narayan and others added 14 commits December 1, 2025 13:02

Add trigger for azureml-mlflow related workflows (#3720)

ea5e796

Co-authored-by: Saanika Gupta <saanikagupta@microsoft.com>

[BES] - public data stored in github for BES notebooks (#3718)

577f58f

* [BES] - public data stored in github for BES notebooks * clean output from notebooks

[BES notebooks] - Fix the issue with cli-batch-score (#3728)

e5b0dfc

[BES notebooks] - fix pending failed sdk (#3731)

e752337

Add azureml-ai-monitoring conda.yaml files (#3730)

385f059

Co-authored-by: Salman Arshad <v-saarshad@microsoft.com>

Update RAI notebooks and CLI samples to use latest responsibleai-tabu…

456295f

…lar environment version 28 (#3734)

Env migration from acpt-pytorch-2.2-cuda12.1 to ` acpt-pytorch-2.8-…

3fc1294

…cuda12.6` (#3735) * env migration * remove nebulaml references * attempt to download and then register data * Revert "attempt to download and then register data" This reverts commit ed8e3b9.

update ubuntu image to 22.04 (#3740)

5c89588

Use DELETE API instead of CLI model archive to delete target models b…

36ef9a8

…efore recreating model (#3743) * Update model cleanup to use DELETE API Replaced model archiving with DELETE API calls for cleanup.

Add experimental class to notebook output check (#3745)

355d081

Fix tcltk2 package installation in R Dockerfiles (#3705)

647dec0

Update Docker image version in component.yml (#3759)

50f168d

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

SDK_CLI_test#3623

SDK_CLI_test#3623
raghu-microsoft wants to merge 52 commits intosdk_cli_fixfrom
main

raghu-microsoft commented Jun 20, 2025

Uh oh!

github-advanced-security bot commented Jun 24, 2025

Uh oh!

Check failure

sdgilley left a comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

20 participants

Conversation

raghu-microsoft commented Jun 20, 2025

Description

Checklist

Uh oh!

github-advanced-security bot commented Jun 24, 2025

Uh oh!

Check failure

sdgilley left a comment

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

20 participants