feature: support of the intelligent stopping in the tuner #3652

repushko · 2023-02-10T16:14:51Z

Issue #, if available: N/A

Description of changes: We want to support the intelligent stopping, the feature which allows customers to specify the condition on which we could stop their tuning jobs.

Testing done: Unit tests are added

Merge Checklist

Put an x in the boxes that apply. You can also fill these out after creating the PR. If you're unsure about any of them, don't hesitate to ask. We're here to help! This is simply a reminder of what we are going to look for before merging your pull request.

General

I have read the CONTRIBUTING doc
I certify that the changes I am introducing will be backward compatible, and I have discussed concerns about this, if any, with the Python SDK team
I used the commit message format described in CONTRIBUTING
I have passed the region in to all S3 and STS clients that I've initialized as part of this change.
I have updated any necessary documentation, including READMEs and API docs (if appropriate)

Tests

I have added tests that prove my fix is effective or that my feature works (if appropriate)
I have added unit and/or integration tests as appropriate to ensure backward compatibility of the changes
I have checked that my tests are not configured for a specific region or account (if appropriate)
I have used unique_name_from_base to create resource names in integ tests (if appropriate)

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

sagemaker-bot · 2023-02-10T16:18:58Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: 0f785dd
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-02-10T16:59:51Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: 0f785dd
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-02-10T17:21:25Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: f293251
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-02-10T17:56:37Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: f293251
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

codecov-commenter · 2023-02-10T17:59:37Z

Codecov Report

Merging #3652 (d51314d) into master (1fa2377) will decrease coverage by 0.41%.
The diff coverage is 87.74%.

@@            Coverage Diff             @@
##           master    #3652      +/-   ##
==========================================
- Coverage   89.17%   88.76%   -0.41%     
==========================================
  Files         204      227      +23     
  Lines       18979    22420    +3441     
==========================================
+ Hits        16924    19902    +2978     
- Misses       2055     2518     +463

Impacted Files	Coverage Δ
src/sagemaker/dataset_definition/inputs.py	`100.00% <ø> (ø)`
src/sagemaker/debugger/framework_profile.py	`100.00% <ø> (ø)`
src/sagemaker/debugger/metrics_config.py	`100.00% <ø> (ø)`
src/sagemaker/huggingface/model.py	`89.87% <ø> (ø)`
src/sagemaker/lineage/_utils.py	`100.00% <ø> (+12.50%)`	⬆️
src/sagemaker/model_card/model_card.py	`93.12% <ø> (ø)`
src/sagemaker/model_card/schema_constraints.py	`100.00% <ø> (ø)`
src/sagemaker/model_monitor/__init__.py	`100.00% <ø> (ø)`
...agemaker/model_monitor/clarify_model_monitoring.py	`89.84% <ø> (-5.09%)`	⬇️
src/sagemaker/model_monitor/dataset_format.py	`72.72% <ø> (-2.28%)`	⬇️
... and 110 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

sagemaker-bot · 2023-02-10T17:59:59Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: f293251
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-02-10T18:42:53Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: 146cd83
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-02-10T18:46:32Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: 146cd83
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-02-10T19:05:49Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: 146cd83
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-02-10T20:54:58Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: 146cd83
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-02-10T21:06:50Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: cca24a5
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-02-10T22:03:39Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: b0ab2a7
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-02-10T22:07:04Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: b0ab2a7
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-02-10T22:27:02Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: b0ab2a7
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-02-10T22:30:03Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: b0ab2a7
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-02-10T23:46:07Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: d51314d
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-02-10T23:53:20Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: d51314d
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-02-11T00:11:55Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: d51314d
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-02-11T00:19:21Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: d51314d
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

vikas0203

/bot run notebook-tests,slow-tests

sagemaker-bot · 2023-02-11T01:23:40Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: d51314d
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-02-11T01:40:37Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: d51314d
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2023-02-11T03:22:23Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: d51314d
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

vikas0203

/bot run pr

sagemaker-bot · 2023-02-13T19:48:11Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: d51314d
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

Co-authored-by: Anton Repushko <[email protected]>

repushko requested a review from a team as a code owner February 10, 2023 16:14

repushko requested review from vikas0203 and removed request for a team February 10, 2023 16:14

iaroslav-ai approved these changes Feb 10, 2023

View reviewed changes

repushko changed the title ~~feature: add support of the intelligent stopping in the tuner~~ feature: support of the intelligent stopping in the tuner Feb 10, 2023

feature: add support of the intelligent stopping in the tuner

d51314d

vikas0203 reviewed Feb 11, 2023

View reviewed changes

vikas0203 reviewed Feb 13, 2023

View reviewed changes

vikas0203 approved these changes Feb 13, 2023

View reviewed changes

vikas0203 merged commit 5cf3e44 into aws:master Feb 13, 2023

repushko deleted the hpo_intelligent_stopping branch February 13, 2023 22:23

JoseJuan98 pushed a commit to JoseJuan98/sagemaker-python-sdk that referenced this pull request Mar 4, 2023

feature: support of the intelligent stopping in the tuner (aws#3652)

bb85268

Co-authored-by: Anton Repushko <[email protected]>

nmadan pushed a commit to nmadan/sagemaker-python-sdk that referenced this pull request Apr 18, 2023

feature: support of the intelligent stopping in the tuner (aws#3652)

404991f

Co-authored-by: Anton Repushko <[email protected]>

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feature: support of the intelligent stopping in the tuner #3652

feature: support of the intelligent stopping in the tuner #3652

repushko commented Feb 10, 2023

sagemaker-bot commented Feb 10, 2023

sagemaker-bot commented Feb 10, 2023

sagemaker-bot commented Feb 10, 2023

sagemaker-bot commented Feb 10, 2023

codecov-commenter commented Feb 10, 2023 •

edited

Loading

sagemaker-bot commented Feb 10, 2023

sagemaker-bot commented Feb 10, 2023

sagemaker-bot commented Feb 10, 2023

sagemaker-bot commented Feb 10, 2023

sagemaker-bot commented Feb 10, 2023

sagemaker-bot commented Feb 10, 2023

sagemaker-bot commented Feb 10, 2023

sagemaker-bot commented Feb 10, 2023

sagemaker-bot commented Feb 10, 2023

sagemaker-bot commented Feb 10, 2023

sagemaker-bot commented Feb 10, 2023

sagemaker-bot commented Feb 10, 2023

sagemaker-bot commented Feb 11, 2023

sagemaker-bot commented Feb 11, 2023

vikas0203 left a comment

sagemaker-bot commented Feb 11, 2023

sagemaker-bot commented Feb 11, 2023

sagemaker-bot commented Feb 11, 2023

vikas0203 left a comment

sagemaker-bot commented Feb 13, 2023

feature: support of the intelligent stopping in the tuner #3652

feature: support of the intelligent stopping in the tuner #3652

Conversation

repushko commented Feb 10, 2023

Merge Checklist

General

Tests

sagemaker-bot commented Feb 10, 2023

AWS CodeBuild CI Report

sagemaker-bot commented Feb 10, 2023

AWS CodeBuild CI Report

sagemaker-bot commented Feb 10, 2023

AWS CodeBuild CI Report

sagemaker-bot commented Feb 10, 2023

AWS CodeBuild CI Report

codecov-commenter commented Feb 10, 2023 • edited Loading

Codecov Report

sagemaker-bot commented Feb 10, 2023

AWS CodeBuild CI Report

sagemaker-bot commented Feb 10, 2023

AWS CodeBuild CI Report

sagemaker-bot commented Feb 10, 2023

AWS CodeBuild CI Report

sagemaker-bot commented Feb 10, 2023

AWS CodeBuild CI Report

sagemaker-bot commented Feb 10, 2023

AWS CodeBuild CI Report

sagemaker-bot commented Feb 10, 2023

AWS CodeBuild CI Report

sagemaker-bot commented Feb 10, 2023

AWS CodeBuild CI Report

sagemaker-bot commented Feb 10, 2023

AWS CodeBuild CI Report

sagemaker-bot commented Feb 10, 2023

AWS CodeBuild CI Report

sagemaker-bot commented Feb 10, 2023

AWS CodeBuild CI Report

sagemaker-bot commented Feb 10, 2023

AWS CodeBuild CI Report

sagemaker-bot commented Feb 10, 2023

AWS CodeBuild CI Report

sagemaker-bot commented Feb 11, 2023

AWS CodeBuild CI Report

sagemaker-bot commented Feb 11, 2023

AWS CodeBuild CI Report

vikas0203 left a comment

Choose a reason for hiding this comment

sagemaker-bot commented Feb 11, 2023

AWS CodeBuild CI Report

sagemaker-bot commented Feb 11, 2023

AWS CodeBuild CI Report

sagemaker-bot commented Feb 11, 2023

AWS CodeBuild CI Report

vikas0203 left a comment

Choose a reason for hiding this comment

sagemaker-bot commented Feb 13, 2023

AWS CodeBuild CI Report

codecov-commenter commented Feb 10, 2023 •

edited

Loading