Skip to content

Support tag updates in SageMaker resources #1732

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
josehui opened this issue Mar 16, 2023 · 7 comments
Open

Support tag updates in SageMaker resources #1732

josehui opened this issue Mar 16, 2023 · 7 comments
Labels
lifecycle/frozen Indicates that an issue or PR should not be auto-closed due to staleness. needs-kind Indicates a PR lacks a `kind/foo` label and requires one. service/sagemaker Indicates issues or PRs that are related to sagemaker-controller.

Comments

@josehui
Copy link

josehui commented Mar 16, 2023

Describe the bug
We recently migrated from old sagemaker operator to the new ACK controller.
When we tried to update the resource tags by editing the manifest, it is not reflected on SageMaker and kubectl describe shows below error

Conditions:
Message: not implemented
Status: True
Type: ACK.Terminal
Last Transition Time: 2023-03-16T11:37:07Z
Message: Resource not synced
Reason: resource is in terminal condition
Status: False
Type: ACK.ResourceSynced
Events:

Steps to reproduce

  1. Migrate sagemaker CRs from old operator following here
  2. Export new manifest e.g. model.yaml
  3. Edit tags field in manifest
  4. Apply manifest again kubectl apply -f model.yaml

Expected outcome
SageMaker CRs can be updated and reflected in aws console.

Environment
Prod, Staging

  • Kubernetes version 1.22
  • Using EKS (yes/no), if so version? yes. 1.22
  • AWS service targeted (S3, RDS, etc.) SageMaker
@josehui josehui changed the title Migrated SageMake resources can not be updated/ sync Migrated SageMaker resources can not be updated/ sync Mar 16, 2023
@a-hilaly a-hilaly added service/sagemaker Indicates issues or PRs that are related to sagemaker-controller. needs-kind Indicates a PR lacks a `kind/foo` label and requires one. labels Mar 16, 2023
@a-hilaly
Copy link
Member

/cc @aws-controllers-k8s/sagemaker-maintainer

@surajkota
Copy link
Member

surajkota commented Mar 16, 2023

This is a known limitation. Tags are only supported on create in sagemaker controller. Updating tags is not supported yet. afaik, same was the case with old operator. Is this a blocker?

Also, updating model and endpoint config is not supported since this operation is not available on service side.

We will find a place to document this.

@a-hilaly thanks for tagging. Is the common tag handling mechanism implemented now?

@josehui
Copy link
Author

josehui commented Mar 16, 2023

Thanks @surajkota. We are aware that model/ endpointconfig is immutable.
We will update the tags manually for now but look forward to the new feature.

@surajkota
Copy link
Member

surajkota commented Mar 16, 2023

Ack, Thank you

@surajkota surajkota changed the title Migrated SageMaker resources can not be updated/ sync Support tag updates in SageMaker resources Mar 16, 2023
@ack-bot
Copy link
Collaborator

ack-bot commented Jun 14, 2023

Issues go stale after 90d of inactivity.
Mark the issue as fresh with /remove-lifecycle stale.
Stale issues rot after an additional 30d of inactivity and eventually close.
If this issue is safe to close now please do so with /close.
Provide feedback via https://github.com/aws-controllers-k8s/community.
/lifecycle stale

@ack-prow ack-prow bot added the lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. label Jun 14, 2023
@surajkota
Copy link
Member

/lifecycle frozen

@ack-prow ack-prow bot added lifecycle/frozen Indicates that an issue or PR should not be auto-closed due to staleness. and removed lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. labels Jun 15, 2023
@mwm5945
Copy link

mwm5945 commented Feb 9, 2024

also interested in this :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
lifecycle/frozen Indicates that an issue or PR should not be auto-closed due to staleness. needs-kind Indicates a PR lacks a `kind/foo` label and requires one. service/sagemaker Indicates issues or PRs that are related to sagemaker-controller.
Projects
None yet
Development

No branches or pull requests

5 participants