Skip to content

Upgrading helm chart from v1.0.2 to v1.1.0: failed to list *v1.TransportServer: #4856

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
kyrofa opened this issue Jan 2, 2024 · 6 comments
Closed

Upgrading helm chart from v1.0.2 to v1.1.0: failed to list *v1.TransportServer: #4856

kyrofa opened this issue Jan 2, 2024 · 6 comments

Comments

@kyrofa
Copy link

kyrofa commented Jan 2, 2024 •
edited
Loading

Describe the bug
Pods never pass health checks, and logs are filled with errors.

To Reproduce
Steps to reproduce the behavior:

  1. Deploy v1.0.2 of the helm chart, which works without issues
  2. Update to v1.1.0
  3. Notice helm chart deployment fails
  4. Notice pod never passes health check
  5. View logs on pod

Expected behavior
Deployment should succeed.

Your environment

  • Version of the Ingress Controller - release version or a specific commit: 3.4.0
  • Version of Kubernetes: v1.26.9
  • Kubernetes platform (e.g. Mini-kube or GCP): DigitalOcean
  • Using NGINX or NGINX Plus: NGINX

Additional context

$ kubectl -n nginx-ingress logs nginx-ingress-controller-845bb589df-zlrqj
Defaulted container "nginx-ingress" out of: nginx-ingress, init-nginx-ingress (init)
NGINX Ingress Controller Version=3.4.0 Commit=0811b5c898f25d578f72a629fedef506a6511730 Date=2023-12-19T11:10:02Z DirtyState=false Arch=linux/amd64 Go=go1.21.3
I0102 22:44:33.320723       1 flags.go:299] Starting with flags: ["-nginx-plus=false" "-nginx-reload-timeout=60000" "-enable-app-protect=false" "-enable-app-protect-dos=false" "-nginx-configmaps=nginx-ingress/nginx-ingress" "-ingress-class=nginx" "-health-status=true" "-health-status-uri=/nginx-health" "-nginx-debug=false" "-v=1" "-nginx-status=true" "-nginx-status-port=8080" "-nginx-status-allow-cidrs=127.0.0.1" "-report-ingress-status" "-external-service=nginx-ingress-controller" "-enable-leader-election=true" "-leader-election-lock-name=nginx-ingress-leader" "-enable-prometheus-metrics=true" "-prometheus-metrics-listen-port=9113" "-prometheus-tls-secret=" "-enable-service-insight=false" "-service-insight-listen-port=9114" "-service-insight-tls-secret=" "-enable-custom-resources=true" "-enable-snippets=false" "-include-year=false" "-disable-ipv6=false" "-enable-tls-passthrough=false" "-enable-cert-manager=false" "-enable-oidc=false" "-enable-external-dns=false" "-default-http-listener-port=80" "-default-https-listener-port=443" "-global-configuration=nginx-ingress/nginx-ingress-controller" "-ready-status=true" "-ready-status-port=8081" "-enable-latency-metrics=false" "-ssl-dynamic-reload=true"]
I0102 22:44:33.347737       1 main.go:260] Kubernetes version: 1.26.9
I0102 22:44:33.357144       1 main.go:406] Using nginx version: nginx/1.25.3
I0102 22:44:33.383968       1 main.go:820] Pod label updated: nginx-ingress-controller-845bb589df-zlrqj
2024/01/02 22:44:33 [notice] 11#11: using the "epoll" event method
2024/01/02 22:44:33 [notice] 11#11: nginx/1.25.3
2024/01/02 22:44:33 [notice] 11#11: built by gcc 12.2.0 (Debian 12.2.0-14) 
2024/01/02 22:44:33 [notice] 11#11: OS: Linux 6.1.0-0.deb11.11-amd64
2024/01/02 22:44:33 [notice] 11#11: getrlimit(RLIMIT_NOFILE): 1048576:1048576
2024/01/02 22:44:33 [notice] 11#11: start worker processes
2024/01/02 22:44:33 [notice] 11#11: start worker process 13
2024/01/02 22:44:33 [notice] 11#11: start worker process 14
I0102 22:44:33.418755       1 listener.go:48] Starting prometheus listener on: :9113/metrics
I0102 22:44:33.419679       1 leaderelection.go:250] attempting to acquire leader lease nginx-ingress/nginx-ingress-leader...
W0102 22:44:33.425051       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
E0102 22:44:33.425091       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.TransportServer: failed to list *v1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
W0102 22:44:33.426320       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.GlobalConfiguration: the server could not find the requested resource (get globalconfigurations.k8s.nginx.org)
E0102 22:44:33.426426       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.GlobalConfiguration: failed to list *v1.GlobalConfiguration: the server could not find the requested resource (get globalconfigurations.k8s.nginx.org)
I0102 22:44:33.439795       1 leaderelection.go:260] successfully acquired lease nginx-ingress/nginx-ingress-leader
W0102 22:44:34.494850       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.GlobalConfiguration: the server could not find the requested resource (get globalconfigurations.k8s.nginx.org)
E0102 22:44:34.495180       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.GlobalConfiguration: failed to list *v1.GlobalConfiguration: the server could not find the requested resource (get globalconfigurations.k8s.nginx.org)
W0102 22:44:34.588681       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
E0102 22:44:34.589020       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.TransportServer: failed to list *v1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
W0102 22:44:36.330386       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
E0102 22:44:36.330428       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.TransportServer: failed to list *v1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
W0102 22:44:36.962656       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.GlobalConfiguration: the server could not find the requested resource (get globalconfigurations.k8s.nginx.org)
E0102 22:44:36.962708       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.GlobalConfiguration: failed to list *v1.GlobalConfiguration: the server could not find the requested resource (get globalconfigurations.k8s.nginx.org)
W0102 22:44:39.785186       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
E0102 22:44:39.785236       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.TransportServer: failed to list *v1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
W0102 22:44:43.195231       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.GlobalConfiguration: the server could not find the requested resource (get globalconfigurations.k8s.nginx.org)
E0102 22:44:43.195275       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.GlobalConfiguration: failed to list *v1.GlobalConfiguration: the server could not find the requested resource (get globalconfigurations.k8s.nginx.org)
W0102 22:44:50.640745       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
E0102 22:44:50.640789       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.TransportServer: failed to list *v1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
W0102 22:44:55.483751       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.GlobalConfiguration: the server could not find the requested resource (get globalconfigurations.k8s.nginx.org)
E0102 22:44:55.484002       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.GlobalConfiguration: failed to list *v1.GlobalConfiguration: the server could not find the requested resource (get globalconfigurations.k8s.nginx.org)
W0102 22:45:06.369073       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
E0102 22:45:06.369292       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.TransportServer: failed to list *v1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
W0102 22:45:08.454316       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.GlobalConfiguration: the server could not find the requested resource (get globalconfigurations.k8s.nginx.org)
E0102 22:45:08.454488       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.GlobalConfiguration: failed to list *v1.GlobalConfiguration: the server could not find the requested resource (get globalconfigurations.k8s.nginx.org)
W0102 22:45:39.547195       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.GlobalConfiguration: the server could not find the requested resource (get globalconfigurations.k8s.nginx.org)
E0102 22:45:39.547390       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.GlobalConfiguration: failed to list *v1.GlobalConfiguration: the server could not find the requested resource (get globalconfigurations.k8s.nginx.org)
W0102 22:45:47.905410       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
E0102 22:45:47.905460       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.TransportServer: failed to list *v1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
W0102 22:46:20.990758       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
E0102 22:46:20.990824       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.TransportServer: failed to list *v1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
W0102 22:46:26.407682       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.GlobalConfiguration: the server could not find the requested resource (get globalconfigurations.k8s.nginx.org)
E0102 22:46:26.407738       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.GlobalConfiguration: failed to list *v1.GlobalConfiguration: the server could not find the requested resource (get globalconfigurations.k8s.nginx.org)
W0102 22:46:59.771303       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.GlobalConfiguration: the server could not find the requested resource (get globalconfigurations.k8s.nginx.org)
E0102 22:46:59.771376       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.GlobalConfiguration: failed to list *v1.GlobalConfiguration: the server could not find the requested resource (get globalconfigurations.k8s.nginx.org)
W0102 22:47:15.589720       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
E0102 22:47:15.589764       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.TransportServer: failed to list *v1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
W0102 22:47:37.644737       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.GlobalConfiguration: the server could not find the requested resource (get globalconfigurations.k8s.nginx.org)
E0102 22:47:37.644781       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.GlobalConfiguration: failed to list *v1.GlobalConfiguration: the server could not find the requested resource (get globalconfigurations.k8s.nginx.org)
W0102 22:47:47.689894       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
E0102 22:47:47.689961       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.TransportServer: failed to list *v1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
W0102 22:48:14.720566       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.GlobalConfiguration: the server could not find the requested resource (get globalconfigurations.k8s.nginx.org)
E0102 22:48:14.720613       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.GlobalConfiguration: failed to list *v1.GlobalConfiguration: the server could not find the requested resource (get globalconfigurations.k8s.nginx.org)
W0102 22:48:44.694159       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
E0102 22:48:44.694294       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.TransportServer: failed to list *v1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
W0102 22:48:55.553736       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.GlobalConfiguration: the server could not find the requested resource (get globalconfigurations.k8s.nginx.org)
E0102 22:48:55.553777       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.GlobalConfiguration: failed to list *v1.GlobalConfiguration: the server could not find the requested resource (get globalconfigurations.k8s.nginx.org)
W0102 22:49:31.051410       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
E0102 22:49:31.051466       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.TransportServer: failed to list *v1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
W0102 22:49:35.639882       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.GlobalConfiguration: the server could not find the requested resource (get globalconfigurations.k8s.nginx.org)
E0102 22:49:35.639939       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.GlobalConfiguration: failed to list *v1.GlobalConfiguration: the server could not find the requested resource (get globalconfigurations.k8s.nginx.org)
W0102 22:50:09.679492       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
E0102 22:50:09.679542       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.TransportServer: failed to list *v1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
W0102 22:50:28.899941       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.GlobalConfiguration: the server could not find the requested resource (get globalconfigurations.k8s.nginx.org)
E0102 22:50:28.900018       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.GlobalConfiguration: failed to list *v1.GlobalConfiguration: the server could not find the requested resource (get globalconfigurations.k8s.nginx.org)
W0102 22:50:49.348262       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
E0102 22:50:49.348316       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.TransportServer: failed to list *v1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
W0102 22:51:16.285044       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.GlobalConfiguration: the server could not find the requested resource (get globalconfigurations.k8s.nginx.org)
E0102 22:51:16.285100       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.GlobalConfiguration: failed to list *v1.GlobalConfiguration: the server could not find the requested resource (get globalconfigurations.k8s.nginx.org)
W0102 22:51:20.194624       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
E0102 22:51:20.194673       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.TransportServer: failed to list *v1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
W0102 22:51:58.966050       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
E0102 22:51:58.966129       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.TransportServer: failed to list *v1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
W0102 22:52:08.240916       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.GlobalConfiguration: the server could not find the requested resource (get globalconfigurations.k8s.nginx.org)
E0102 22:52:08.240961       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.GlobalConfiguration: failed to list *v1.GlobalConfiguration: the server could not find the requested resource (get globalconfigurations.k8s.nginx.org)
W0102 22:52:44.716145       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.GlobalConfiguration: the server could not find the requested resource (get globalconfigurations.k8s.nginx.org)
E0102 22:52:44.716364       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.GlobalConfiguration: failed to list *v1.GlobalConfiguration: the server could not find the requested resource (get globalconfigurations.k8s.nginx.org)
W0102 22:52:55.372523       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
E0102 22:52:55.372584       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.TransportServer: failed to list *v1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
W0102 22:53:35.808394       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
E0102 22:53:35.808457       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.TransportServer: failed to list *v1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
W0102 22:53:42.123049       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.GlobalConfiguration: the server could not find the requested resource (get globalconfigurations.k8s.nginx.org)
E0102 22:53:42.123098       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.GlobalConfiguration: failed to list *v1.GlobalConfiguration: the server could not find the requested resource (get globalconfigurations.k8s.nginx.org)
W0102 22:54:23.161330       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
E0102 22:54:23.161552       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.TransportServer: failed to list *v1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
W0102 22:54:32.329135       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.GlobalConfiguration: the server could not find the requested resource (get globalconfigurations.k8s.nginx.org)
E0102 22:54:32.329183       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.GlobalConfiguration: failed to list *v1.GlobalConfiguration: the server could not find the requested resource (get globalconfigurations.k8s.nginx.org)
W0102 22:55:18.233623       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
E0102 22:55:18.233698       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.TransportServer: failed to list *v1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
W0102 22:55:22.054277       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.GlobalConfiguration: the server could not find the requested resource (get globalconfigurations.k8s.nginx.org)
E0102 22:55:22.054329       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.GlobalConfiguration: failed to list *v1.GlobalConfiguration: the server could not find the requested resource (get globalconfigurations.k8s.nginx.org)
W0102 22:55:55.655043       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
E0102 22:55:55.655172       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.TransportServer: failed to list *v1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
W0102 22:56:17.109320       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.GlobalConfiguration: the server could not find the requested resource (get globalconfigurations.k8s.nginx.org)
E0102 22:56:17.109407       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.GlobalConfiguration: failed to list *v1.GlobalConfiguration: the server could not find the requested resource (get globalconfigurations.k8s.nginx.org)
W0102 22:56:45.250972       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
E0102 22:56:45.251430       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.TransportServer: failed to list *v1.TransportServer: the server could not find the requested resource (get transportservers.k8s.nginx.org)
W0102 22:56:48.849193       1 reflector.go:539] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: failed to list *v1.GlobalConfiguration: the server could not find the requested resource (get globalconfigurations.k8s.nginx.org)
E0102 22:56:48.849520       1 reflector.go:147] pkg/mod/k8s.io/[email protected]/tools/cache/reflector.go:229: Failed to watch *v1.GlobalConfiguration: failed to list *v1.GlobalConfiguration: the server could not find the requested resource (get globalconfigurations.k8s.nginx.org)
@github-actions GitHub Actions
Copy link

github-actions bot commented Jan 2, 2024

Hi @kyrofa thanks for reporting!

Be sure to check out the docs and the Contributing Guidelines while you wait for a human to take a look at this 🙂

Cheers!

@jasonwilliams14
Copy link
Contributor

@kyrofa
hello there.
Did you upgrade the CRDs before you updated the helm chart?
You can find the steps on our docs page:

https://docs.nginx.com/nginx-ingress-controller/installation/installing-nic/installation-with-helm/#upgrading-the-crds

You should be able to install 1.0.2, then upgrade the CRDs (our docs walk through it), followed by upgrading to 1.1.0 of the chart.

i just did a quick test in my lab and it worked out as expected.

Let us know how it goes.

@kyrofa
Copy link
Author

kyrofa commented Jan 2, 2024

Wait, so the helm chart installs the CRDs, but it doesn't update them? That's confusing, I'm not sure I've ever used a chart that worked that way. Is there a reason the helm chart doesn't update them for me if I don't install with --skip-crds?

@brianehlert
Copy link
Collaborator

https://helm.sh/docs/chart_best_practices/custom_resource_definitions/
"There is no support at this time for upgrading or deleting CRDs using Helm. This was an explicit decision after much community discussion due to the danger for unintentional data loss. Furthermore, there is currently no community consensus around how to handle CRDs and their lifecycle. As this evolves, Helm will add support for those use cases."

We are always looking for ways to make this better.
Do your charts that have CRDs follow the two chart method?

@kyrofa
Copy link
Author

kyrofa commented Jan 3, 2024 •
edited
Loading

Do your charts that have CRDs follow the two chart method?

Ah, yes indeed, rook is a good example. I'm not going to lie though, I didn't actually know about this helm limitation until just now. I've never written a helm chart, so I've never read that part of the docs. I'll need to take a closer look at some other charts I'm using, so thanks for schooling me. This is a surprisingly sharp edge, honestly: every chart that uses CRDs needs to explicitly document this behavior (in general they don't). Also, it's not unusual for chart users to not even realize that their chart installs CRDs in the first place, so this requires a deeper knowledge of the chart than most users will have. nginx is a good example: I don't actually use any of its CRDs, so I never gave it any thought. Now I must, even though I don't directly use them. The user experience suffers, but so does the experience for you the developer, and I get that. I'm sorry you need to deal with it!

Future readers, this is a good document outlining the helm challenges.

@kyrofa
Copy link
Author

kyrofa commented Jan 3, 2024

Confirmed: manually upgrading the CRDs allowed the helm upgrade to v1.1.0 to succeed. Thanks again!

@kyrofa kyrofa closed this as completed Jan 3, 2024
@brianehlert brianehlert mentioned this issue Jan 16, 2024
Closed
@kyrofa kyrofa mentioned this issue Feb 9, 2024
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@kyrofa @brianehlert @jasonwilliams14