GCP: add GKE nodepool for SIG node

[ameukam]

Related:

• GCP: experiment nodepools per SIG #8004

Setup a dedicated nodepool with taints using an external terraform module. We want evaluate running prowjobs on COS with newer machine types.

[ameukam]

/hold

[k8s-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: ameukam

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• infra/gcp/terraform/k8s-infra-prow-build/OWNERS [ameukam]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[k8s-infra-ci-robot]

Ran Plan for dir: infra/gcp/terraform/k8s-infra-prow-build workspace: default

Show Output

Terraform used the selected providers to generate the following execution
plan. Resource actions are indicated with the following symbols:
+ create

Terraform will perform the following actions:

  # module.sig_node_node_pool_1_n4_highmem_8.google_container_node_pool.nodepool will be created
+ resource "google_container_node_pool" "nodepool" {
      + cluster                     = (sensitive value)
      + id                          = (known after apply)
      + initial_node_count          = 1
      + instance_group_urls         = (known after apply)
      + location                    = (sensitive value)
      + managed_instance_group_urls = (known after apply)
      + max_pods_per_node           = (known after apply)
      + name                        = "sig-node-pool1"
      + name_prefix                 = (known after apply)
      + node_count                  = (known after apply)
      + node_locations              = (known after apply)
      + operation                   = (known after apply)
      + project                     = "k8s-infra-prow-build"
      + version                     = (known after apply)

      + autoscaling {
          + location_policy = (known after apply)
          + max_node_count  = 10
          + min_node_count  = 1
        }

      + management {
          + auto_repair  = true
          + auto_upgrade = true
        }

      + network_config (known after apply)

      + node_config {
          + disk_size_gb     = (known after apply)
          + disk_type        = "hyperdisk-balanced"
          + effective_taints = (known after apply)
          + image_type       = "COS_CONTAINERD"
          + labels           = (known after apply)
          + local_ssd_count  = (known after apply)
          + logging_variant  = (known after apply)
          + machine_type     = "n4-highmem-8"
          + metadata         = (known after apply)
          + min_cpu_platform = (known after apply)
          + oauth_scopes     = [
              + "https://www.googleapis.com/auth/cloud-platform",
            ]
          + preemptible      = false
          + service_account  = "gke-nodes-prow-build@k8s-infra-prow-build.iam.gserviceaccount.com"
          + spot             = false

          + confidential_nodes (known after apply)

          + gcfs_config (known after apply)

          + guest_accelerator (known after apply)

          + gvnic {
              + enabled = true
            }

          + kubelet_config (known after apply)

          + shielded_instance_config {
              + enable_integrity_monitoring = true
              + enable_secure_boot          = true
            }

          + taint {
              + effect = "NO_SCHEDULE"
              + key    = "dedicated"
              + value  = "sig-node"
            }

          + windows_node_config (known after apply)

          + workload_metadata_config {
              + mode = "GKE_METADATA"
            }
        }

      + upgrade_settings (known after apply)
    }

Plan: 1 to add, 0 to change, 0 to destroy.

• ▶️ To apply this plan, comment:

  atlantis apply -d infra/gcp/terraform/k8s-infra-prow-build

• 🚮 To delete this plan and lock, click here
• 🔁 To plan this project again, comment:

  atlantis plan -d infra/gcp/terraform/k8s-infra-prow-build

Plan: 1 to add, 0 to change, 0 to destroy.

---

• ⏩ To apply all unapplied plans from this Pull Request, comment:

  atlantis apply

• 🚮 To delete all plans and locks from this Pull Request, comment:

  atlantis unlock

[ameukam]

atlantis apply

[k8s-infra-ci-robot]

Ran Apply for dir: infra/gcp/terraform/k8s-infra-prow-build workspace: default

Show Output

module.sig_node_node_pool_1_n4_highmem_8.google_container_node_pool.nodepool: Creating...
module.sig_node_node_pool_1_n4_highmem_8.google_container_node_pool.nodepool: Still creating... [10s elapsed]
module.sig_node_node_pool_1_n4_highmem_8.google_container_node_pool.nodepool: Still creating... [20s elapsed]
module.sig_node_node_pool_1_n4_highmem_8.google_container_node_pool.nodepool: Still creating... [30s elapsed]
module.sig_node_node_pool_1_n4_highmem_8.google_container_node_pool.nodepool: Still creating... [40s elapsed]
module.sig_node_node_pool_1_n4_highmem_8.google_container_node_pool.nodepool: Still creating... [50s elapsed]
module.sig_node_node_pool_1_n4_highmem_8.google_container_node_pool.nodepool: Still creating... [1m0s elapsed]
module.sig_node_node_pool_1_n4_highmem_8.google_container_node_pool.nodepool: Still creating... [1m10s elapsed]
module.sig_node_node_pool_1_n4_highmem_8.google_container_node_pool.nodepool: Still creating... [1m20s elapsed]
module.sig_node_node_pool_1_n4_highmem_8.google_container_node_pool.nodepool: Still creating... [1m30s elapsed]
module.sig_node_node_pool_1_n4_highmem_8.google_container_node_pool.nodepool: Still creating... [1m40s elapsed]
module.sig_node_node_pool_1_n4_highmem_8.google_container_node_pool.nodepool: Still creating... [1m50s elapsed]
module.sig_node_node_pool_1_n4_highmem_8.google_container_node_pool.nodepool: Still creating... [2m0s elapsed]
module.sig_node_node_pool_1_n4_highmem_8.google_container_node_pool.nodepool: Still creating... [2m10s elapsed]
module.sig_node_node_pool_1_n4_highmem_8.google_container_node_pool.nodepool: Still creating... [2m20s elapsed]
module.sig_node_node_pool_1_n4_highmem_8.google_container_node_pool.nodepool: Still creating... [2m30s elapsed]
module.sig_node_node_pool_1_n4_highmem_8.google_container_node_pool.nodepool: Still creating... [2m40s elapsed]
module.sig_node_node_pool_1_n4_highmem_8.google_container_node_pool.nodepool: Still creating... [2m50s elapsed]
module.sig_node_node_pool_1_n4_highmem_8.google_container_node_pool.nodepool: Still creating... [3m0s elapsed]
module.sig_node_node_pool_1_n4_highmem_8.google_container_node_pool.nodepool: Still creating... [3m10s elapsed]
module.sig_node_node_pool_1_n4_highmem_8.google_container_node_pool.nodepool: Still creating... [3m20s elapsed]
module.sig_node_node_pool_1_n4_highmem_8.google_container_node_pool.nodepool: Still creating... [3m30s elapsed]
module.sig_node_node_pool_1_n4_highmem_8.google_container_node_pool.nodepool: Still creating... [3m40s elapsed]
module.sig_node_node_pool_1_n4_highmem_8.google_container_node_pool.nodepool: Still creating... [3m50s elapsed]
module.sig_node_node_pool_1_n4_highmem_8.google_container_node_pool.nodepool: Creation complete after 3m57s [id=projects/k8s-infra-prow-build/locations/us-central1/clusters/prow-build/nodePools/sig-node-pool1]

Apply complete! Resources: 1 added, 0 changed, 0 destroyed.

[ameukam]

/hold cancel
cc @dims @BenTheElder

[BenTheElder]

#8004 (comment)