Allow defining a default base model in the lora syncer configuration

[kaushikmitr]

This pull request introduces a new feature to set a default base model for LoRA adapters, which simplifies the configuration by reducing repetition. The most important changes include updates to configuration files, documentation, and the sidecar code to support this new feature.

New Feature: Default Base Model for LoRA Adapters

• config/manifests/vllm/gpu-deployment.yaml: Added defaultBaseModel field to specify a default base model for all adapters when not specified individually. Removed redundant base-model entries from individual adapters.
• site-src/guides/adapter-rollout.md: Updated ConfigMap examples to include the defaultBaseModel field and removed redundant base-model entries from individual adapters.
• tools/dynamic-lora-sidecar/README.md: Updated documentation to explain the new defaultBaseModel field and provided example configurations.
• tools/dynamic-lora-sidecar/deployment.yaml: Updated deployment configuration to use defaultBaseModel and removed redundant base-model entries from individual adapters.
• tools/dynamic-lora-sidecar/sidecar/sidecar.py: Added default_base_model property to retrieve the default base model from the configuration and used it in ensure_exist_adapters and ensure_not_exist_adapters methods.
• tools/dynamic-lora-sidecar/sidecar/validation.yaml: Updated schema validation to include defaultBaseModel and adjusted descriptions for base-model to indicate it overrides the default base model.

[k8s-ci-robot]

Hi @kaushikmitr. Thanks for your PR.

I'm waiting for a kubernetes-sigs member to verify that this patch is reasonable to test. If it is, they should reply with /ok-to-test on its own line. Until that is done, I will not automatically test new commits in this PR, but the usual testing commands by org members will still work. Regular contributors should join the org to skip this step.

Once the patch is verified, the new status will be reflected by the ok-to-test label.

I understand the commands that are listed here.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

[netlify]

✅ Deploy Preview for gateway-api-inference-extension ready!

Name	Link
🔨 Latest commit	0562977
🔍 Latest deploy log	https://app.netlify.com/sites/gateway-api-inference-extension/deploys/67e72c43b6d160000802fb5d
😎 Deploy Preview	https://deploy-preview-609--gateway-api-inference-extension.netlify.app
📱 Preview on mobile	Toggle QR Code... Use your smartphone camera to open QR code link.

---

To edit notification comments on pull requests, go to your Netlify site configuration.

[ahg-g]

/ok-to-test

[kaushikmitr]

added default base model functionality to config map

[ahg-g]

Great, can you please also update:

1. The ConfigMap in the deployment manifests to only set the defaultBaseModel: https://github.com/kubernetes-sigs/gateway-api-inference-extension/tree/main/config/manifests/vllm

2. The manifests in the guide to use the defaultBaseModel: https://github.com/kubernetes-sigs/gateway-api-inference-extension/blob/main/site-src/guides/adapter-rollout.md

[kaushikmitr]

updated public docs and deployment yaml

[ahg-g]

us-central1-docker.pkg.dev/k8s-staging-images/gateway-api-inference-extension/lora-syncer:main

[kaushikmitr]

done

[ahg-g]

/lgtm
/approve

[k8s-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: ahg-g, kaushikmitr

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [ahg-g]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[ahg-g]

/ok-to-test