Problem when upgrade from 4.15.0-0.okd-2024-03-10-010116 to 4.16.0-okd-scos.1

[balait4]

Hi,

I'm upgrading from 4.15.0-0.okd-2024-03-10-010116 to 4.16.0-okd-scos.1 stuck in the machine-config where getting the below error: content mismatch for file "/usr/local/bin/configure-ovs.sh

E0226 21:43:05.504060    1986 writer.go:226] Marking Degraded due to: unexpected on-disk state validating against rendered-worker-df8c66ce3c927a173d4596de56cb5889: content mismatch for file "/usr/local/bin/configure-ovs.sh"

Though we never touched this file manually. So how to deal with this now? Any help on this please.
upgrade_filed.txt

Thanks

[alexander-bruun]

Open a debug shell to the node with oc debug node/node-name, then write chroot /host.

Then you can force the Machine Config Operator to overwrite the mismatched file by executing: touch /run/machine-config-daemon-force, now follow the logs for the Machine Config daemon on that specific node and see it go along.

But be aware this can destroy your cluster, if its trying to write a invalid file that differentiates from the expected. So do your due diligence and compare the previous MachineConfigPool with the new.

[balait4]

thanks a lot it worked!