OpenShift Baremetal IPI installtion fails with error "failed to convert nmstate data: exit status 65"

Solution Verified - Updated -

Issue

  • OCP 4.14.z BM IPI with static IP installation fails with the journalctl logs on bootstrap showing ImageRefValidationFailed errors:

    ERROR ironic.drivers.modules.inspector.interface     raise exception.ImageRefValidationFailed(image_href=output_url,
    Mar 07 12:18:18 localhost.localdomain ironic[8540]: 2024-03-07 12:18:18.512 1 ERROR ironic.drivers.modules.inspector.interface ironic.common.exception.ImageRefValidationFailed: Validation of image href http://[xxxxxxx]:8084/master-1.initramfs failed, reason: HTTPConnectionPool(host='xxxxxxxx', port=8084): Max retries exceeded with url: /master-1
    
  • The image-customisation.service logs show this error indicating there might be a problem in networkconfig section of install-config.yaml:

    $ journalctl -u image-customization.service -f
    Mar 07 12:16:58 localhost.localdomain image-customization[8474]: {"level":"info","ts":"2024-03-07T12:16:58Z","logger":"static-server","msg":"Go Version: go1.20.12 X:strictfipsruntime"}
    Mar 07 12:16:58 localhost.localdomain image-customization[8474]: {"level":"info","ts":"2024-03-07T12:16:58Z","logger":"static-server","msg":"Go OS/Arch: linux/amd64"}
    Mar 07 12:16:58 localhost.localdomain image-customization[8474]: {"level":"info","ts":"2024-03-07T12:16:58Z","logger":"static-server","msg":"Git commit: unknown"}
    Mar 07 12:16:58 localhost.localdomain image-customization[8474]: {"level":"info","ts":"2024-03-07T12:16:58Z","logger":"static-server","msg":"Build time: unknown"}
    Mar 07 12:16:58 localhost.localdomain image-customization[8474]: {"level":"info","ts":"2024-03-07T12:16:58Z","logger":"static-server","msg":"Component: openshift/image-customization-controller was not built with version info"}
    Mar 07 12:16:58 localhost.localdomain image-customization[8474]: {"level":"error","ts":"2024-03-07T12:16:58Z","logger":"static-server","msg":"problem loading static ignitions","error":"failed to convert nmstate data: exit status 65","errorVerbose":"exit status 65\nfailed to convert nmstate data","stacktrace":"main.main\n\t/go/src/github.com/openshift/image-customization-controller/cmd/static-server/main.go:151\nruntime.main\n\t/usr/lib/golang/src/runtime/proc.go:250"}
    Mar 07 12:16:58 localhost.localdomain systemd[1]: image-customization.service: Main process exited, code=exited, status=1/FAILURE
    Mar 07 12:16:58 localhost.localdomain image-customization[8516]: cb67bfeb2b0aa981f0b1c9e2d
    Mar 07 12:16:58 localhost.localdomain systemd[1]: image-customization.service: Failed with result 'exit-code'.
    Mar 07 12:16:58 localhost.localdomain systemd[1]: image-customization.service: Consumed 21.917s CPU time.  
    

Environment

  • Red Hat Openshift Container Platform 4.15
  • Baremetal IPI with Static IPs

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content