Support for custom vLLM image in RHOAI
Issue
- I need to use a different version of vLLM than the one that comes included with RHOAI for customizing our deployment.
- Does Red Hat provide an official repository for vLLM that we can use?
- Does upstream vLLM version is supported in Openshift AI (RHOAI)?
Environment
- Red Hat OpenShift AI (RHOAI) Self Managed
- 2.x
- 3.0
- Custom vLLM image
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.
