Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Local AI Deployment container error on Kubernetes #4935

Open
kkr2320 opened this issue Mar 3, 2025 · 0 comments
Open

Local AI Deployment container error on Kubernetes #4935

kkr2320 opened this issue Mar 3, 2025 · 0 comments
Labels
bug Something isn't working unconfirmed

Comments

@kkr2320
Copy link

kkr2320 commented Mar 3, 2025

LocalAI version:
local-ai:latest-cpu

Environment, CPU architecture, OS, and Version:
OpenShift[Kubernetes] , CPU , X86_64

Describe the bug
When deploying in Openshift[kubernetes] , getting an error with container creation

Generated from kubelet on ip-10-111-60-167.ec2.internal
Error: container create failed: time="2025-03-03T19:48:00Z" level=error msg="runc create failed: unable to start container process: error during container init: error running hook #0: error running hook: exit status 1, stdout: , stderr: nvidia-container-cli.real: requirement error: invalid expression\n"

I have tried to deploy older versions , aio versions and all getting same error. The only version worked is ffmpeg , but getting error HTTP 500 - rpc error ..

I want to host only Embedding and Re-Ranking models ..

What would be right version for this architecture. ?
How to overcome this error ?
Can LocalAI run on OpenShift[Kubernetes] ?

To Reproduce
Deploy LocalAI on Kubernetes

Expected behavior
Container runing

Logs

Additional context

@kkr2320 kkr2320 added bug Something isn't working unconfirmed labels Mar 3, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working unconfirmed
Projects
None yet
Development

No branches or pull requests

1 participant