Deploy LLM microservice on Kubernetes cluster

• You should have Helm (version >= 3.15) installed. Refer to the Helm Installation Guide for more information.

• For more deployment options, refer to helm charts README.

Deploy on Kubernetes

export HFTOKEN="insert-your-huggingface-token-here"
helm install llm oci://ghcr.io/opea-project/charts/llm-uservice --set global.HUGGINGFACEHUB_API_TOKEN=${HFTOKEN} -f cpu-values.yaml