OPEA microservice¶
Helm chart for deploying OPEA example service.
Installing the Chart¶
To install the chart, run the following:
cd GenAIInfra/helm-charts/common
export HFTOKEN="insert-your-huggingface-token-here"
# To deploy <CHARTNAME> microserice on CPU
helm install <CHARTNAME> <CHARTNAME> --set global.HUGGINGFACEHUB_API_TOKEN=${HFTOKEN}
Verify¶
To verify the installation, run the command kubectl get pod
to make sure all pods are running and in ready state.
Then run the command kubectl port-forward svc/<CHARTNAME> 8080:8080
to expose the corresponding K8s service for access.
Open another terminal and run the following command to verify the service if working:
curl http://localhost:8080/v1/<CHARTNAME> \
-X POST \
-H 'Content-Type: application/json' \
-d '<service specific content>'
Values¶
Key |
Type |
Default |
Description |
---|---|---|---|
global.HUGGINGFACEHUB_API_TOKEN |
string |
|
HuggingFace API token |