embedding-usvc¶
Helm chart for deploying embedding microservice.
embedding-usvc depends on TEI, set TEI_EMBEDDING_ENDPOINT.
(Option1): Installing the chart separately¶
First, you need to install the tei chart, please refer to the tei chart for more information.
After you’ve deployted the tei chart successfully, please run kubectl get svc
to get the tei service endpoint, i.e. http://tei
.
To install the embedding-usvc chart, run the following:
cd GenAIInfra/helm-charts/common/embedding-usvc
export TEI_EMBEDDING_ENDPOINT="http://tei"
helm dependency update
helm install embedding-usvc . --set TEI_EMBEDDING_ENDPOINT=${TEI_EMBEDDING_ENDPOINT}
(Option2): Installing the chart with dependencies automatically¶
cd GenAIInfra/helm-charts/common/embedding-usvc
helm dependency update
helm install embedding-usvc . --set autodependency.enabled=true
Verify¶
To verify the installation, run the command kubectl get pod
to make sure all pods are running.
Then run the command kubectl port-forward svc/embedding-usvc 6000:6000
to expose the embedding-usvc service for access.
Open another terminal and run the following command to verify the service if working:
curl http://localhost:6000/v1/embeddings \
-X POST \
-d '{"text":"hello"}' \
-H 'Content-Type: application/json'
Values¶
Key |
Type |
Default |
Description |
---|---|---|---|
image.repository |
string |
|
|
service.port |
string |
|
|
TEI_EMBEDDING_ENDPOINT |
string |
|