ChatQnA Deployment¶
This document guides you through deploying ChatQnA pipelines using Helm charts. Helm charts simplify managing Kubernetes applications by packaging configuration and resources.
Getting Started¶
Preparation¶
# on k8s-master node
cd GenAIExamples/ChatQnA/benchmark/performance/helm_charts
# Replace the key of HUGGINGFACEHUB_API_TOKEN with your actual Hugging Face token:
# vim customize.yaml
HUGGINGFACEHUB_API_TOKEN: hf_xxxxx
Deploy your ChatQnA¶
# Deploy a ChatQnA pipeline using the specified YAML configuration.
# To deploy with different configurations, simply provide a different YAML file.
helm install chatqna helm_charts/ -f customize.yaml
Notes: The provided BKC manifests for single, two, and four node Kubernetes clusters are generated using this tool.
Customize your own ChatQnA pipelines. (Optional)¶
There are two yaml configs you can specify.
customize.yaml This file can specify image names, the number of replicas and CPU cores to manage your pods.
values.yaml This file contains the default microservice configurations for ChatQnA. Please review and understand each parameter before making any changes.