Deploy FaqGen with ReactUI¶
The README provides a step-by-step guide on how to deploy FaqGen with ReactUI, a popular React-based user interface library in Kubernetes cluster.
You can use react-faqgen.yaml to deploy FaqGen with reactUI.
kubectl apply -f react-faqgen.yaml
Prerequisites for Deploying FaqGen with ReactUI¶
Before deploying the react-faqgen.yaml file, ensure that you have the following prerequisites in place:
Kubernetes installation: Make sure that you have Kubernetes installed.
Configuration Values: Set the following values in react-faqgen.yaml before proceeding with the deployment: a. HUGGINGFACEHUB_API_TOKEN (Your HuggingFace token to download your desired model from HuggingFace):
# You may set the HUGGINGFACEHUB_API_TOKEN via method: export HUGGINGFACEHUB_API_TOKEN="YourOwnToken" cd GenAIExamples/FaqGen/kubernetes/intel/cpu/xeon/manifests/ui/ sed -i "s/insert-your-huggingface-token-here/${HUGGINGFACEHUB_API_TOKEN}/g" react-faqgen.yaml
b. Set the proxies based on your network configuration# Look for http_proxy, https_proxy, no_proxy key and fill up the value with your proxy configuration.
MODEL_ID and model-volume (OPTIONAL): You may as well customize the “MODEL_ID” to use different model and model-volume for the volume to be mounted.
After completing these, you can proceed with the deployment of the react-faqgen.yaml file.
Verify Services¶
Make sure all the pods are running, you should see total of 4 pods running:
faqgen
faqgen-llm-uservice
faqgen-react-ui
faqgen-tgi
You may open up the UI by using the faqgen-react-ui endpoint in the browser.