DocSum E2E test scripts¶
Set the required environment variable¶
export HUGGINGFACEHUB_API_TOKEN="Your_Huggingface_API_Token"
Run test¶
On Intel Xeon with vLLM:
bash test_compose_on_xeon.sh
On Intel Xeon with TGI:
bash test_compose_tgi_on_xeon.sh
On Intel Gaudi with vLLM:
bash test_compose_on_gaudi.sh
On Intel Gaudi with TGI:
bash test_compose_tgi_on_gaudi.sh
On AMD ROCm with TGI:
bash test_compose_on_rocm.sh
On AMD ROCm with vLLM:
bash test_compose_vllm_on_rocm.sh