docker compose up
docker run
Xtune
export HF_TOKEN="Your_Huggingface_API_Token"
On Intel ARC with TGI:
bash test_compose_on_arc.sh
On Intel ARC with vLLM:
bash test_compose_vllm_on_arc.sh