Multimodal Dataprep Microservice with VDMS

For dataprep microservice, we currently provide one framework: Langchain.

🚀1. Start Microservice with Python (Option 1)

1.1 Install Requirements

• option 1: Install Single-process version (for 1-10 files processing)

  apt-get update
  apt-get install -y default-jre tesseract-ocr libtesseract-dev poppler-utils
  pip install -r requirements.txt
  

1.2 Start VDMS Server

docker run -d --name="vdms-vector-db" -p 55555:55555 intellabs/vdms:latest

1.3 Setup Environment Variables

export http_proxy=${your_http_proxy}
export https_proxy=${your_http_proxy}
export host_ip=$(hostname -I | awk '{print $1}')
export VDMS_HOST=${host_ip}
export VDMS_PORT=55555
export INDEX_NAME="rag-vdms"
export your_hf_api_token="{your_hf_token}"
export PYTHONPATH=${path_to_comps}

1.4 Start Data Preparation Microservice for VDMS with Python Script

Start document preparation microservice for VDMS with below command.

python ingest_videos.py

🚀2. Start Microservice with Docker (Option 2)

2.1 Start VDMS Server

docker run -d --name="vdms-vector-db" -p 55555:55555 intellabs/vdms:latest

2.1 Setup Environment Variables

export http_proxy=${your_http_proxy}
export https_proxy=${your_http_proxy}
export host_ip=$(hostname -I | awk '{print $1}')
export VDMS_HOST=${host_ip}
export VDMS_PORT=55555
export INDEX_NAME="rag-vdms"
export your_hf_api_token="{your_hf_token}"

2.3 Build Docker Image

• Build docker image

  cd ../../../
  docker build -t opea/dataprep-vdms:latest --network host --build-arg https_proxy=$https_proxy --build-arg http_proxy=$http_proxy -f comps/dataprep/vdms/multimodal_langchain/Dockerfile .
  

2.4 Run Docker Compose

docker compose -f comps/dataprep/vdms/multimodal_langchain/docker-compose-dataprep-vdms.yaml up -d

🚀3. Status Microservice

docker container logs -f dataprep-vdms-server

🚀4. Consume Microservice

Once data preparation microservice for VDMS is started, user can use below command to invoke the microservice to convert the videos to embedding and save to the database.

Make sure the file path after files=@ is correct.

• Single file upload

  curl -X POST \
       -H "Content-Type: multipart/form-data" \
       -F "files=@./file1.mp4" \
       http://localhost:6007/v1/dataprep
  

• Multiple file upload

  curl -X POST \
       -H "Content-Type: multipart/form-data" \
       -F "files=@./file1.mp4" \
       -F "files=@./file2.mp4" \
       -F "files=@./file3.mp4" \
       http://localhost:6007/v1/dataprep
  

• List of uploaded files

  curl -X GET http://localhost:6007/v1/dataprep/get_videos
  

• Download uploaded files

  Use the file name from the list

  curl -X GET http://localhost:6007/v1/dataprep/get_file/${filename}