Reranking Microservice¶

The Reranking Microservice, fueled by reranking models, stands as a straightforward yet immensely potent tool for semantic search. When provided with a query and a collection of documents, reranking swiftly indexes the documents based on their semantic relevance to the query, arranging them from most to least pertinent. This microservice significantly enhances overall accuracy. In a text retrieval system, either a dense embedding model or a sparse lexical search index is often employed to retrieve relevant text documents based on the input. However, a reranking model can further refine this process by rearranging potential candidates into a final, optimized order.

🚀1. Start Microservice with Python (Option 1)¶

To start the Reranking microservice, you must first install the required python packages.

1.1 Install Requirements¶

pip install -r requirements.txt

1.2 Install fastRAG¶

git clone https://github.com/IntelLabs/fastRAG.git
cd fastRag
pip install .
pip install .[intel]

1.3 Start Reranking Service with Python Script¶

export EMBED_MODEL="Intel/bge-small-en-v1.5-rag-int8-static"
python local_reranking.py

🚀2. Start Microservice with Docker (Option 2)¶

2.1 Setup Environment Variables¶

export EMBED_MODEL="Intel/bge-small-en-v1.5-rag-int8-static"

2.2 Build Docker Image¶

cd ../../../
docker build -t opea/reranking-fastrag:latest --build-arg https_proxy=$https_proxy --build-arg http_proxy=$http_proxy -f comps/reranks/fastrag/Dockerfile .

2.3 Run Docker¶

docker run -d --name="reranking-fastrag-server" -p 8000:8000 --ipc=host -e http_proxy=$http_proxy -e https_proxy=$https_proxy -e EMBED_MODEL=$EMBED_MODEL opea/reranking-fastrag:latest

🚀3. Consume Reranking Service¶

3.1 Check Service Status¶

curl http://localhost:8000/v1/health_check \
  -X GET \
  -H 'Content-Type: application/json'

3.2 Consume Reranking Service¶

curl http://localhost:8000/v1/reranking \
  -X POST \
  -d '{"initial_query":"What is Deep Learning?", "retrieved_docs": [{"text":"Deep Learning is not..."}, {"text":"Deep learning is..."}]}' \
  -H 'Content-Type: application/json'