GenAI Microservices

GenAI microservices leverag a service composer to assemble a mega-service tailored for real-world Enterprise AI applications. All the microservices are containerized, allowing cloud native deployment. Checkout how the microservices are used in GenAI Examples.

We’re building this microservices documentation from content in the GenAIComps GitHub repository.

• Generative AI Components (GenAIComps)
• Legal Information

Microservices Table of Contents

---

Agent Microservice

• Agent Microservice
• Plan Execute
• RAG Agent

Asr Microservice

• ASR Microservice

Chathistory Microservice

• Chat History Microservice

Cores Microservice

• Telemetry for OPEA

Dataprep Microservice

• Dataprep Microservice
• Dataprep Microservice with Milvus
• Dataprep Microservice for Multimodal Data with Redis
• Dataprep Microservice with Neo4J
• Dataprep Microservice with PGVector
• Dataprep Microservice with Pinecone
• Dataprep Microservice with Qdrant
• Dataprep Microservice with Redis
• Dataprep Microservice with VDMS
• Multimodal Dataprep Microservice with VDMS

Embeddings Microservice

• Embeddings Microservice
• build Mosec endpoint docker image
• Embedding Server
• Multimodal Embeddings Microservice
• Multimodal CLIP Embeddings Microservice
• Embedding Generation Prediction Guard Microservice
• Embeddings Microservice with Langchain TEI
• Embeddings Microservice with Llama Index TEI

Feedback_management Microservice

• Feedback Management Microservice

Finetuning Microservice

• Fine-tuning Microservice

Guardrails Microservice

• Trust and Safety with LLM
• Bias Detection Microservice
• Guardrails Microservice
• PII Detection Microservice
• Toxicity Detection Microservice

Intent_detection Microservice

• Intent Detection Microservice by TGI

Knowledgegraphs Microservice

• Knowledge Graph Microservice

Llms Microservice

• TGI FAQGen LLM Microservice
• Document Summary TGI Microservice
• LLM Microservice
• LLM Native Microservice
• LLM Native Microservice
• Introduction
• Prediction Guard Introduction
• TGI LLM Microservice
• vLLM Endpoint Service
• vLLM Endpoint Service
• VLLM-Ray Endpoint Service
• LM-Eval Microservice

Lvms Microservice

• LVM Microservice
• LVM Prediction Guard Microservice
• LVM Microservice

Nginx Microservice

• Nginx for Microservice Forwarding

Prompt_registry Microservice

• Prompt Registry Microservice

Ragas Microservice

Reranks Microservice

• Reranking Microservice
• build reranking Mosec endpoint docker image
• Reranking Microservice
• Rerank Microservice

Retrievers Microservice

• Retriever Microservice
• Retriever Microservice with Milvus
• Retriever Microservice
• Retriever Microservice with Neo4J
• Retriever Microservice with Pathway
• Retriever Microservice
• Retriever Microservice with Qdrant
• Retriever Microservice
• Retriever Microservice
• Retriever Microservice

Tts Microservice

• TTS Microservice

Vectorstores Microservice

• Vectorstores Microservice
• Start Chroma server
• Start LanceDB Server
• Start Milvus server
• Start the Pathway Vector DB Server
• Start PGVector server
• Pinecone setup
• Start Qdrant server
• Start Redis server
• Start VDMS server

Web_retrievers Microservice

• Web Retriever Microservice