GenAI Microservices

GenAI microservices leverag a service composer to assemble a mega-service tailored for real-world Enterprise AI applications. All the microservices are containerized, allowing cloud native deployment. Checkout how the microservices are used in GenAI Examples.

We’re building this microservices documentation from content in the GenAIComps GitHub repository.

• Generative AI Components (GenAIComps)
• Legal Information

Microservices Table of Contents

---

Agent Microservice

• Deploy Agent microservice on Kubernetes cluster
• Agent Microservice
• Plan Execute
• RAG Agent
• SQL Agents

Animation Microservice

• Avatar Animation Microservice
• 🚀1. Start Microservice with Docker (option 1)
• 🚀2. Run the Docker container
• 🚀3. Validate Microservice

Asr Microservice

• Deploy ASR microservice on Kubernetes cluster
• ASR Microservice

Chathistory Microservice

• 📝 Chat History Microservice
• Deploy chathistory microservice on Kubernetes cluster
• 📝 Chat History Microservice with MongoDB

Cores Microservice

• Telemetry for OPEA

Dataprep Microservice

• Dataprep Microservice
• Deploy dataprep microservice on Kubernetes cluster
• Dataprep Microservice with Elasticsearch
• Dataprep Microservice with Milvus
• Dataprep Microservice for Multimodal Data with Redis
• Dataprep Microservice with Neo4J
• Dataprep Microservice with Neo4J
• Dataprep Microservice with OpenSearch
• Dataprep Microservice with PGVector
• Dataprep Microservice with Pinecone
• Dataprep Microservice with Qdrant
• Dataprep Microservice with Redis
• Dataprep Microservice
• Dataprep Microservice with VDMS
• Multimodal Dataprep Microservice with VDMS

Embeddings Microservice

• Deploy Embedding microservice on Kubernetes cluster
• Embeddings Microservice

Feedback_management Microservice

• 🗨 Feedback Management Microservice
• 🗨 Feedback Management Microservice with MongoDB

Finetuning Microservice

• Fine-tuning Microservice

Guardrails Microservice

• Trust and Safety with LLM
• Deploy guardrails microservice on Kubernetes cluster
• Bias Detection Microservice
• Factuality Check Prediction Guard Microservice
• 🚀 Start Microservice with Docker
• 🚀 Consume Factuality Check Service
• Guardrails Microservice
• Hallucination Detection Microservice
• PII Detection Prediction Guard Microservice
• 🚀 Start Microservice with Docker
• 🚀 Consume PII Detection Service
• Prompt Injection Detection Prediction Guard Microservice
• 🚀 Start Microservice with Docker
• 🚀 Consume Prompt Injection Detection Service
• Toxicity Detection Microservice

Image2image Microservice

• Image-to-Image Microservice
• 🚀1. Start Microservice with Python (Option 1)
• 🚀2. Start Microservice with Docker (Option 2)
• 3 Test Image-to-Image Service

Image2video Microservice

• Image-to-Video Microservice
• 🚀1. Start Microservice with Python (Option 1)
• 🚀2. Start Microservice with Docker (Option 2)

Intent_detection Microservice

• Intent Detection Microservice by TGI

Llms Microservice

• Deploy LLM microservice on Kubernetes cluster
• Document Summary LLM Microservice
• FAQGen LLM Microservice
• TGI LLM Microservice
• LLM Native Microservice
• Introduction
• Prediction Guard Introduction
• LLM Microservice
• LM-Eval Microservice

Lvms Microservice

• Deploy LVM microservice on Kubernetes cluster
• LVM Microservice
• LVM Microservice
• LVM Microservice
• LVM Prediction Guard Microservice
• LVM Microservice

Prompt_registry Microservice

• 🧾 Prompt Registry Microservice
• Deploy prompt microservice on Kubernetes cluster
• 🧾 Prompt Registry Microservice with MongoDB

Rerankings Microservice

• Deploy reranking microservice on Kubernetes cluster
• Reranking Microservice

Retrievers Microservice

• Deploy retriever microservice on Kubernetes cluster
• Retriever Microservice

Text2image Microservice

• Text-to-Image Microservice
• 🚀1. Start Microservice with Python (Option 1)
• 🚀2. Start Microservice with Docker (Option 2)
• 3 Test Text-to-Image Service

Text2sql Microservice

• 🛢 Text-to-SQL Microservice

Third_parties Microservice

• Multimodal Embeddings Microservice with BridgePower
• Multimodal Embeddings Microservice with CLIP
• Start Elasticsearch server
• Deploy gpt-sovits on kubernetes cluster
• Start Milvus server
• Deploy MongoDB on kubernetes cluster
• Deploy nginx on kubernetes cluster
• Start Opensearch server
• Start the Pathway Vector DB Server
• Start PGVector server
• Deploy RedisDB on kubernetes cluster
• Start Redis server
• Deploy speecht5 on kubernetes cluster
• Deploy TEI on kubernetes cluster
• Deploy TEIRERANK on kubernetes cluster
• Deploy TGI on kubernetes cluster
• Start VDMS server
• vLLM Endpoint Service
• Deploy vllm on kubernetes cluster
• Deploy whisper on kubernetes cluster

Tts Microservice

• Deploy tts microservice on Kubernetes cluster
• TTS Microservice
• GPT-SoVITS Microservice

Web_retrievers Microservice

• Deploy web-retriever microservice on Kubernetes cluster
• Web Retriever Microservice