GenAI Microservices¶
GenAI microservices leverag a service composer to assemble a mega-service tailored for real-world Enterprise AI applications. All the microservices are containerized, allowing cloud native deployment. Checkout how the microservices are used in GenAI Examples.
We’re building this microservices documentation from content in the GenAIComps GitHub repository.
Microservices Table of Contents
Agent Microservice¶
Animation Microservice¶
Asr Microservice¶
Chathistory Microservice¶
Cores Microservice¶
Dataprep Microservice¶
- Dataprep Microservice
- Dataprep Microservice with Milvus
- Multimedia to Text Services
- Test Data for Document Summarization
- Dataprep Microservice for Multimodal Data with Redis
- Dataprep Microservice with Neo4J
- Dataprep Microservice with Neo4J
- Dataprep Microservice with PGVector
- Dataprep Microservice with Pinecone
- Dataprep Microservice with Qdrant
- Dataprep Microservice with Redis
- Dataprep Microservice with VDMS
- Multimodal Dataprep Microservice with VDMS
Embeddings Microservice¶
Feedback_management Microservice¶
Finetuning Microservice¶
Guardrails Microservice¶
- Trust and Safety with LLM
- Bias Detection Microservice
- Factuality Check Prediction Guard Microservice
- 🚀 Start Microservice with Docker
- 🚀 Consume Factuality Check Service
- Guardrails Microservice
- PII Detection Microservice
- PII Detection Prediction Guard Microservice
- 🚀 Start Microservice with Docker
- 🚀 Consume PII Detection Service
- Prompt Injection Detection Prediction Guard Microservice
- 🚀 Start Microservice with Docker
- 🚀 Consume Prompt Injection Detection Service
- Toxicity Detection Microservice
- Toxicity Checking Prediction Guard Microservice
- 🚀 Start Microservice with Docker
- 🚀 Consume Toxicity Check Service
- Guardrails Microservice
Image2image Microservice¶
Image2video Microservice¶
Intent_detection Microservice¶
Llms Microservice¶
- TGI FAQGen LLM Microservice
- vLLM FAQGen LLM Microservice
- Document Summary TGI Microservice
- Document Summary vLLM Microservice
- LLM Microservice
- LLM Native Microservice
- LLM Native Microservice
- Introduction
- Prediction Guard Introduction
- TGI LLM Microservice
- vLLM Endpoint Service
- vLLM Endpoint Service
- LM-Eval Microservice
Lvms Microservice¶
Nginx Microservice¶
Prompt_registry Microservice¶
Ragas Microservice¶
Reranks Microservice¶
Retrievers Microservice¶
- Retriever Microservice
- Retriever Microservice with Milvus
- Retriever Microservice
- Retriever Microservice with Neo4J
- Retriever Microservice with Neo4J
- Retriever Microservice with Pathway
- Retriever Microservice
- Retriever Microservice with Qdrant
- Retriever Microservice
- Retriever Microservice
- Retriever Microservice