GenAI Microservices¶
GenAI microservices leverag a service composer to assemble a mega-service tailored for real-world Enterprise AI applications. All the microservices are containerized, allowing cloud native deployment. Checkout how the microservices are used in GenAI Examples.
We’re building this microservices documentation from content in the GenAIComps GitHub repository.
Microservices Table of Contents
Agent Microservice¶
Asr Microservice¶
Chathistory Microservice¶
Cores Microservice¶
Dataprep Microservice¶
- Dataprep Microservice
- Dataprep Microservice with Milvus
- Dataprep Microservice for Multimodal Data with Redis
- Dataprep Microservice with Neo4J
- Dataprep Microservice with PGVector
- Dataprep Microservice with Pinecone
- Dataprep Microservice with Qdrant
- Dataprep Microservice with Redis
- Dataprep Microservice with VDMS
- Multimodal Dataprep Microservice with VDMS
Embeddings Microservice¶
Feedback_management Microservice¶
Finetuning Microservice¶
Guardrails Microservice¶
- Trust and Safety with LLM
- Bias Detection Microservice
- Factuality Check Prediction Guard Microservice
- 🚀 Start Microservice with Docker
- 🚀 Consume Factuality Check Service
- Guardrails Microservice
- PII Detection Microservice
- PII Detection Prediction Guard Microservice
- 🚀 Start Microservice with Docker
- 🚀 Consume PII Detection Service
- Prompt Injection Detection Prediction Guard Microservice
- 🚀 Start Microservice with Docker
- 🚀 Consume Prompt Injection Detection Service
- Toxicity Detection Microservice
- Toxicity Checking Prediction Guard Microservice
- 🚀 Start Microservice with Docker
- 🚀 Consume Toxicity Check Service
- Guardrails Microservice