# OPEA Release Notes v0.7

## OPEA Highlights

- Add 3 MegaService examples: Translation, SearchQnA and AudioQnA
- Add 4 MicroService and LLM supports llamaIndex, vllm, RayServe
- Enable Dataprep: extract info from table, image...etc
- Add HelmChart and GenAI Microservice Connector(GMC) test

## GenAIExamples

- ChatQnA
    - ChatQnA supports Qwen2([422b4b](https://github.com/opea-project/GenAIExamples/commit/422b4bc56b4e5500538b3d75209320d0a415483b))
    - Add no_proxy in docker compose yaml for micro services([99eb6a](https://github.com/opea-project/GenAIExamples/commit/99eb6a6a7eab4a6d24cbb47d4a541ff4aef41b57), [240587](https://github.com/opea-project/GenAIExamples/commit/240587932b04adeaf740d70229dd27ebd42d5dcd))
    - Fix DataPrep image build in ChatQnA([2fb070](https://github.com/opea-project/GenAIExamples/commit/2fb070dbfd9352d56a7be13606318aa583852a0f))
    - Add Nvidia GPU support for ChatQnA([e80e56](https://github.com/opea-project/GenAIExamples/commit/e80e567817439af1b70b56ff4a60fa58c24e2439))
    - Update ChatQnA docker_compose.yaml to fix downloads failing([e948a7](https://github.com/opea-project/GenAIExamples/commit/e948a7f81b2b68e62b09ad66be35414bf04babd5), [f2a943](https://github.com/opea-project/GenAIExamples/commit/f2a94377aa5e9850a7590c31fd8613f65fdef83c))
    - Chat QNA React UI with conversation history([b994bc](https://github.com/opea-project/GenAIExamples/commit/b994bc87318f245a07e099b395fa49ca3f36baba))
    - Adapt Chinese characters([2f4723](https://github.com/opea-project/GenAIExamples/commit/2f472315fdd4934b4f50b6120a0d583000d7751c))

- Other examples
    - Refactor Translation Example([409c723](https://github.com/opea-project/GenAIExamples/commit/409c72350e84867ca1ea555c327fe13d00afd926))
    - Add AudioQnA with GenAIComps([b4d8e1](https://github.com/opea-project/GenAIExamples/commit/b4d8e1a19b7cb141dd509c40711d74be26c282ce))
    - Add SearchQnA with GenAIComps([6b76a9](https://github.com/opea-project/GenAIExamples/commit/6b76a93eb70738459d3fd553c44d6e7c120a51b3))
    - Add env for searchqna([d9b62a](https://github.com/opea-project/GenAIExamples/commit/d9b62a5a62d5c192ed34f598f3769378b7f594a1))
    - Supports ASR on HPU([2a4860](https://github.com/opea-project/GenAIExamples/commit/2a48601227557833cae721ad12418060b50dd62e))
    - Fix DocSum Gaudi building instructions([29de55](https://github.com/opea-project/GenAIExamples/commit/29de55da3ca0978123644ccfccdc53da20fc0791))
    - Add image build job in docker compose e2e gaudi test in CI([4fecd4](https://github.com/opea-project/GenAIExamples/commit/4fecd6a850d9b4cc0c4cd88d9987b5ef890c1aa2))

- CI
    - Add docker build job in manifest e2e workflow([c5f309](https://github.com/opea-project/GenAIExamples/commit/c5f3095ea5c0016e4e9a2568ff063a5da4f6ef48))
    - Create reuse workflow for get-test-matrix in CI([961abb](https://github.com/opea-project/GenAIExamples/commit/961abb3c05c2bfb02e1cbae12ec7a67c3c0dfc8f))
    - Enable new CI runner and improve manifest e2e test scripts([26d6ea](https://github.com/opea-project/GenAIExamples/commit/26d6ea4724aeaef9fc258d79226ed15e3c325d76))
    - Enable building latest megaservice image on push event in CI([a0b94b](https://github.com/opea-project/GenAIExamples/commit/a0b94b540180ddba7892573b2d9ce8b0eb16b403))
    - Fix the image build refer([01eed8](https://github.com/opea-project/GenAIExamples/commit/01eed84db13656a000edd8e47f1e24dbbe2b067a))
    - Add build docker image option for test scripts([e32a51](https://github.com/opea-project/GenAIExamples/commit/e32a51451c38c35ee4bf27e58cb47f824821ce8d))
    - Add e2e test of chatqna([afcb3a](https://github.com/opea-project/GenAIExamples/commit/afcb3a)), codetrans([295b818](https://github.com/opea-project/GenAIExamples/commit/295b818)), codegen([960cf38](https://github.com/opea-project/GenAIExamples/commit/960cf38)), docsum([2e62ecc](https://github.com/opea-project/GenAIExamples/commit/2e62ecc)))

## GenAIComps

- Cores
    - Add aio orchestrator to boost concurrent serving([db3b4f](https://github.com/opea-project/GenAIComps/commit/db3b4f13fa8fc258236d4cc504f1a083d5fd95df))
    - Add microservice level perf statistics([597b3c](https://github.com/opea-project/GenAIComps/commit/597b3ca7d243ff74ce108ded6255e73df01d2486), [ba1d11](https://github.com/opea-project/GenAIComps/commit/ba1d11d93299f2b1d5e53f747aed73cff0384dda))
    - Add Gateway for Translation([1b654d](https://github.com/opea-project/GenAIComps/commit/1b654de29d260043d8a5811a265013d5f5b4b6e1))

- LLM
    - Support Qwen2 in LLM Microservice([3f5cde](https://github.com/opea-project/GenAIComps/commit/3f5cdea67d3789be72aafc70364fd1e0cbe6cfaf))
    - Fix the vLLM docker compose issues([3d134d](https://github.com/opea-project/GenAIComps/commit/3d134d260b8968eb9ca18162b2f0d86aa15a85b3))
    - Enable vLLM Gaudi support for LLM service based on officially habana vllm release([0dedc2](https://github.com/opea-project/GenAIComps/commit/0dedc28af38019e92eaf595935907de82c6a1cf5))
    - Openvino support in vllm([7dbad0](https://github.com/opea-project/GenAIComps/commit/7dbad0706d820f3c6ff8e8b4dd0ee40b7c389ff4))
    - Support Ollama microservice([a00e36](https://github.com/opea-project/GenAIComps/commit/a00e3641f25a7b515f427f1fbbcc893d85d97f85))
    - Support vLLM XFT LLM microservice([2a6a29](https://github.com/opea-project/GenAIComps/commit/2a6a29fda4ff13af5488912974b431390ed2ebc2), [309c2d](https://github.com/opea-project/GenAIComps/commit/309c2da5e18ce75b3ecc3ff3f2d71d51477ad4d1), [fe5f39](https://github.com/opea-project/GenAIComps/commit/fe5f39452b7fbca7e512611cef8c1a90c08feae8))
    - Add e2e test for llm summarization tgi([e8ebd9](https://github.com/opea-project/GenAIComps/commit/e8ebd948ee3518860838b50ca59d999d4f028d7c))

- DataPrep
    - Support Dataprep([f7443f](https://github.com/opea-project/GenAIComps/commit/f7443f)), embedding([f37ce2](https://github.com/opea-project/GenAIComps/commit/f37ce2)) microservice with Llama Index
    - Fix dataprep microservice path issue([e20acc](https://github.com/opea-project/GenAIComps/commit/e20acc))
    - Add milvus microservice([e85033](https://github.com/opea-project/GenAIComps/commit/e85033))
    - Add Ray version for multi file process([40c1aa](https://github.com/opea-project/GenAIComps/commit/40c1aa))
    - Fix dataprep timeout issue([61ead4](https://github.com/opea-project/GenAIComps/commit/61ead4))
    - Add e2e test for dataprep redis langchain([6b7bec](https://github.com/opea-project/GenAIComps/commit/6b7bec))
    - Supported image summarization with LVM in dataprep microservice([86412c](https://github.com/opea-project/GenAIComps/commit/86412c))
    - Enable conditional splitting for html files([e1dad1](https://github.com/opea-project/GenAIComps/commit/e1dad1))
    - Added support for pyspark in dataprep microservice([a5eb14](https://github.com/opea-project/GenAIComps/commit/a5eb14))
    - DataPrep extract info from table in the docs([953e78](https://github.com/opea-project/GenAIComps/commit/953e78))
    - Added support for extracting info from image in the docs([e23745](https://github.com/opea-project/GenAIComps/commit/e23745))

- Other Components
    - Add PGvector support in Vectorstores([1b7001](https://github.com/opea-project/GenAIComps/commit/1b7001)) and Retriever([75eff6](https://github.com/opea-project/GenAIComps/commit/75eff6)), Dataprep([9de3c7](https://github.com/opea-project/GenAIComps/commit/9de3c7))
    - Add Mosec embedding([f76685](https://github.com/opea-project/GenAIComps/commit/f76685)) and reranking([a58ca4](https://github.com/opea-project/GenAIComps/commit/a58ca4))
    - Add knowledge graph components([4c0afd](https://github.com/opea-project/GenAIComps/commit/4c0afd))
    - Add LVMs LLaVA component([bd385b](https://github.com/opea-project/GenAIComps/commit/bd385b))
    - Add asr/tts components for xeon and hpu([cef6ea](https://github.com/opea-project/GenAIComps/commit/cef6ea))
    - Add WebSearch Retriever Microservice([900178](https://github.com/opea-project/GenAIComps/commit/900178))
    - Add initial pii detection microservice([e38041](https://github.com/opea-project/GenAIComps/commit/e38041))
    - Pinecone support for dataprep and retrieval microservice([8b6486](https://github.com/opea-project/GenAIComps/commit/8b6486))
    - Support prometheus metrics for opea microservices([758914](https://github.com/opea-project/GenAIComps/commit/758914)), ([900178](https://github.com/opea-project/GenAIComps/commit/900178))
    - Add no_proxy env for micro services([df0c11](https://github.com/opea-project/GenAIComps/commit/df0c11))
    - Enable RAGAS([8a670e](https://github.com/opea-project/GenAIComps/commit/8a670e))
    - Fix RAG performance issues([70c23d](https://github.com/opea-project/GenAIComps/commit/70c23d))
    - Support rerank and retrieval of RAG OPT([b51675](https://github.com/opea-project/GenAIComps/commit/b51675))
    - Reranking using an optimized bi-encoder([574847](https://github.com/opea-project/GenAIComps/commit/574847))
    - Use parameter for retriever([358dbd](https://github.com/opea-project/GenAIComps/commit/358dbd)), reranker([dfdd08](https://github.com/opea-project/GenAIComps/commit/dfdd08))

- CI
    - CI optimization to support multiple test for single kind of service([38f646](https://github.com/opea-project/GenAIComps/commit/38f646))
    - Update CI to support dataprep_redis path level change([5c0773](https://github.com/opea-project/GenAIComps/commit/5c0773))
    - Enable python coverage([cd91cf](https://github.com/opea-project/GenAIComps/commit/cd91cf))
    - Add codecov([da2689](https://github.com/opea-project/GenAIComps/commit/da2689))
    - Enable microservice docker images auto build and push([16c5fd](https://github.com/opea-project/GenAIComps/commit/16c5fd))

## GenAIEvals

- Enable autorag to automatically generate the evaluation dataset and evaluate the RAG system([b24bff](https://github.com/opea-project/GenAIEval/commit/b24bff))
- Support document summarization evaluation with microservice([3ec544](https://github.com/opea-project/GenAIEval/commit/3ec544))
- Add RAGASMetric([7406bf](https://github.com/opea-project/GenAIEval/commit/7406bf))
- Update install bkc([26ddcc](https://github.com/opea-project/GenAIEval/commit/26ddcc))

## GenAIInfra

- GMC
    - Enable gmc e2e for manifests changes and some minor fix ([758432](https://github.com/opea-project/GenAIInfra/commit/758432))
    - GMC: make "namespace" field of each resource in the CR optional ([7073ac](https://github.com/opea-project/GenAIInfra/commit/7073ac))
    - ChatQnA demo yaml files integration between GMC and Oneclick ([020899](https://github.com/opea-project/GenAIInfra/commit/020899))
    - Add gmc e2e ([595185](https://github.com/opea-project/GenAIInfra/commit/595185))
    - Add docker build and push target for GMC ([04d7f2](https://github.com/opea-project/GenAIInfra/commit/04d7f2))
    - GMC: overwrite config map template before GMC resources are deployed ([ce9190](https://github.com/opea-project/GenAIInfra/commit/ce9190))
    - GMC: replace the service and deployment name if GMC has defined ([eec845](https://github.com/opea-project/GenAIInfra/commit/eec845))
    - Add gmc guide ([6bb8a3](https://github.com/opea-project/GenAIInfra/commit/6bb8a3))
    - GMC: adopt separate e2e for gaudi and xeon ([c5075b](https://github.com/opea-project/GenAIInfra/commit/c5075b))
    - Update readme and user guide for GMC ([2d17c9](https://github.com/opea-project/GenAIInfra/commit/2d17c9))
    - GMC: add Codetrans example ([aed70d](https://github.com/opea-project/GenAIInfra/commit/aed70d))
    - Enable GMC e2e on Gaudi ([d204a7](https://github.com/opea-project/GenAIInfra/commit/d204a7))

- HelmChart
    - Helm chart: Add default minimal pod security ([8fcf0a](https://github.com/opea-project/GenAIInfra/commit/8fcf0a))
    - Support e2e test for chatqna helm chart ([2f317d](https://github.com/opea-project/GenAIInfra/commit/2f317d))
    - Add helm charts for deploy ChatQnA ([20dce6](https://github.com/opea-project/GenAIInfra/commit/20dce6))
    - Reorg of helm charts ([d332c2](https://github.com/opea-project/GenAIInfra/commit/d332c2))

- Others
   - Add DocSum llm service manifests ([9ab8de](https://github.com/opea-project/GenAIInfra/commit/9ab8de))
   - Enable golang e2e test in CI ([bc9aba](https://github.com/opea-project/GenAIInfra/commit/bc9aba))
   - Add e2e test for docsum example ([89aa5a](https://github.com/opea-project/GenAIInfra/commit/89aa5a))
   - Add docsum example on both xeon and gaudi node ([c88817](https://github.com/opea-project/GenAIInfra/commit/c88817))