Open Platform for Enterprise AI - OPEA
OPEA (Open Platform for Enterprise AI) is an AI inferencing and finetuning microservice framework that enables the creation and evaluation of open, configurable, and composable generative AI solutions.
Product Description
Overview
The OPEA platform includes:
Detailed framework of composable microservices building blocks for state-of-the-art GenAI systems including LLMs, data stores, and prompt engines
Architectural blueprints of retrieval-augmented GenAI component stack structure and end-to-end workflows
Multiple micro- and megaservices to get your GenAI into production and deployed
A four-step assessment for grading GenAI systems around performance, features, trustworthiness and enterprise-grade readiness.
Highlights
Leverage Open Source Ecosystem for GenAI solution
Easy to use with composable and configurable AI microservices
Hardware-agnostic architecture (supports Intel, AMD and nVidia Hardware)
