Developer Platform

Overview

The O.RI Developer Platform is a B2B solution for enterprises and companies. It offers a comprehensive suite of tools and features designed to empower developers to harness the power of advanced AI technologies. At its core, the platform provides a scalable Inference API that leverages O.RI's core functionalities, along with support for various open-source Large Language Models (LLMs). The platform also includes an Assistant feature, similar to OpenAI's offering, which enables developers to perform advanced retrieval augmented generation (RAG) on their own data and seamlessly integrate O.RI functionalities into their applications. For experimentation and exploration, the O.RI Playground offers an intuitive frontend interface where developers can quickly test and understand the platform's capabilities. Perhaps most innovatively, the platform introduces a new development framework, codenamed "O Surf," which adopts an SDK-less approach. This framework utilizes intelligent AI agents to handle various development tasks, such as code refactoring, deployment, fine-tuning, and data processing, eliminating the need for developers to work with traditional SDKs and streamlining the development process by 10-100x.

Key Features for Developer Platform

  • O.RI Inference API
  • A scalable API endpoint utilizing O.RI's core functionalities for developers in enterprises.
  • Inference API for Open Source LLMs
  • All models in registry, most routed/used models are hosted in Cerebras infra, while less used models are hosted in  IO.NET  clusters.
  • O.RI Assistant
  • Similar with OpenAI Assistant, this feature provides developers the flexibility to perform advance RAG (retrieval augmented generation) on their own data and build in our O.RI functionalities into their applications seamlessly.
  • O.RI Playground
  • The playground feature allows developers to explore O.RI's functionalities and perform quick experiments on an intuitive frontend user interface before integrating into their applications.
  • New type of Development Framework, code name: O Surf
  • We use a SDK-less approach and intelligent Ops agent to implement our developer platform.
  • No SDK work required from the developer side.
  • Instead, intelligent Ops agent will handle the development tasks, such as code refactoring, deployment, fine-tuning, and data processing.
  • More details will come soon as we are still drafting the scope.