The Roli Generative AI Gateway is an application that runs in the cloud that fits between your web applications that make use of GenAI models and the models themselves. This effectively decouples your applications from the Large Language Models they make use of, letting you swap them out without changing code.
Roli is designed with developers in mind; the platform sports a code-first, TypeScript class-based configuration system that should be familiar to application software developers.
- Self-hosted, on-prem installation via Helm chart
- Managed cloud SaaS (shared and dedicated)