Why Choose EdgeOne Makers as Your LLM Gateway
A production-grade model gateway for llm hosting and model serving — unified access, secure key hosting, built-in free tokens, and multi-SDK compatibility.
One Endpoint, All Models
Access DeepSeek, MiniMax, Hunyuan, OpenAI, Anthropic, Google and more through a single unified API endpoint — switch providers by changing one parameter.
Secure Key Management
Provider API keys are encrypted and hosted by the platform — your application only carries the gateway key, vendor secrets never touch client code.
Zero Platform Fee
The Models gateway service is completely free — no markup, no platform fees. You only pay for vendor API usage on their own platforms when using Bring-Your-Own-Key models.
Native SSE Streaming
All protocols and providers support Server-Sent Events streaming out of the box — real-time responses with OpenAI SDK, Anthropic SDK, or Vercel AI SDK.
How to Use the LLM Gateway on EdgeOne Makers
Connect to the model gateway and start model serving in minutes — single endpoint, one key, instant access to 8+ LLM providers.
1
Get Your API Key
Sign up at the Makers console and create your gateway API key — one key for all model providers.
2
Point Your SDK
Set the base URL to the Makers gateway endpoint in your SDK — supports any OpenAI-compatible client.
3
Call Any Model
Send requests with your chosen `model` parameter — the gateway routes to the right provider automatically.
Complete LLM Gateway Features
Everything your model gateway needs for llm hosting and model serving — unified endpoint, multi-provider, key management, zero platform fees, and streaming.
Feature | Description |
|---|---|
| Unified Endpoint | Single API endpoint for 8+ LLM providers — switch models by changing one parameter, no code changes |
| Multi-SDK Compatible | Works with OpenAI JS/Python SDK, Anthropic SDK, Vercel AI SDK, cURL, and any OpenAI-compatible client |
| Key Management | Provider keys encrypted and hosted — applications only carry the gateway API key |
| Built-in Models | Call models like `@makers/deepseek-v4-flash` without binding any provider key — free tokens included per account |
| SSE Streaming | Native Server-Sent Events support for all providers — real-time streaming with zero configuration |
What is the LLM gateway on EdgeOne Makers?
The llm gateway is a unified model access service that aggregates 8+ LLM providers behind a single endpoint, enabling model serving without managing individual provider connections or keys.
Does the llm gateway support free llm hosting?
Yes. The model gateway provides built-in models (e.g., `@makers/deepseek-v4-flash`) with 500K free tokens for new accounts. This enables free llm hosting without binding any provider API key.
How does the model gateway handle model serving?
The model gateway handles model serving through a unified endpoint compatible with OpenAI, Anthropic, and Vercel AI SDK. Switch between providers by changing the `model` parameter — the gateway routes requests to the appropriate provider.
What SDKs are compatible with the llm gateway?
The llm gateway supports OpenAI JS/Python SDK, Anthropic SDK, Vercel AI SDK (`@edgeone/makers-models-provider`), cURL, and any OpenAI-compatible HTTP client for model serving.
Can I bring my own API keys to the llm gateway?
Yes. Use built-in free models without any key, or bring your own keys for OpenAI, Anthropic, Google AI Studio, and more. All providers are accessed through the same model gateway endpoint.