Adding Vercel AI Gateway as a provider in AIBackends with Devin
Melvin Vivas · X post · 2026-09-19 · Open on X
Topics: LLMOps, Deployment & Monitoring, AI Dev Tools & Productivity · Level: intermediate
Summary
The creator used the Devin coding agent to add Vercel AI Gateway (aigw) as a new provider for the Jev model in his open-source AIBackends API. AIBackends is an API server for common AI use cases. It supports several models and providers: local ones through Ollama or LM Studio, and cloud ones through OpenRouter, OpenAI, Anthropic and others.
Key points
- Jev was free on Vercel AI Gateway for a limited time, so the creator added the gateway as a provider.
- He assigned the integration work to Devin, an AI coding agent.
- AIBackends (donvito/ai-backends) is an API server runtime for common AI use cases, with support for multiple models and providers.
- You can run it locally with Ollama or LM Studio, or in the cloud through OpenRouter, OpenAI, Anthropic and others.
- Design idea: put a provider abstraction in your backend so you can switch to free or cheaper model endpoints quickly.
Resources mentioned
- AIBackends · repo · aibackends.com · free
Open-source API server runtime for common AI use cases that supports many models and providers (Ollama, LM Studio, OpenRouter, OpenAI, Anthropic).
Also in: Redacting PII Locally with GLiNER-PII Before AI Processing (Melvin Vivas on X · notes), Building a production website with Opus 5.5 and TanStack (Melvin Vivas on X · notes), CamelFlow: open-source visual viewer for Apache Camel routes (Melvin Vivas on X · notes), AI Backends: A Production AI Workflow Engineering Site (Link Share) (Melvin Vivas on X · notes) and 17 more - Vercel · tool · x.com · free · recommended by both Bashiri Smith & Melvin Vivas
Deploy web apps and frontends.
Also in: OpenAI DevDay 2026 Recap: Dots, Agents API, Codex Cloud & Marketplace (Melvin Vivas on X · notes), 7 Habits to Become an AI Engineer: Books, Tooling, Research & Shipping (Bashiri Smith on Facebook · notes), Jev model added to the AIBackends API via Vercel AI Gateway (Melvin Vivas on X · notes), Open models now dominate token volume on Vercel AI Gateway (Melvin Vivas on X · notes) and 7 more - Jev (TypeSafe AI) · tool · typesafe.ai · free
TypeSafe's new post-training algorithm for calibrated, confidence-scored decisions, pitched as a replacement for RLHF.
Also in: JevDev: Open-Source UI Tool for Experimenting with Jev (Typesafe.ai) (Melvin Vivas on X · notes), jev-dev: A UI Tool to Keep Run History When Experimenting with Jev (Melvin Vivas on X · notes), JevDev: Open-Source UI for Experimenting with Jev by Typesafe.ai (Melvin Vivas on X · notes), Building a Jev Session-History Tool with Codex and Astra (Melvin Vivas on X · notes) and 7 more - Devin · tool · x.com · paid
A desktop app from the makers of the Devin coding agent for planning, delegating, reviewing and shipping work across fleets of local and cloud coding agents.
Also in: Devin's open-source vulnerability-fixes agent plugin (Melvin Vivas on X · notes), Gemini 4 Argon now available in Devin (Melvin Vivas on X · notes), Devin Defaults to Opus 5.5 in Normal and Fusion Modes (Cloud) (Melvin Vivas on X · notes), Devin: Preview Websites in Its Built-in Cloud Browser (Melvin Vivas on X · notes) and 57 more - Ollama · tool · x.com · free · recommended by both Bashiri Smith & Melvin Vivas
Open-source tool for downloading and running LLMs locally from a simple command line or API.
Also in: GitHub Copilot Adds Intelligent Local Model Routing (Project HydraFusion) (Melvin Vivas on X · notes), Run Local LLMs on the Computer You Already Have: A Beginner's Path (Melvin Vivas on X · notes), Running LLMs Locally Without an Expensive Rig (Melvin Vivas on X · notes), Running Qwen3.8-27B Locally on an M5 Max MacBook with Inco Splash (Melvin Vivas on X · notes) and 14 more - LM Studio · tool · x.com · free
Desktop app for downloading and running LLMs locally, with a developer mode that serves models through an API.
Also in: Run Local LLMs on the Computer You Already Have: A Beginner's Path (Melvin Vivas on X · notes), Running LLMs Locally Without an Expensive Rig (Melvin Vivas on X · notes), LoRA Fine-Tune Qwen3.5-2B on Your Tweets with Unsloth Studio (Melvin Vivas on X · notes), AIBackends: An API Layer Between Your App and AI Models (Now with Jev) (Melvin Vivas on X · notes) and 32 more - OpenRouter · tool · openrouter.ai · free
A single OpenAI-compatible API that routes requests to hundreds of models from many providers, with one bill and model fallbacks.
Also in: Stealth Model 'Space Bunny' Revealed as MiniMax M3.1 Flash (Melvin Vivas on X · notes), NVIDIA Nemotron 3.5 Super VL now on OpenRouter (Melvin Vivas on X · notes), OpenRouter serves image models, including FLUX 3 Image Klein (Melvin Vivas on X · notes), Comparing Opus 5.5, GPT-6 Astra and Grok 4.7 on OpenRouter (Melvin Vivas on X · notes) and 53 more
Try this
- Add a new model gateway provider (e.g. Vercel AI Gateway) to a multi-provider AI backend API.
More in LLMOps, Deployment & Monitoring
- Building a Local Model Server with ONNX Support
- Jev model added to the AIBackends API via Vercel AI Gateway
- LiteRT: Google's on-device AI runtime
- Jev was free on Vercel AI Gateway until Sept 25
- Benchmarking LLM Endpoints with NVIDIA Dynamo AIPerf
- Running Qwen3.8-27B Locally on an M5 Max MacBook with Inco Splash