Adding Vercel AI Gateway as a provider in AIBackends with Devin

Melvin Vivas · X post · 2026-09-19 · Open on X

Topics: LLMOps, Deployment & Monitoring, AI Dev Tools & Productivity · Level: intermediate

Summary

The creator used the Devin coding agent to add Vercel AI Gateway (aigw) as a new provider for the Jev model in his open-source AIBackends API. AIBackends is an API server for common AI use cases. It supports several models and providers: local ones through Ollama or LM Studio, and cloud ones through OpenRouter, OpenAI, Anthropic and others.

Key points

• Jev was free on Vercel AI Gateway for a limited time, so the creator added the gateway as a provider.
• He assigned the integration work to Devin, an AI coding agent.
• AIBackends (donvito/ai-backends) is an API server runtime for common AI use cases, with support for multiple models and providers.
• You can run it locally with Ollama or LM Studio, or in the cloud through OpenRouter, OpenAI, Anthropic and others.
• Design idea: put a provider abstraction in your backend so you can switch to free or cheaper model endpoints quickly.

Resources mentioned

• AIBackends · repo · aibackends.com · free
  Open-source API server runtime for common AI use cases that supports many models and providers (Ollama, LM Studio, OpenRouter, OpenAI, Anthropic).
  Also in: Building a production website with Opus 5.5 and TanStack (Melvin Vivas on X · notes), CamelFlow: open-source visual viewer for Apache Camel routes (Melvin Vivas on X · notes), AI Backends: A Production AI Workflow Engineering Site (Link Share) (Melvin Vivas on X · notes), Demo: Claude Opus 5.5 Generating a Motion-Graphics Video for AIBackends (Melvin Vivas on X · notes) and 16 more
• Vercel · tool · x.com · free · recommended by both Bashiri Smith & Melvin Vivas
  Deploy web apps and frontends.
  Also in: OpenAI DevDay 2026 Recap: Dots, Agents API, Codex Cloud & Marketplace (Melvin Vivas on X · notes), 7 Habits to Become an AI Engineer: Books, Tooling, Research & Shipping (Bashiri Smith on Facebook · notes), Jev model added to the AIBackends API via Vercel AI Gateway (Melvin Vivas on X · notes), Open models now dominate token volume on Vercel AI Gateway (Melvin Vivas on X · notes) and 7 more
• Jev (TypeSafe AI) · tool · typesafe.ai · free
  TypeSafe's new post-training algorithm for calibrated, confidence-scored decisions, pitched as a replacement for RLHF.
  Also in: JevDev: Open-Source UI Tool for Experimenting with Jev (Typesafe.ai) (Melvin Vivas on X · notes), jev-dev: A UI Tool to Keep Run History When Experimenting with Jev (Melvin Vivas on X · notes), JevDev: Open-Source UI for Experimenting with Jev by Typesafe.ai (Melvin Vivas on X · notes), Building a Jev Session-History Tool with Codex and Astra (Melvin Vivas on X · notes) and 7 more
• Devin · tool · x.com · paid
  A desktop app from the makers of the Devin coding agent for planning, delegating, reviewing and shipping work across fleets of local and cloud coding agents.
  Also in: Using the Devin iOS App to Build iOS Apps (Quick Demo) (Melvin Vivas on X · notes), Use Your ChatGPT Plus/Pro Subscription to Run Devin (Melvin Vivas on X · notes), OpenAI DevDay recap: Dots, GPT-6.1 Sol, Codex Cloud, Agents API (Melvin Vivas on X · notes), Devin price cuts and top score on FrontierCode 1.1 Extended (Melvin Vivas on X · notes) and 44 more
• Ollama · tool · x.com · free · recommended by both Bashiri Smith & Melvin Vivas
  Open-source tool for downloading and running LLMs on your own machine with minimal setup.
  Also in: Running LLMs Locally Without an Expensive Rig (Melvin Vivas on X · notes), Running Qwen3.8-27B Locally on an M5 Max MacBook with Inco Splash (Melvin Vivas on X · notes), AIBackends: An API Layer Between Your App and AI Models (Now with Jev) (Melvin Vivas on X · notes), Coworker: An Open-Source Desktop Agent App for Local and Cloud Models (Melvin Vivas on X · notes) and 12 more
• LM Studio · tool · x.com · free
  Desktop app for downloading and running LLMs locally, with a developer mode that serves models through an API.
  Also in: Running LLMs Locally Without an Expensive Rig (Melvin Vivas on X · notes), LoRA Fine-Tune Qwen3.5-2B on Your Tweets with Unsloth Studio (Melvin Vivas on X · notes), AIBackends: An API Layer Between Your App and AI Models (Now with Jev) (Melvin Vivas on X · notes), Post-training Qwen3.5-2B on your own X posts with Unsloth Studio (Melvin Vivas on X · notes) and 31 more
• OpenRouter · tool · openrouter.ai · free
  A single OpenAI-compatible API that routes requests to hundreds of models from many providers, with one bill and model fallbacks.
  Also in: Customizing Your Coding Setup with Pi Coding Agent Extensions (Melvin Vivas on X · notes), The Jev model is now on OpenRouter (Melvin Vivas on X · notes), Kev-4B model, an alternative to Jev, now available on OpenRouter (Melvin Vivas on X · notes), Space Bunny Alpha: stealth 1M-context flash model on OpenRouter (Melvin Vivas on X · notes) and 42 more

Try this

• Add a new model gateway provider (e.g. Vercel AI Gateway) to a multi-provider AI backend API.