AIBackends: An API Layer Between Your App and AI Models (Now with Jev)

Melvin Vivas · X video post · 2026-09-18 · Open on X

Topics: AI System Design & Architecture, LLMOps, Deployment & Monitoring · Level: intermediate

Summary

The creator's open-source AIBackends API server now supports TypeSafe AI's Jev model. AIBackends is an abstraction layer for common AI use cases, so you can change model and provider integrations outside your main app. It runs locally with Ollama or LM Studio, or in the cloud via OpenRouter, OpenAI, Anthropic and others.

Key points

• Put AI calls behind a separate API layer to decouple them from your main app
• AIBackends supports multiple models and providers for common AI use cases
• Run locally with Ollama or LM Studio, or in the cloud via OpenRouter, OpenAI or Anthropic
• It now supports Jev by TypeSafe AI

Resources mentioned

• AIBackends · repo · aibackends.com · free
  Open-source API server runtime for common AI use cases that supports many models and providers (Ollama, LM Studio, OpenRouter, OpenAI, Anthropic).
  Also in: Building a production website with Opus 5.5 and TanStack (Melvin Vivas on X · notes), CamelFlow: open-source visual viewer for Apache Camel routes (Melvin Vivas on X · notes), AI Backends: A Production AI Workflow Engineering Site (Link Share) (Melvin Vivas on X · notes), Demo: Claude Opus 5.5 Generating a Motion-Graphics Video for AIBackends (Melvin Vivas on X · notes) and 16 more
• TypeSafe AI (@typesafeai) on X · person · x.com · free
  The X account of TypeSafe AI, the company that makes Jev and the System One models.
  Also in: Using Jev (TypeSafe AI) as a Decision Model for Email Classification (Melvin Vivas on X · notes), Building a Jev Session-History Tool with Codex and Astra (Melvin Vivas on X · notes), Not every problem needs an LLM: small fine-tuned models (Jev by TypeSafe AI) (Melvin Vivas on X · notes), Jev model added to the AIBackends API via Vercel AI Gateway (Melvin Vivas on X · notes) and 6 more
• Ollama · tool · x.com · free · recommended by both Bashiri Smith & Melvin Vivas
  Open-source tool for downloading and running LLMs on your own machine with minimal setup.
  Also in: Running LLMs Locally Without an Expensive Rig (Melvin Vivas on X · notes), Adding Vercel AI Gateway as a provider in AIBackends with Devin (Melvin Vivas on X · notes), Running Qwen3.8-27B Locally on an M5 Max MacBook with Inco Splash (Melvin Vivas on X · notes), Coworker: An Open-Source Desktop Agent App for Local and Cloud Models (Melvin Vivas on X · notes) and 12 more
• LM Studio · tool · x.com · free
  Desktop app for downloading and running LLMs locally, with a developer mode that serves models through an API.
  Also in: Running LLMs Locally Without an Expensive Rig (Melvin Vivas on X · notes), Adding Vercel AI Gateway as a provider in AIBackends with Devin (Melvin Vivas on X · notes), LoRA Fine-Tune Qwen3.5-2B on Your Tweets with Unsloth Studio (Melvin Vivas on X · notes), Post-training Qwen3.5-2B on your own X posts with Unsloth Studio (Melvin Vivas on X · notes) and 31 more
• OpenRouter · tool · openrouter.ai · free
  A single OpenAI-compatible API that routes requests to hundreds of models from many providers, with one bill and model fallbacks.
  Also in: Customizing Your Coding Setup with Pi Coding Agent Extensions (Melvin Vivas on X · notes), The Jev model is now on OpenRouter (Melvin Vivas on X · notes), Kev-4B model, an alternative to Jev, now available on OpenRouter (Melvin Vivas on X · notes), Space Bunny Alpha: stealth 1M-context flash model on OpenRouter (Melvin Vivas on X · notes) and 42 more

Try this

• Try AIBackends as an abstraction layer between your app and AI providers