AIBackends: An API Layer Between Your App and AI Models (Now with Jev)
Melvin Vivas · X video post · 2026-09-18 · Open on X
Topics: AI System Design & Architecture, LLMOps, Deployment & Monitoring · Level: intermediate
Summary
The creator's open-source AIBackends API server now supports TypeSafe AI's Jev model. AIBackends is an abstraction layer for common AI use cases, so you can change model and provider integrations outside your main app. It runs locally with Ollama or LM Studio, or in the cloud via OpenRouter, OpenAI, Anthropic and others.
Key points
- Put AI calls behind a separate API layer to decouple them from your main app
- AIBackends supports multiple models and providers for common AI use cases
- Run locally with Ollama or LM Studio, or in the cloud via OpenRouter, OpenAI or Anthropic
- It now supports Jev by TypeSafe AI
Resources mentioned
- AIBackends · repo · aibackends.com · free
Open-source API server runtime for common AI use cases that supports many models and providers (Ollama, LM Studio, OpenRouter, OpenAI, Anthropic).
Also in: Redacting PII Locally with GLiNER-PII Before AI Processing (Melvin Vivas on X · notes), Building a production website with Opus 5.5 and TanStack (Melvin Vivas on X · notes), CamelFlow: open-source visual viewer for Apache Camel routes (Melvin Vivas on X · notes), AI Backends: A Production AI Workflow Engineering Site (Link Share) (Melvin Vivas on X · notes) and 17 more - TypeSafe AI (@typesafeai) on X · person · x.com · free
Company that built Jev and the RLCD training method, focused on reliable models for automation.
Also in: Decision Model Rankings by Spend and Token Share (Melvin Vivas on X · notes), JevDev v0.1.3: Free UI Environment for Experimenting with Jev Models (Melvin Vivas on X · notes), Using Jev (TypeSafe AI) as a Decision Model for Email Classification (Melvin Vivas on X · notes), Building a Jev Session-History Tool with Codex and Astra (Melvin Vivas on X · notes) and 9 more - Ollama · tool · x.com · free · recommended by both Bashiri Smith & Melvin Vivas
Open-source tool for downloading and running LLMs locally from a simple command line or API.
Also in: GitHub Copilot Adds Intelligent Local Model Routing (Project HydraFusion) (Melvin Vivas on X · notes), Run Local LLMs on the Computer You Already Have: A Beginner's Path (Melvin Vivas on X · notes), Running LLMs Locally Without an Expensive Rig (Melvin Vivas on X · notes), Adding Vercel AI Gateway as a provider in AIBackends with Devin (Melvin Vivas on X · notes) and 14 more - LM Studio · tool · x.com · free
Desktop app for downloading and running LLMs locally, with a developer mode that serves models through an API.
Also in: Run Local LLMs on the Computer You Already Have: A Beginner's Path (Melvin Vivas on X · notes), Running LLMs Locally Without an Expensive Rig (Melvin Vivas on X · notes), Adding Vercel AI Gateway as a provider in AIBackends with Devin (Melvin Vivas on X · notes), LoRA Fine-Tune Qwen3.5-2B on Your Tweets with Unsloth Studio (Melvin Vivas on X · notes) and 32 more - OpenRouter · tool · openrouter.ai · free
A single OpenAI-compatible API that routes requests to hundreds of models from many providers, with one bill and model fallbacks.
Also in: Stealth Model 'Space Bunny' Revealed as MiniMax M3.1 Flash (Melvin Vivas on X · notes), NVIDIA Nemotron 3.5 Super VL now on OpenRouter (Melvin Vivas on X · notes), OpenRouter serves image models, including FLUX 3 Image Klein (Melvin Vivas on X · notes), Comparing Opus 5.5, GPT-6 Astra and Grok 4.7 on OpenRouter (Melvin Vivas on X · notes) and 53 more
Try this
- Try AIBackends as an abstraction layer between your app and AI providers