5 Weekend AI Engineering Projects: Cost Routing, Caching, Evals & Observability
Bashiri Smith · Facebook reel · 2026-09-14 · 1:28 · 19,059 views · Open on Facebook
Topics: Portfolio Projects, LLMOps, Deployment & Monitoring, Evaluation (Evals) & Testing · Level: intermediate
Summary
Bashiri Smith suggests five AI projects you could build in a weekend. Each one deals with a real production problem: model cost routing, semantic caching, regression testing against a golden dataset, observability for multi-step pipelines, and documentation that updates itself through a GitHub Action. He says building them teaches more than any course. The video ends by inviting viewers to comment "5" to get a guide with build instructions and an AI engineer community.
Key points
- LLM cost autopilot: a routing layer in front of several LLM providers. It judges how complex each query is and sends it to the cheapest model that can still answer well.
- Semantic caching layer: middleware that spots requests that mean the same thing as earlier ones and returns the cached answer right away. This cuts latency and API costs.
- Model regression detector: a CI/CD-style pipeline that keeps testing LLM-powered features against a golden dataset. When a system prompt or model change lowers quality, it alerts the team on Slack.
- Failure forensics tool: an observability layer for multi-step AI pipelines. It traces every intermediate step, finds where a failure started, and flags the failure for evaluation.
- Self-healing technical docs: a GitHub Action that watches a codebase, notices code changes that affect the documentation, finds the outdated sections, and updates them.
- The creator's guide has build instructions for all five projects. The counts of extra projects don't match: the caption says 21 more, the spoken version says 10 more.
Resources mentioned
- AI Projects (Google Drive folder) · pdf · drive.google.com · free
The creator's guide to 27 AI projects, with full architecture, build steps phase by phase, interview talking points, and the stack for each project.
Also in: Prompt Claude to Plan 3 Production-Grade AI Portfolio Projects (Bashiri Smith on Facebook · notes), 5 AI Engineer Skills Mapped to 5 Portfolio Projects (Bashiri Smith on Facebook · notes), 25 AI Engineer Interview Questions Covering ~95% of Interview Topics (Bashiri Smith on Facebook · notes), 6-Step Framework for Building AI Projects Target Companies Care About (Bashiri Smith on Facebook · notes) and 6 more - BASWE.Ai Engineer (Skool community) · community · skool.com · paid
The creator's paid community and program, with an AI learning roadmap (including the full ops and evaluation track), daily calls with engineers and recruiters, resume and portfolio help, and a job-search pipeline.
Also in: Basic vs Production AI Engineering: RAG, Agents, and Context over Prompts (Bashiri Smith on Facebook · notes), ChatGPT Prompt to Generate Standout Portfolio Project Ideas (Bashiri Smith on Facebook · notes), Vector Database vs. Graph Database: When to Use Each (and Both for RAG) (Bashiri Smith on Facebook · notes), The 5 Levels of RAG: From Naive Retrieval to Agentic RAG (Bashiri Smith on Facebook · notes) and 93 more - Slack · tool · slack.com · free · recommended by both Bashiri Smith & Melvin Vivas
Team chat app where the user-feedback channel lives and where the agent replies to close the loop.
Also in: Claude Duet: Anthropic's Research Preview of a Proactive Agent App (Melvin Vivas on X · notes), Grok Bot Weekly Update: @bot Tagging on X, Connectors, Voice Memory (Melvin Vivas on X · notes), ChatGPT Dots on Mobile: Setting Up an Always-On Proactive Agent (Melvin Vivas on X · notes), Dots Demo: A Voice AI Agent Handling Travel Booking and Feedback Triage (Melvin Vivas on X · notes) and 7 more - GitHub Actions · tool · github.com · free · recommended by both Bashiri Smith & Melvin Vivas
GitHub's built-in CI/CD: workflows that run tests, builds and deploys on every push.
Also in: Prompt Claude to Plan 3 Production-Grade AI Portfolio Projects (Bashiri Smith on Facebook · notes), Use Claude Code /loop to Watch and Auto-Fix Failing GitHub Actions (Melvin Vivas on X · notes)
Try this
- Pick one of the five projects and build it over a weekend.
- Comment "5" on the video to get the guide link and the community invite.
- LLM cost autopilot: a router that scores query complexity and sends each query to the cheapest model that can still answer well
- Semantic caching middleware for LLM APIs that serves semantically similar requests from a cache
- Model regression detector: a CI/CD pipeline that tests LLM outputs against a golden dataset and sends Slack alerts
- Failure forensics / observability tool that traces multi-step AI pipelines and finds where failures start
- Self-healing technical docs: a GitHub Action that finds outdated docs after code changes and updates them
More in Portfolio Projects
- Beat the Hiring "Trust Recession" With Public Proof-of-Skill Projects
- 3 AI Portfolio Projects That Get Past the 6-Second Resume Scan
- 15 Production-Grade AI Projects to Go from Software Engineer to AI Engineer
- 6 Job-Realistic AI Engineering Projects: Reranking to Exfiltration Guardrails
- Learn AI Engineering by Building One Project per Skill
- Comment-to-DM Offer: Claude Prompt, 27 AI Engineering Projects & BASWE.AI