Open Source LLMOps & AI Tooling Tools

Alternative toPinecone

Self-hosted vector database for AI similarity search and RAG

• 35,154 GitHub stars
• Apache-2.0Licence Apache-2.0
• #Database

Alternative toGlean

Self-hosted knowledge base with RAG search, AI agent, and wiki

• 34,874 GitHub stars
• MITLicence MIT
• #LLM

Alternative toGitHub Copilot

Self-hosted AI coding assistant server for private team deployment

• 33,889 GitHub stars
• Apache-2.0Licence Apache-2.0

InAI & Machine Learning

ESP32 firmware for LLM-powered voice chatbots via MCP

• 31,693 GitHub stars
• MITLicence MIT
• #AI Agents

Alternative toMem0

Add persistent user memory to any LLM app via API, Apache 2.0

• 31,339 GitHub stars
• MITLicence MIT
• #AI Agents

Alternative toOpenRouter

Smart AI Router with 3-Tier Fallback

• 31,123 GitHub stars
• MITLicence MIT

Alternative toZenity

Self-hosted AI agent auditing across 60 trust and safety inspections.

• 30,695 GitHub stars
• Apache-2.0Licence Apache-2.0
• #AI Agents

Alternative toHugging Face Inference Endpoints

Local inference engine for DeepSeek V4 Flash/PRO and GLM 5.2

• 23,970 GitHub stars
• MITLicence MIT
• #LLM

Alternative toRagie AI

Comprehensive multimodal document processing framework

• 23,910 GitHub stars
• MITLicence MIT
• #RAG

Alternative toLM Studio

Fast LLM inference for Apple Silicon with persistent SSD KV caching

• 22,964 GitHub stars
• Apache-2.0Licence Apache-2.0
• #LLM