LLMOps Open Source Tools

Alternative toLangSmith

Trace and debug LLM prompts while monitoring inference costs

• 36,091 GitHub stars
• MITLicence MIT
• #LLMOps

Alternative toClaude Code

Open-source AI coding agent you can leave running locally.

• 35,882 GitHub stars
• MITLicence MIT
• #AI Agents

Alternative toPinecone

Self-hosted vector database for AI similarity search and RAG

• 35,154 GitHub stars
• Apache-2.0Licence Apache-2.0
• #Database

Alternative toOpenRouter

Smart AI Router with 3-Tier Fallback

• 31,123 GitHub stars
• MITLicence MIT

Alternative toZenity

Self-hosted AI agent auditing across 60 trust and safety inspections.

• 30,695 GitHub stars
• Apache-2.0Licence Apache-2.0
• #AI Agents

Alternative toGitHub

Self-hosted Git server with CI/CD, security scans, and planning

• 24,535 GitHub stars
• MITLicence MIT

Alternative toHugging Face Inference Endpoints

Local inference engine for DeepSeek V4 Flash/PRO and GLM 5.2

• 23,970 GitHub stars
• MITLicence MIT
• #LLM

Alternative toRagie AI

Comprehensive multimodal document processing framework

• 23,910 GitHub stars
• MITLicence MIT
• #RAG

Alternative toDevin AI

Automate coding workflows with a self-improving agent

• 22,206 GitHub stars
• MITLicence MIT

Alternative toOpenAI

Alibaba's Apache 2.0 LLM in sizes from small to frontier scale

• 21,700 GitHub stars
• Apache-2.0Licence Apache-2.0
• #LLM