Open Source LLMOps & AI Tooling Tools

Alternative toOpenAI

Compact 1.1B LLaMA model trained on 3 trillion tokens

• 9,020 GitHub stars
• Apache-2.0Licence Apache-2.0
• #LLM

Alternative toPortkey

Open-source AI gateway with 23+ providers, failover, and MCP support.

• 8,975 GitHub stars
• Apache-2.0Licence Apache-2.0
• #LLM

InAI & Machine Learning

Self-evolution engine that turns prompt tweaks into assets

• 8,686 GitHub stars
• GPL-3.0Licence GPL-3.0
• #AI Agents

Alternative toOpenAI

Permissive open LLaMA reproduction in 3B, 7B, and 13B parameters

• 7,528 GitHub stars
• Apache-2.0Licence Apache-2.0
• #LLM

Alternative toDatabricks (with MosaicML)

EleutherAI's framework for training LLMs at research scale

• 7,473 GitHub stars
• Apache-2.0Licence Apache-2.0
• #LLM

Alternative toLM Studio

Local models for your agent, tuned for your hardware

• 7,220 GitHub stars
• Apache-2.0Licence Apache-2.0
• #AI Agents

Alternative toCClaude Managed Agents

Open-source agent harness for reliable, long-running LLM agents

• 6,315 GitHub stars
• MITLicence MIT
• #LLM

Alternative toArize AI

Monitor LLM spend and catch prompt anomalies in production

• 6,228 GitHub stars
• Apache-2.0Licence Apache-2.0
• #LLMOps

Alternative toLM Studio

Hot-swap AI models on your local inference server

• 6,013 GitHub stars
• MITLicence MIT
• #LLM

Alternative toConductor

Spawn coding agents that run infinitely in parallel cloud VMs

• 5,852 GitHub stars
• MITLicence MIT
• #AI Agents