LLM Open Source Tools

Alternative toArize AI

Monitor LLM spend and catch prompt anomalies in production

• 6,228 GitHub stars
• Apache-2.0Licence Apache-2.0
• #LLMOps

Alternative toLM Studio

Hot-swap AI models on your local inference server

• 6,013 GitHub stars
• MITLicence MIT
• #LLM

Alternative toConductor

Spawn coding agents that run infinitely in parallel cloud VMs

• 5,852 GitHub stars
• MITLicence MIT
• #AI Agents

InAI & Machine Learning

Build and debug ComfyUI image workflows using natural language

• 5,554 GitHub stars
• MITLicence MIT
• #AI Agents

Alternative toChatGPT

Control your AI infrastructure with Thunderbolt

• 4,799 GitHub stars
• MPL-2.0Licence MPL-2.0
• #AI Agents

Alternative toGoogle Gemini Enterprise Agent Platform

Agentic AI framework for the JVM

• 4,524 GitHub stars
• Apache-2.0Licence Apache-2.0
• #AI Agents

Alternative toDatabricks

Apache 2.0 LLM fine-tuning toolkit for Llama and Mistral on GPU

• 4,443 GitHub stars
• Apache-2.0Licence Apache-2.0
• #LLM

InAI & Machine Learning

Visual desktop companion for OpenAI Codex configuration

• 4,289 GitHub stars
• MITLicence MIT
• #LLM

Alternative toDatabricks

Open lab for training foundation models together

• 3,987 GitHub stars
• Apache-2.0Licence Apache-2.0
• #LLM

Alternative toMicrosoft Translator (Windows Live Captions translation)

Real-time audio translation for Windows, powered by LLMs

• 3,956 GitHub stars
• Apache-2.0Licence Apache-2.0
• #LLM