LLM Open Source Tools

Alternative toBaseten

One self-hosted cluster for all the models your agents need

• 3,416 GitHub stars
• Apache-2.0Licence Apache-2.0
• #LLM

Alternative toPortkey

LLM proxy with API translation and multi-backend routing

• 3,413 GitHub stars
• Apache-2.0Licence Apache-2.0
• #LLM

Alternative toOpenAI Whisper API

Self-hosted speech recognition API built on OpenAI Whisper

• 3,357 GitHub stars
• MITLicence MIT
• #LLM

Alternative toConductor

One desktop UI for all your AI coding agents.

• 3,177 GitHub stars
• MITLicence MIT

Alternative toAnyscale

Enterprise-grade RL framework for LLM post-training at scale

• 3,175 GitHub stars
• Apache-2.0Licence Apache-2.0
• #LLM

Alternative toChatGPT Pro

Ollama-powered web researcher that breaks queries into focus areas

• 3,020 GitHub stars
• MITLicence MIT
• #LLM

Alternative toAlgolia

Hybrid search and RAG infrastructure for AI knowledge bases

• 2,721 GitHub stars
• MITLicence MIT

Alternative toFireworks AI

MIT-licensed LLM inference engine built for agentic coding workloads.

• 2,715 GitHub stars
• MITLicence MIT
• #LLM

Alternative toPrivate LLM

Private local LLM chat app for iPhone and Mac

• 2,264 GitHub stars
• MITLicence MIT
• #LLM

Alternative toDeepMotion SayMotion

Text-to-animation for any rigged skeleton, no per-rig retraining

• 2,036 GitHub stars
• MITLicence MIT
• #LLM