LLM Open Source Tools

Alternative toAmazon SageMaker

Accelerate AI applications with caching technology

• 12,129 GitHub stars
• Apache-2.0Licence Apache-2.0
• #LLM

Alternative toPerplexity AI

Open source AI search engine that retrieves cited sources

• 11,901 GitHub stars
• AGPL-3.0Licence AGPL-3.0

Alternative toMem0

Persist AI agent context across sessions and tool switches

• 11,876 GitHub stars
• MITLicence MIT
• #LLM

Alternative toGranola

Local-first AI meeting notetaker with transcription

• 9,539 GitHub stars
• MITLicence MIT

Alternative toTogether AI

Fine-tune any LLM on a 4 GB GPU, one YAML config

• 9,470 GitHub stars
• Apache-2.0Licence Apache-2.0
• #LLM

Alternative toOpenAI

Apache 2.0-licensed LLM from TII, from 1B to 180B parameters

• 9,409 GitHub stars
• Apache-2.0Licence Apache-2.0
• #LLM

Alternative toPerplexity AI

Your AI research assistant, fully local and encrypted.

• 9,372 GitHub stars
• MITLicence MIT
• #LLM

Alternative toOpenAI

Compact 1.1B LLaMA model trained on 3 trillion tokens

• 9,020 GitHub stars
• Apache-2.0Licence Apache-2.0
• #LLM

Alternative toPortkey

Open-source AI gateway with 23+ providers, failover, and MCP support.

• 8,975 GitHub stars
• Apache-2.0Licence Apache-2.0
• #LLM

Alternative toXano

One YAML file gives your app auth, CRUD, storage, and admin UI

• 7,595 GitHub stars
• MITLicence MIT
• #BaaS

Alternative toOpenAI

Permissive open LLaMA reproduction in 3B, 7B, and 13B parameters

• 7,528 GitHub stars
• Apache-2.0Licence Apache-2.0
• #LLM

Alternative toDatabricks (with MosaicML)

EleutherAI's framework for training LLMs at research scale

• 7,473 GitHub stars
• Apache-2.0Licence Apache-2.0
• #LLM