Open Source LLMOps & AI Tooling Tools

Alternative toGoogle Gemini Enterprise Agent Platform

Agentic AI framework for the JVM

• 4,524 GitHub stars
• Apache-2.0Licence Apache-2.0
• #AI Agents

Alternative toDatabricks

Apache 2.0 LLM fine-tuning toolkit for Llama and Mistral on GPU

• 4,443 GitHub stars
• Apache-2.0Licence Apache-2.0
• #LLM

Alternative toDatabricks

Open lab for training foundation models together

• 3,987 GitHub stars
• Apache-2.0Licence Apache-2.0
• #LLM

Alternative toMem0

Give your LLM agents persistent memory across every conversation

• 3,663 GitHub stars
• Apache-2.0Licence Apache-2.0
• #AI Agents

Alternative toGrok Bot

Local-first AI agent that runs on your machine, drives real tools.

• 3,425 GitHub stars
• MITLicence MIT
• #LLM

Alternative toBaseten

One self-hosted cluster for all the models your agents need

• 3,416 GitHub stars
• Apache-2.0Licence Apache-2.0
• #LLM

Alternative toPortkey

LLM proxy with API translation and multi-backend routing

• 3,413 GitHub stars
• Apache-2.0Licence Apache-2.0
• #LLM

InAI & Machine Learning

Phase-guarded workflow layer for AI coding agents, with eval built in

• 3,206 GitHub stars
• MITLicence MIT
• #AI Agents

Alternative toAlgolia

Hybrid search and RAG infrastructure for AI knowledge bases

• 2,721 GitHub stars
• MITLicence MIT

Alternative toFireworks AI

MIT-licensed LLM inference engine built for agentic coding workloads.

• 2,715 GitHub stars
• MITLicence MIT
• #LLM