Open Source LLMOps & AI Tooling Tools

Alternative toChatGPT

Chat with your documents using any LLM, private and self-hosted

• 67,351 GitHub stars
• MITLicence MIT
• #AI Agents

Alternative toPortkey

Self-hosted AI gateway for 100+ LLMs in OpenAI format

• 61,759 GitHub stars
• CustomLicence MIT with enterprise directory carve-out
• #LLM

Alternative toOpenAI API

Self-hosted AI runtime: any model, any modality, any hardware.

• 49,798 GitHub stars
• MITLicence MIT
• #LLM

Alternative toChatGPT

Run open source LLMs on your own hardware with no cloud required

• 45,019 GitHub stars
• Apache-2.0Licence Apache-2.0
• #LLM

Alternative toUnstructured.io

Convert documents to clean markdown and JSON with open source AI.

• 40,566 GitHub stars
• Apache-2.0Licence Apache-2.0
• #LLM

Alternative toHugging Face Inference Endpoints

Run huge LLMs on low-end GPUs with minimal VRAM

• 39,915 GitHub stars
• Apache-2.0Licence Apache-2.0
• #LLM

InAI & Machine Learning

One command to rank every LLM against your hardware.

• 38,170 GitHub stars
• MITLicence MIT
• #LLM

Alternative toMicrosoft Copilot

Self-hosted AI assistant that searches your notes and web

• 37,768 GitHub stars
• AGPL-3.0Licence AGPL-3.0
• #AI Agents

Alternative toGitHub Copilot

Connect any LLM to VS Code for AI completions and codebase chat

• 36,273 GitHub stars
• Apache-2.0Licence Apache-2.0

Alternative toLangSmith

Trace and debug LLM prompts while monitoring inference costs

• 36,091 GitHub stars
• MITLicence MIT
• #LLMOps