LiteLLM
Open-source gateway that calls 100+ model APIs in one format.
About LiteLLM
In LiteLLM’s own words: “Put your full AI stack behind one key. Track and cap LLM spend, route to the right model, and self-host anywhere — even air-gapped. 140+ providers, 1,892 models, 60K+ GitHub stars.”
LiteLLM is open source and can be self-hosted.
People switching from OpenRouter often consider LiteLLM.
LiteLLM is an alternative to
Similar to LiteLLM
- Amazon BedrockAWS service for building with foundation models from several providers.
- Fireworks AIFast, scalable inference for open-source models.
- GroqVery fast inference for open models on Groq’s own chips.
- Hugging FaceThe hub for open models and datasets, with hosted inference.
- Together AICloud for running and fine-tuning open-source AI models.
Listed for information; LaunchStall isn’t affiliated with LiteLLM. The quoted description comes from litellm.ai. Features and plans change — check the official site for current details.