OpenAI
Azure OpenAI
Anthropic
Ollama
LlamaCpp
Hugging Face
Vertex AI
Mistral AI
Token Usage
The list of LLMs that support token usage are:- OpenAI
- Vertex AI
- Anthropic
- Mistral AI
If you can't find the specific LLM you need, no need to fret. We're continuously expanding our support for additional LLMs, and you can help us prioritize by opening an issue on our GitHub.
GitHub
Open an issue on our GitHub

