Chatbot

litellm

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

Visit litellm ↗

Overview

litellm is listed under Chatbot. The information on this page comes from GitHub. The source does not describe a specific use case, so check the official site to see if it fits your work.

  • ai-gateway
  • anthropic
  • azure-openai
  • bedrock
  • gateway
  • langchain

Pricing and features change over time. Check the official site before you buy or subscribe.

Similar Chatbot tools

Chatbot Open source

A2A

Agent2Agent (A2A) is an open protocol enabling communication and interoperability between opaque agentic applications.

GitHub · ★ 26,076
Chatbot Open source

ai

The AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building AI-powered applications and agents

GitHub · ★ 27,183
Chatbot Open source

agentscope

Build and run agents you can see, understand and trust.

GitHub · ★ 32,915
Chatbot Open source

airllm

AirLLM 70B inference with single 4GB GPU

GitHub · ★ 35,517
Chatbot Open source

anything-llm

Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience

GitHub · ★ 66,831
Chatbot Open source

assistant-ui

Typescript/React Library for AI Chat 💬🚀

GitHub · ★ 12,449