A high-throughput and memory-efficient inference and serving engine for LLMs
vllm is listed under Chatbot. The information on this page comes from GitHub. The source does not describe a specific use case, so check the official site to see if it fits your work.
Pricing and features change over time. Check the official site before you buy or subscribe.
Agent2Agent (A2A) is an open protocol enabling communication and interoperability between opaque agentic applications.
The AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building AI-powered applications and agents
Build and run agents you can see, understand and trust.
AirLLM 70B inference with single 4GB GPU
Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience
Typescript/React Library for AI Chat 💬🚀