A high-performance LLM inference API and Chat UI that integrates DeepSeek R1's CoT reasoning traces with Anthropic Claude models.

TensorZero creates a feedback loop for optimizing LLM applications — turning production data into smarter, faster, and cheaper models.

Kheish: A multi-role LLM agent for tasks like code auditing, file searching, and more—seamlessly leveraging RAG and extensible modules.

Govern, Secure, and Optimize your AI Traffic. AI Gateway provides unified interface to all LLMs using OpenAI API format with a focus on performance and reliability. Built in Rust.

Use multiple LLM backends in a single crate, simple builder-based configuration, and built-in prompt chaining & templating.

🤖 A Matrix bot for using diffent capabilities (text-generation, text-to-speech, speech-to-text, image-generation, etc.) of AI / Large Language Models (OpenAI, Anthropic, etc.)

The fastest CLI tool for prompting LLMs. Including support for prompting several LLMs at once!

allms: One Rust Library to rule them aLLMs

Rust bindings to the Anthropic API

Fluent CLI is an advanced command-line interface designed to interact seamlessly with multiple workflow systems like FlowiseAI, Langflow, Make, and Zapier. Tailored for developers and IT professionals, Fluent CLI facilitates robust automation, simplifies complex interactions, and enhances productivity through a powerful and command suite

A minimalistic async Rust implementation of the Model Context Protocol (MCP).

Simple, ergonomic, async, Rust client for Anthropic’s Messages API

LLM Choose your own Adventure API using Rust & Htmx (HuggingFace models or Anthropic)

A framework for building and composing AI agents built in Rust. Build simply using YAML or rust-script. Leverage mcp-servers right away.

Build AI-powered apps in Rust using popular LLM providers

Using the OpenAI or Anthropic API to play an adventure game with the AI as the game master.

A Rust library unifying multiple LLM providers

AI in the Terminal

Anthropic Rust SDK

Models for Model Context Protocol derived from schema