AI-native (edge and LLM) proxy for agents. Move faster by letting Arch handle the pesky heavy lifting in building agentic apps -- ⚡️ query understanding and routing, seamless integration of prompts with tools, and unified access and observability of LLMs. Built by the contributors of Envoy proxy.
proxy routing gateway prompt proxy-server openai envoy envoyproxy llms generative-ai llmops llm-inference ai-gateway llm-gateway llm-routing
-
Updated
Mar 1, 2025 - Rust