llm-serving

Here are 5 public repositories matching this topic...

🧬 Helix is a private GenAI stack for building AI applications with declarative pipelines, knowledge (RAG), API bindings, and first-class testing.

Finetune LLMs on K8s by using Runbooks

Tensor Fusion is a state-of-the-art GPU virtualization and pooling solution designed to optimize GPU cluster utilization to its fullest potential.

ai gpu inference pytorch nvidia autoscaling amd-gpu vgpu gpu-usage gpu-virtualization gpu-scheduling karpenter remote-gpu llm-serving rcuda gpu-pooling

An unofficial Go port of the official Tavily API Python Wrapper.

internet llm - access your ollama (or any other local llm) instance from across the internet

llm-serving ollama ollama-interface

Add a description, image, and links to the llm-serving topic page so that developers can more easily learn about it.

To associate your repository with the llm-serving topic, visit your repo's landing page and select "manage topics."