Skip to content
#

qwen2

Here are 51 public repositories matching this topic...

High-Performance OpenAI LLM Service: A pure C++ high-performance OpenAI LLM service implemented with GPRS+TensorRT-LLM+Tokenizers.cpp, supporting chat and function call, AI agents, distributed multi-GPU inference, multimodal capabilities, and a Gradio chat interface.

  • Updated Feb 24, 2025
  • C++

Improve this page

Add a description, image, and links to the qwen2 topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the qwen2 topic, visit your repo's landing page and select "manage topics."

Learn more