Replies: 2 comments 5 replies
-
|
Beta Was this translation helpful? Give feedback.
-
Hold my Pepsi... you have only WHL :-D triton-3.0.0-cp311-cp311-win_amd64.whl Download here: https://1drv.ms/u/s!Aq5X0D4OWWATiKkx8gdY012BCa_wVQ?e=SaCr0l What is so good on Triton anyway? They just rape vLLM. You should check out SGLang, very nice. I'm building my own OpenAI API gateway that will feature plug n play models and cover functionality of Ollama, LT Studio, OpenVINO and will feature nice dashboard with statistics and some Red Team System Prompts muhehehe. |
Beta Was this translation helpful? Give feedback.
-
this gets us one step closer to a working windows version but it's still erroring out during install bc it's looking for lscpu info instead of Windows. I'm not totally inept at coding but my skills are subpar at best if anyone else feels like taking a crack at getting it installed. I know someone managed to get the build whl built but I have no idea where I saw it anymore... here's the triton 2.0.0 download. it didn't trigger any flags when scanning in Defender https://transfer.sh/me0xpC/triton-2.0.0-cp310-cp310-win_amd64.whl just download the file. activate whatever virtual environment and pip install the filename from your downloads folder
Beta Was this translation helpful? Give feedback.
All reactions