New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature] Support mistralai/Pixtral #2351

Open

merrymercy opened this issue Dec 4, 2024 · 2 comments

Labels

good first issue help wanted high priority

Contributor

merrymercy commented Dec 4, 2024 •

edited

Loading

Motivation

mistralai/Pixtral is one of the best vision language models. We would like to support it.

Models:
https://huggingface.co/mistralai/Pixtral-12B-2409
https://huggingface.co/mistralai/Pixtral-Large-Instruct-2411

Related resources

You can learn from the existing implementations and usage examples of other vision language models.
https://sgl-project.github.io/references/supported_models.html#how-to-support-a-new-model
/~https://github.com/sgl-project/sglang/blob/main/python/sglang/srt/models/llava.py
/~https://github.com/sgl-project/sglang/blob/main/test/srt/test_vision_openai_server.py
https://sgl-project.github.io/references/sampling_params.html#multi-modal

merrymercy added good first issue help wanted labels

This comment was marked as outdated.

Sign in to view

yixin-huang1 mentioned this issue

Support for Pixtral model (Mistral) #2381

Closed

merrymercy added the high priority label

merrymercy mentioned this issue

Development Roadmap (2024 Q4) #1487

Open

37 tasks

Contributor

DanielC12321 commented Jan 8, 2025

I will give this a try if no one else is working on it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment