Code

Implement Phi-4 Multimodal!#1163

Code

Open

EricLBuehler wants to merge 20 commits intomasterEricLBuehler/mistral.rs:masterfrom phi4_multimodalEricLBuehler/mistral.rs:phi4_multimodalCopy head branch name to clipboard

+2,904-28

Commits

Commits on Feb 28, 2025

• Add base text model

  EricLBuehler

  committed
  7e1926a

  Copy full SHA for 7e1926a

• Add image embedding, add get_image_features

  EricLBuehler

  committed
  f5b0e78

  Copy full SHA for f5b0e78

• Add image embedding forward

  EricLBuehler

  committed
  7265564

  Copy full SHA for 7265564

• Optimize a bit

  EricLBuehler

  committed
  4cbae75

  Copy full SHA for 4cbae75

• Implement image embedding to forward

  EricLBuehler

  committed
  de7696f

  Copy full SHA for de7696f

• Sketch loader

  EricLBuehler

  committed
  da5e0e8

  Copy full SHA for da5e0e8

• Implement reflectionpad2d

  EricLBuehler

  committed
  b3e9cc5

  Copy full SHA for b3e9cc5

• Add the image inputs processor

  EricLBuehler

  committed
  35ad1c5

  Copy full SHA for 35ad1c5

• Add processor

  EricLBuehler

  committed
  4667972

  Copy full SHA for 4667972

• Base model works

  EricLBuehler

  committed
  ec4daf3

  Copy full SHA for ec4daf3

• Add static lora

  EricLBuehler

  committed
  052b6ee

  Copy full SHA for 052b6ee

• Vision model *runs*

  EricLBuehler

  committed
  68d6f61

  Copy full SHA for 68d6f61

• Clippy

  EricLBuehler

  committed
  028dc85

  Copy full SHA for 028dc85

• Some fixes

  EricLBuehler

  committed
  fc9534e

  Copy full SHA for fc9534e

• Try out phi3 insertion?

  EricLBuehler

  committed
  98c306c

  Copy full SHA for 98c306c

• More progresss

  EricLBuehler

  committed
  997f948

  Copy full SHA for 997f948

Commits on Mar 1, 2025

• index_put replacement is confirmed good

  EricLBuehler

  committed
  210bdae

  Copy full SHA for 210bdae

• It works!!

  EricLBuehler

  committed
  8a6e169

  Copy full SHA for 8a6e169

• Fix 2-pass metal SDPA

  EricLBuehler

  committed
  85ba5b1

  Copy full SHA for 85ba5b1

• Add isq

  EricLBuehler

  committed
  031fc23

  Copy full SHA for 031fc23