model family

Phi 4

Published by microsoft. 24 members have been measured on real machines. Every number below was signed by the machine that produced it — none of it is from a model card.

what it takes, what it returns
text → text

Declared by the network’s catalog, not measured — a signature says what this family would be asked. Whether it answered is the signed capability flags on each member.

24 of 55 builds measured · 31 still open
what each build proved
mini · Q3_K_L · bartowski
mini-reasoning · IQ3_XXS
mini · Q3_K_S · MaziyarPanahi
mini · IQ2_M
mini-reasoning · Q8_0
mini-reasoning · IQ1_S
mini-reasoning · Q3_K_L
mini-reasoning · Q3_K_M
mini-reasoning · Q2_K_L
mini-reasoning · Q4_K_M · lmstudio-community
mini · Q3_K_L · MaziyarPanahi
mini-reasoning · Q2_K
mini-reasoning · Q4_K_M · unsloth
mini · Q3_K_S · bartowski
mini · Q4_K_M · bartowski
reasoning-plus · Q4_K_M
reasoning-plus · Q6_K
mini · Q2_K
mini · Q4_K_M · MaziyarPanahi
mini · Q4_K_S
mini · Q8_0
mini · IQ2_XS
mini · BF16
mini · Q4_K_M · unsloth
mini · Q3_K_L · bartowski · Structured output — provedmini · Q3_K_L · bartowski · Sustained output — provedmini · Q3_K_L · bartowski · Extended thinking — asked, failedmini · Q3_K_L · bartowski · Writes code — provedmini · Q3_K_L · bartowski · Reasons about code — asked, failedmini · Q3_K_L · bartowski · Synthesises sources — provedmini · Q3_K_L · bartowski · Follows instructions — provedmini-reasoning · IQ3_XXS · Structured output — provedmini-reasoning · IQ3_XXS · Sustained output — provedmini-reasoning · IQ3_XXS · Extended thinking — provedmini-reasoning · IQ3_XXS · Writes code — asked, failedmini-reasoning · IQ3_XXS · Reasons about code — provedmini-reasoning · IQ3_XXS · Synthesises sources — provedmini-reasoning · IQ3_XXS · Follows instructions — asked, failedmini · Q3_K_S · MaziyarPanahi · Structured output — provedmini · Q3_K_S · MaziyarPanahi · Sustained output — provedmini · Q3_K_S · MaziyarPanahi · Extended thinking — asked, failedmini · Q3_K_S · MaziyarPanahi · Writes code — provedmini · Q3_K_S · MaziyarPanahi · Reasons about code — asked, failedmini · Q3_K_S · MaziyarPanahi · Synthesises sources — provedmini · Q3_K_S · MaziyarPanahi · Follows instructions — provedmini · IQ2_M · Structured output — provedmini · IQ2_M · Sustained output — provedmini · IQ2_M · Extended thinking — asked, failedmini · IQ2_M · Writes code — provedmini · IQ2_M · Reasons about code — asked, failedmini · IQ2_M · Synthesises sources — asked, failedmini · IQ2_M · Follows instructions — provedmini-reasoning · Q8_0 · Structured output — provedmini-reasoning · Q8_0 · Sustained output — provedmini-reasoning · Q8_0 · Extended thinking — provedmini-reasoning · Q8_0 · Writes code — asked, failedmini-reasoning · Q8_0 · Reasons about code — provedmini-reasoning · Q8_0 · Synthesises sources — provedmini-reasoning · Q8_0 · Follows instructions — asked, failedmini-reasoning · IQ1_S · Structured output — asked, failedmini-reasoning · IQ1_S · Sustained output — asked, failedmini-reasoning · IQ1_S · Extended thinking — asked, failedmini-reasoning · IQ1_S · Writes code — asked, failedmini-reasoning · IQ1_S · Reasons about code — asked, failedmini-reasoning · IQ1_S · Synthesises sources — asked, failedmini-reasoning · IQ1_S · Follows instructions — asked, failedmini-reasoning · Q3_K_L · Structured output — provedmini-reasoning · Q3_K_L · Sustained output — provedmini-reasoning · Q3_K_L · Extended thinking — provedmini-reasoning · Q3_K_L · Writes code — asked, failedmini-reasoning · Q3_K_L · Reasons about code — provedmini-reasoning · Q3_K_L · Synthesises sources — provedmini-reasoning · Q3_K_L · Follows instructions — asked, failedmini-reasoning · Q3_K_M · Structured output — provedmini-reasoning · Q3_K_M · Sustained output — provedmini-reasoning · Q3_K_M · Extended thinking — provedmini-reasoning · Q3_K_M · Writes code — asked, failedmini-reasoning · Q3_K_M · Reasons about code — provedmini-reasoning · Q3_K_M · Synthesises sources — provedmini-reasoning · Q3_K_M · Follows instructions — asked, failedmini-reasoning · Q2_K_L · Structured output — provedmini-reasoning · Q2_K_L · Sustained output — never askedmini-reasoning · Q2_K_L · Extended thinking — provedmini-reasoning · Q2_K_L · Writes code — asked, failedmini-reasoning · Q2_K_L · Reasons about code — provedmini-reasoning · Q2_K_L · Synthesises sources — never askedmini-reasoning · Q2_K_L · Follows instructions — asked, failedmini-reasoning · Q4_K_M · lmstudio-community · Structured output — provedmini-reasoning · Q4_K_M · lmstudio-community · Sustained output — provedmini-reasoning · Q4_K_M · lmstudio-community · Extended thinking — provedmini-reasoning · Q4_K_M · lmstudio-community · Writes code — asked, failedmini-reasoning · Q4_K_M · lmstudio-community · Reasons about code — provedmini-reasoning · Q4_K_M · lmstudio-community · Synthesises sources — provedmini-reasoning · Q4_K_M · lmstudio-community · Follows instructions — asked, failedmini · Q3_K_L · MaziyarPanahi · Structured output — provedmini · Q3_K_L · MaziyarPanahi · Sustained output — provedmini · Q3_K_L · MaziyarPanahi · Extended thinking — asked, failedmini · Q3_K_L · MaziyarPanahi · Writes code — provedmini · Q3_K_L · MaziyarPanahi · Reasons about code — asked, failedmini · Q3_K_L · MaziyarPanahi · Synthesises sources — asked, failedmini · Q3_K_L · MaziyarPanahi · Follows instructions — provedmini-reasoning · Q2_K · Structured output — provedmini-reasoning · Q2_K · Sustained output — provedmini-reasoning · Q2_K · Extended thinking — provedmini-reasoning · Q2_K · Writes code — asked, failedmini-reasoning · Q2_K · Reasons about code — provedmini-reasoning · Q2_K · Synthesises sources — provedmini-reasoning · Q2_K · Follows instructions — asked, failedmini-reasoning · Q4_K_M · unsloth · Structured output — provedmini-reasoning · Q4_K_M · unsloth · Sustained output — asked, failedmini-reasoning · Q4_K_M · unsloth · Extended thinking — provedmini-reasoning · Q4_K_M · unsloth · Writes code — asked, failedmini-reasoning · Q4_K_M · unsloth · Reasons about code — provedmini-reasoning · Q4_K_M · unsloth · Synthesises sources — provedmini-reasoning · Q4_K_M · unsloth · Follows instructions — asked, failedmini · Q3_K_S · bartowski · Structured output — never askedmini · Q3_K_S · bartowski · Sustained output — never askedmini · Q3_K_S · bartowski · Extended thinking — never askedmini · Q3_K_S · bartowski · Writes code — never askedmini · Q3_K_S · bartowski · Reasons about code — never askedmini · Q3_K_S · bartowski · Synthesises sources — never askedmini · Q3_K_S · bartowski · Follows instructions — never askedmini · Q4_K_M · bartowski · Structured output — never askedmini · Q4_K_M · bartowski · Sustained output — never askedmini · Q4_K_M · bartowski · Extended thinking — never askedmini · Q4_K_M · bartowski · Writes code — never askedmini · Q4_K_M · bartowski · Reasons about code — never askedmini · Q4_K_M · bartowski · Synthesises sources — never askedmini · Q4_K_M · bartowski · Follows instructions — never askedreasoning-plus · Q4_K_M · Structured output — never askedreasoning-plus · Q4_K_M · Sustained output — never askedreasoning-plus · Q4_K_M · Extended thinking — never askedreasoning-plus · Q4_K_M · Writes code — never askedreasoning-plus · Q4_K_M · Reasons about code — never askedreasoning-plus · Q4_K_M · Synthesises sources — never askedreasoning-plus · Q4_K_M · Follows instructions — never askedreasoning-plus · Q6_K · Structured output — provedreasoning-plus · Q6_K · Sustained output — provedreasoning-plus · Q6_K · Extended thinking — asked, failedreasoning-plus · Q6_K · Writes code — asked, failedreasoning-plus · Q6_K · Reasons about code — provedreasoning-plus · Q6_K · Synthesises sources — provedreasoning-plus · Q6_K · Follows instructions — provedmini · Q2_K · Structured output — provedmini · Q2_K · Sustained output — provedmini · Q2_K · Extended thinking — asked, failedmini · Q2_K · Writes code — provedmini · Q2_K · Reasons about code — asked, failedmini · Q2_K · Synthesises sources — asked, failedmini · Q2_K · Follows instructions — asked, failedmini · Q4_K_M · MaziyarPanahi · Structured output — provedmini · Q4_K_M · MaziyarPanahi · Sustained output — provedmini · Q4_K_M · MaziyarPanahi · Extended thinking — asked, failedmini · Q4_K_M · MaziyarPanahi · Writes code — provedmini · Q4_K_M · MaziyarPanahi · Reasons about code — asked, failedmini · Q4_K_M · MaziyarPanahi · Synthesises sources — provedmini · Q4_K_M · MaziyarPanahi · Follows instructions — provedmini · Q4_K_S · Structured output — provedmini · Q4_K_S · Sustained output — provedmini · Q4_K_S · Extended thinking — asked, failedmini · Q4_K_S · Writes code — provedmini · Q4_K_S · Reasons about code — asked, failedmini · Q4_K_S · Synthesises sources — provedmini · Q4_K_S · Follows instructions — provedmini · Q8_0 · Structured output — provedmini · Q8_0 · Sustained output — provedmini · Q8_0 · Extended thinking — asked, failedmini · Q8_0 · Writes code — provedmini · Q8_0 · Reasons about code — asked, failedmini · Q8_0 · Synthesises sources — asked, failedmini · Q8_0 · Follows instructions — provedmini · IQ2_XS · Structured output — provedmini · IQ2_XS · Sustained output — provedmini · IQ2_XS · Extended thinking — asked, failedmini · IQ2_XS · Writes code — asked, failedmini · IQ2_XS · Reasons about code — provedmini · IQ2_XS · Synthesises sources — asked, failedmini · IQ2_XS · Follows instructions — asked, failedmini · BF16 · Structured output — provedmini · BF16 · Sustained output — never askedmini · BF16 · Extended thinking — never askedmini · BF16 · Writes code — never askedmini · BF16 · Reasons about code — never askedmini · BF16 · Synthesises sources — never askedmini · BF16 · Follows instructions — never askedmini · Q4_K_M · unsloth · Structured output — never askedmini · Q4_K_M · unsloth · Sustained output — never askedmini · Q4_K_M · unsloth · Extended thinking — never askedmini · Q4_K_M · unsloth · Writes code — never askedmini · Q4_K_M · unsloth · Reasons about code — never askedmini · Q4_K_M · unsloth · Synthesises sources — never askedmini · Q4_K_M · unsloth · Follows instructions — never asked
Structured output
Sustained output
Extended thinking
Writes code
Reasons about code
Synthesises sources
Follows instructions
hf.co/bartowski/microsoft_Phi-4-mini-instruct-GGUF:Q3_K_Lmini · Q3_K_L · 1 machine
8,192recalled
—served
32.1best tok/s
hf.co/unsloth/Phi-4-mini-reasoning-GGUF:IQ3_XXSmini-reasoning · IQ3_XXS · 5 machines · 3.84B
4,096recalled
—served
189.4best tok/s
189.4 tok/s · unnamed machine41.8 tok/s · unnamed machine4.2 tok/s · unnamed machine
4.2 → 189.4 tok/s across 3 machines · ×45.0 spreadunnamed machine
recalled 4k⌐ declared 128k · unsignedadvertises 32× what it proved
hf.co/MaziyarPanahi/Phi-4-mini-instruct-GGUF:Q3_K_Smini · Q3_K_S · 3 machines
4,096recalled
—served
134.8best tok/s
134.8 tok/s · unnamed machine27.9 tok/s · unnamed machine2.2 tok/s · Apple silicon · Bhubaneswar
2.2 → 134.8 tok/s across 3 machines · ×62.2 spreadunnamed machineApple silicon
hf.co/bartowski/microsoft_Phi-4-mini-instruct-GGUF:IQ2_Mmini · IQ2_M · 2 machines
4,096recalled
—served
37.3best tok/s
37.3 tok/s · unnamed machine1.1 tok/s · Apple silicon · Bhubaneswar
1.1 → 37.3 tok/s across 2 machines · ×35.3 spreadunnamed machineApple silicon
hf.co/lmstudio-community/Phi-4-mini-reasoning-GGUF:Q8_0mini-reasoning · Q8_0 · 1 machine · 3.84B
4,096recalled
—served
22.2best tok/s
recalled 4k⌐ declared 128k · unsignedadvertises 32× what it proved
hf.co/unsloth/Phi-4-mini-reasoning-GGUF:IQ1_Smini-reasoning · IQ1_S · 9 machines · 3.84B
—recalled
—served
188.9best tok/s
26.4 tok/s · unnamed machine19.8 tok/s · unnamed machine5.6 tok/s · x86 · CPU · Hyderabad5.6 tok/s · unnamed machine4.0 tok/s · unnamed machine
4.0 → 26.4 tok/s across 5 machines · ×6.5 spreadunnamed machinex86 · CPU
hf.co/lmstudio-community/Phi-4-mini-reasoning-GGUF:Q3_K_Lmini-reasoning · Q3_K_L · 4 machines
—recalled
—served
89.9best tok/s
89.9 tok/s · unnamed machine24.9 tok/s · unnamed machine3.8 tok/s · unnamed machine3.4 tok/s · unnamed machine
3.4 → 89.9 tok/s across 4 machines · ×26.3 spreadunnamed machine
hf.co/unsloth/Phi-4-mini-reasoning-GGUF:Q3_K_Mmini-reasoning · Q3_K_M · 4 machines
—recalled
—served
31.9best tok/s
31.9 tok/s · unnamed machine20.2 tok/s · unnamed machine20.2 tok/s · unnamed machine0.0 tok/s · Apple silicon · Bhubaneswar
0.0 → 31.9 tok/s across 4 machines · ×1447.5 spreadunnamed machineApple silicon
hf.co/unsloth/Phi-4-mini-reasoning-GGUF:Q2_K_Lmini-reasoning · Q2_K_L · 3 machines
—recalled
—served
6.8best tok/s
hf.co/lmstudio-community/Phi-4-mini-reasoning-GGUF:Q4_K_Mmini-reasoning · Q4_K_M · 2 machines
—recalled
—served
7.3best tok/s
7.3 tok/s · unnamed machine4.8 tok/s · unnamed machine
4.8 → 7.3 tok/s across 2 machines · ×1.5 spreadunnamed machine
hf.co/MaziyarPanahi/Phi-4-mini-instruct-GGUF:Q3_K_Lmini · Q3_K_L · 2 machines
—recalled
—served
110.1best tok/s
110.1 tok/s · unnamed machine2.2 tok/s · Apple silicon · Bhubaneswar
2.2 → 110.1 tok/s across 2 machines · ×50.1 spreadunnamed machineApple silicon
hf.co/unsloth/Phi-4-mini-reasoning-GGUF:Q2_Kmini-reasoning · Q2_K · 2 machines
—recalled
—served
37.7best tok/s
37.7 tok/s · unnamed machine9.8 tok/s · x86 · CPU · Hyderabad
9.8 → 37.7 tok/s across 2 machines · ×3.8 spreadunnamed machinex86 · CPU
hf.co/unsloth/Phi-4-mini-reasoning-GGUF:Q4_K_Mmini-reasoning · Q4_K_M · 2 machines
—recalled
—served
6.5best tok/s
6.5 tok/s · x86 · CPU · Hyderabad1.9 tok/s · Apple silicon · Bhubaneswar
1.9 → 6.5 tok/s across 2 machines · ×3.5 spreadx86 · CPUApple silicon
hf.co/bartowski/microsoft_Phi-4-mini-instruct-GGUF:Q3_K_Smini · Q3_K_S · 1 machine
—recalled
—served
28.2best tok/s
hf.co/bartowski/microsoft_Phi-4-mini-instruct-GGUF:Q4_K_Mmini · Q4_K_M · 1 machine
—recalled
—served
40.6best tok/s
hf.co/lmstudio-community/Phi-4-reasoning-plus-GGUF:Q4_K_Mreasoning-plus · Q4_K_M · 1 machine
—recalled
—served
—best tok/s
hf.co/lmstudio-community/Phi-4-reasoning-plus-GGUF:Q6_Kreasoning-plus · Q6_K · 1 machine
—recalled
—served
3.3best tok/s
hf.co/MaziyarPanahi/Phi-4-mini-instruct-GGUF:Q2_Kmini · Q2_K · 1 machine
—recalled
—served
154.3best tok/s
hf.co/MaziyarPanahi/Phi-4-mini-instruct-GGUF:Q4_K_Mmini · Q4_K_M · 1 machine
—recalled
—served
101.9best tok/s
hf.co/MaziyarPanahi/Phi-4-mini-instruct-GGUF:Q4_K_Smini · Q4_K_S · 1 machine
—recalled
—served
77.4best tok/s
hf.co/MaziyarPanahi/Phi-4-mini-instruct-GGUF:Q8_0mini · Q8_0 · 1 machine
—recalled
—served
39.2best tok/s
hf.co/Mungert/Phi-4-mini-instruct.gguf:IQ2_XSmini · IQ2_XS · 1 machine
—recalled
—served
8.5best tok/s
hf.co/unsloth/Phi-4-mini-instruct-GGUF:BF16mini · BF16 · 1 machine
—recalled
—served
0.1best tok/s
hf.co/unsloth/Phi-4-mini-instruct-GGUF:Q4_K_Mmini · Q4_K_M · 1 machine
—recalled
—served
2.2best tok/s

Builds this network knows of

Declared, not measured — this is what the catalog says exists and what it would cost a machine to hold. Nothing here is signed, and none of it claims the build works.

how much memory does your machine have

45 of 55 builds fit a 16 GB machine — budgeting 70% of it, or 11.2 GiB, because the cache and the runtime want the rest.

  • optimum-intel-internal-testing/tiny-random-phi-4-multimodalFP32vllmderived by optimum-intel-internal-testing
    0.0 GiB
  • hf.co/unsloth/Phi-4-mini-reasoning-GGUF:IQ1_SIQ1_Sollamameasured herequantized by unsloth
    1.1 GiB
  • hf.co/bartowski/microsoft_Phi-4-mini-instruct-GGUF:IQ2_MIQ2_Mollamameasured herederived by bartowski
    1.4 GiB
  • hf.co/unsloth/Phi-4-mini-reasoning-GGUF:IQ3_XXSIQ3_XXSollamameasured herequantized by unsloth
    1.6 GiB
  • hf.co/bartowski/microsoft_Phi-4-mini-instruct-GGUF:IQ3_XXSIQ3_XXSollamaderived by bartowski
    1.6 GiB
  • hf.co/MaziyarPanahi/Phi-4-mini-instruct-GGUF:Q2_KQ2_Kollamameasured herequantized by MaziyarPanahi
    1.6 GiB
  • hf.co/MaziyarPanahi/Phi-4-mini-instruct-GGUF:Q3_K_SQ3_K_Sollamameasured herequantized by MaziyarPanahi
    1.8 GiB
  • mlx-community/Phi-4-mini-instruct-4bit4BITmlxquantized by mlx-community
    2.0 GiB
  • lmstudio-community/Phi-4-mini-reasoning-MLX-4bit4BITmlxquantized by lmstudio-community
    2.0 GiB
  • charakaweb/phi4-clinical-mlx4BITmlxderived by charakaweb
    2.0 GiB
  • hf.co/bartowski/microsoft_Phi-4-mini-instruct-GGUF:IQ4_XSIQ4_XSollamaderived by bartowski
    2.1 GiB
  • hf.co/MaziyarPanahi/Phi-4-mini-instruct-GGUF:Q3_K_LQ3_K_Lollamameasured herequantized by MaziyarPanahi
    2.1 GiB
  • hf.co/lmstudio-community/Phi-4-mini-reasoning-GGUF:Q3_K_LQ3_K_Lollamameasured herequantized by lmstudio-community
    2.1 GiB
  • hf.co/bartowski/microsoft_Phi-4-mini-instruct-GGUF:Q4_0Q4_0ollamaderived by bartowski
    2.2 GiB
  • hf.co/MaziyarPanahi/Phi-4-mini-instruct-GGUF:Q4_K_SQ4_K_Sollamameasured herequantized by MaziyarPanahi
    2.2 GiB
  • hf.co/MaziyarPanahi/Phi-4-mini-instruct-GGUF:Q4_K_MQ4_K_Mollamameasured herequantized by MaziyarPanahi
    2.3 GiB
  • hf.co/lmstudio-community/Phi-4-mini-reasoning-GGUF:Q4_K_MQ4_K_Mollamameasured herequantized by lmstudio-community
    2.3 GiB
  • hf.co/bartowski/microsoft_Phi-4-mini-instruct-GGUF:Q4_K_MQ4_K_Mollamameasured herederived by bartowski
    2.3 GiB
  • hf.co/lmstudio-community/Phi-4-mini-reasoning-GGUF:Q6_KQ6_Kollamaquantized by lmstudio-community
    2.9 GiB
  • unsloth/Phi-4-mini-instruct-unsloth-bnb-4bitBITSANDBYTESvllmderived by unsloth
    3.0 GiB
  • hf.co/unsloth/Phi-4-reasoning-plus-GGUF:IQ1_SIQ1_Sollamaquantized by unsloth
    3.3 GiB
  • mlx-community/Phi-4-mini-instruct-8bit8BITmlxquantized by mlx-community
    3.8 GiB
  • hf.co/MaziyarPanahi/Phi-4-mini-instruct-GGUF:Q8_0Q8_0ollamameasured herequantized by MaziyarPanahi
    3.8 GiB
  • hf.co/lmstudio-community/Phi-4-mini-reasoning-GGUF:Q8_0Q8_0ollamameasured herequantized by lmstudio-community
    3.8 GiB
  • hf.co/bartowski/microsoft_Phi-4-mini-instruct-GGUF:Q8_0Q8_0ollamaderived by bartowski
    3.8 GiB
  • hf.co/unsloth/Phi-4-reasoning-plus-GGUF:IQ2_XXSIQ2_XXSollamaquantized by unsloth
    4.0 GiB
  • hf.co/microsoft/phi-4-gguf:Q2_KQ2_Kollamapublished by microsoft
    5.2 GiB
  • hf.co/unsloth/Phi-4-reasoning-plus-GGUF:IQ3_XXSIQ3_XXSollamaquantized by unsloth
    5.5 GiB
  • hf.co/microsoft/phi-4-gguf:IQ3_XXSIQ3_XXSollamapublished by microsoft
    5.7 GiB
  • hf.co/microsoft/phi-4-gguf:IQ3_SIQ3_Sollamapublished by microsoft
    6.1 GiB
  • microsoft/Phi-4-mini-instructBF16vllmpublished by microsoft
    7.1 GiB
  • microsoft/Phi-4-mini-reasoningBF16vllmpublished by microsoft
    7.1 GiB
  • unsloth/Phi-4-mini-instructBF16vllmderived by unsloth
    7.1 GiB
  • hf.co/unsloth/Phi-4-mini-instruct-GGUF:BF16BF16ollamameasured herequantized by unsloth
    7.2 GiB
  • hf.co/unsloth/Phi-4-mini-reasoning-GGUF:BF16BF16ollamaquantized by unsloth
    7.2 GiB
  • mlx-community/phi-4-4bit4BITmlxquantized by mlx-community
    7.7 GiB
  • mlx-community/Unsloth-Phi-4-4bit4BITmlxderived by mlx-community
    7.7 GiB
  • lmstudio-community/Phi-4-reasoning-MLX-4bit4BITmlxquantized by lmstudio-community
    7.7 GiB
  • lmstudio-community/Phi-4-reasoning-plus-MLX-4bit4BITmlxquantized by lmstudio-community
    7.7 GiB
  • hf.co/microsoft/phi-4-gguf:Q4_0Q4_0ollamapublished by microsoft
    7.8 GiB
  • hf.co/unsloth/Phi-4-reasoning-plus-GGUF:Q4_0Q4_0ollamaquantized by unsloth
    7.8 GiB
  • hf.co/MaziyarPanahi/phi-4-GGUF:Q4_K_MQ4_K_Mollamaquantized by MaziyarPanahi
    8.4 GiB
  • hf.co/unsloth/Phi-4-reasoning-plus-GGUF:Q4_K_MQ4_K_Mollamaquantized by unsloth
    8.4 GiB
  • unsloth/phi-4-unsloth-bnb-4bitBITSANDBYTESvllmderived by unsloth
    9.7 GiB
  • Lexius/Phi-4-multimodal-instructBF16vllmderived by Lexius
    10.4 GiB
  • microsoft/Phi-4-multimodal-instructBF16vllmpublished by microsoft
    11.9 GiB
  • mlx-community/phi-4-8bit8BITmlxquantized by mlx-community
    14.5 GiB
  • hf.co/microsoft/phi-4-gguf:Q8_0Q8_0ollamapublished by microsoft
    14.5 GiB
  • hf.co/unsloth/Phi-4-reasoning-plus-GGUF:Q8_0Q8_0ollamaquantized by unsloth
    14.5 GiB
  • RedHatAI/phi-4-FP8-dynamicFP8vllmquantized by RedHatAI
    14.6 GiB
  • RedHatAI/phi-4-quantized.w8a8W8A8vllmquantized by RedHatAI
    14.6 GiB
  • microsoft/Phi-4-reasoningBF16vllmpublished by microsoft
    27.3 GiB
  • microsoft/Phi-4-reasoning-plusBF16vllmpublished by microsoft
    27.3 GiB
  • hf.co/microsoft/phi-4-gguf:BF16BF16ollamapublished by microsoft
    27.3 GiB
  • hf.co/unsloth/Phi-4-reasoning-plus-GGUF:BF16BF16ollamaquantized by unsloth
    27.3 GiB

Sizes are what the catalog declares, not what a machine measured — fitting on disk is necessary and not sufficient. Nobody here has run these on your machine, and this narrows the candidates rather than certifying one.

the same builds, by member
Phi 4 BASE
hf.co/microsoft/phi-4-gguf:Q2_KQ2_Kollama5.2 GiB on diskpublished by microsoft
hf.co/microsoft/phi-4-gguf:IQ3_XXSIQ3_XXSollama5.7 GiB on diskpublished by microsoft
hf.co/microsoft/phi-4-gguf:IQ3_SIQ3_Sollama6.1 GiB on diskpublished by microsoft
mlx-community/phi-4-4bit4BITmlx7.7 GiB on diskquantized by mlx-community
hf.co/microsoft/phi-4-gguf:Q4_0Q4_0ollama7.8 GiB on diskpublished by microsoft
hf.co/MaziyarPanahi/phi-4-GGUF:Q4_K_MQ4_K_Mollama8.4 GiB on diskquantized by MaziyarPanahi
mlx-community/phi-4-8bit8BITmlx14.5 GiB on diskquantized by mlx-community
hf.co/microsoft/phi-4-gguf:Q8_0Q8_0ollama14.5 GiB on diskpublished by microsoft
RedHatAI/phi-4-FP8-dynamicFP8vllm14.6 GiB on diskquantized by RedHatAI
RedHatAI/phi-4-quantized.w8a8W8A8vllm14.6 GiB on diskquantized by RedHatAI
hf.co/microsoft/phi-4-gguf:BF16BF16ollama27.3 GiB on diskpublished by microsoft
Phi 4 BASE · mlx-community
mlx-community/Unsloth-Phi-4-4bit4BITmlx7.7 GiB on diskderived by mlx-community
Phi 4 BASE · unsloth
unsloth/phi-4-unsloth-bnb-4bitBITSANDBYTESvllm9.7 GiB on diskderived by unsloth
Phi 4 MINI
hf.co/MaziyarPanahi/Phi-4-mini-instruct-GGUF:Q2_KQ2_Kollama1.6 GiB on diskquantized by MaziyarPanahi
hf.co/MaziyarPanahi/Phi-4-mini-instruct-GGUF:Q3_K_SQ3_K_Sollama1.8 GiB on diskquantized by MaziyarPanahi
mlx-community/Phi-4-mini-instruct-4bit4BITmlx2.0 GiB on diskquantized by mlx-community
hf.co/MaziyarPanahi/Phi-4-mini-instruct-GGUF:Q3_K_LQ3_K_Lollama2.1 GiB on diskquantized by MaziyarPanahi
hf.co/MaziyarPanahi/Phi-4-mini-instruct-GGUF:Q4_K_SQ4_K_Sollama2.2 GiB on diskquantized by MaziyarPanahi
hf.co/MaziyarPanahi/Phi-4-mini-instruct-GGUF:Q4_K_MQ4_K_Mollama2.3 GiB on diskquantized by MaziyarPanahi
mlx-community/Phi-4-mini-instruct-8bit8BITmlx3.8 GiB on diskquantized by mlx-community
hf.co/MaziyarPanahi/Phi-4-mini-instruct-GGUF:Q8_0Q8_0ollama3.8 GiB on diskquantized by MaziyarPanahi
microsoft/Phi-4-mini-instructBF16vllm7.1 GiB on diskpublished by microsoft
hf.co/unsloth/Phi-4-mini-instruct-GGUF:BF16BF16ollama7.2 GiB on diskquantized by unsloth
Phi 4 MINI-REASONING
hf.co/unsloth/Phi-4-mini-reasoning-GGUF:IQ1_SIQ1_Sollama1.1 GiB on diskquantized by unsloth
hf.co/unsloth/Phi-4-mini-reasoning-GGUF:IQ3_XXSIQ3_XXSollama1.6 GiB on diskquantized by unsloth
lmstudio-community/Phi-4-mini-reasoning-MLX-4bit4BITmlx2.0 GiB on diskquantized by lmstudio-community
hf.co/lmstudio-community/Phi-4-mini-reasoning-GGUF:Q3_K_LQ3_K_Lollama2.1 GiB on diskquantized by lmstudio-community
hf.co/lmstudio-community/Phi-4-mini-reasoning-GGUF:Q4_K_MQ4_K_Mollama2.3 GiB on diskquantized by lmstudio-community
hf.co/lmstudio-community/Phi-4-mini-reasoning-GGUF:Q6_KQ6_Kollama2.9 GiB on diskquantized by lmstudio-community
hf.co/lmstudio-community/Phi-4-mini-reasoning-GGUF:Q8_0Q8_0ollama3.8 GiB on diskquantized by lmstudio-community
microsoft/Phi-4-mini-reasoningBF16vllm7.1 GiB on diskpublished by microsoft
hf.co/unsloth/Phi-4-mini-reasoning-GGUF:BF16BF16ollama7.2 GiB on diskquantized by unsloth
Phi 4 MINI · bartowski
hf.co/bartowski/microsoft_Phi-4-mini-instruct-GGUF:IQ2_MIQ2_Mollama1.4 GiB on diskderived by bartowski
hf.co/bartowski/microsoft_Phi-4-mini-instruct-GGUF:IQ3_XXSIQ3_XXSollama1.6 GiB on diskderived by bartowski
hf.co/bartowski/microsoft_Phi-4-mini-instruct-GGUF:IQ4_XSIQ4_XSollama2.1 GiB on diskderived by bartowski
hf.co/bartowski/microsoft_Phi-4-mini-instruct-GGUF:Q4_0Q4_0ollama2.2 GiB on diskderived by bartowski
hf.co/bartowski/microsoft_Phi-4-mini-instruct-GGUF:Q4_K_MQ4_K_Mollama2.3 GiB on diskderived by bartowski
hf.co/bartowski/microsoft_Phi-4-mini-instruct-GGUF:Q8_0Q8_0ollama3.8 GiB on diskderived by bartowski
Phi 4 MINI · charakaweb
charakaweb/phi4-clinical-mlx4BITmlx2.0 GiB on diskderived by charakaweb
Phi 4 MINI · unsloth
unsloth/Phi-4-mini-instruct-unsloth-bnb-4bitBITSANDBYTESvllm3.0 GiB on diskderived by unsloth
unsloth/Phi-4-mini-instructBF16vllm7.1 GiB on diskderived by unsloth
Phi 4 MULTIMODAL
microsoft/Phi-4-multimodal-instructBF16vllm11.9 GiB on diskpublished by microsoft
Phi 4 MULTIMODAL · Lexius
Lexius/Phi-4-multimodal-instructBF16vllm10.4 GiB on diskderived by Lexius
Phi 4 REASONING
lmstudio-community/Phi-4-reasoning-MLX-4bit4BITmlx7.7 GiB on diskquantized by lmstudio-community
microsoft/Phi-4-reasoningBF16vllm27.3 GiB on diskpublished by microsoft
Phi 4 REASONING-PLUS
hf.co/unsloth/Phi-4-reasoning-plus-GGUF:IQ1_SIQ1_Sollama3.3 GiB on diskquantized by unsloth
hf.co/unsloth/Phi-4-reasoning-plus-GGUF:IQ2_XXSIQ2_XXSollama4.0 GiB on diskquantized by unsloth
hf.co/unsloth/Phi-4-reasoning-plus-GGUF:IQ3_XXSIQ3_XXSollama5.5 GiB on diskquantized by unsloth
lmstudio-community/Phi-4-reasoning-plus-MLX-4bit4BITmlx7.7 GiB on diskquantized by lmstudio-community
hf.co/unsloth/Phi-4-reasoning-plus-GGUF:Q4_0Q4_0ollama7.8 GiB on diskquantized by unsloth
hf.co/unsloth/Phi-4-reasoning-plus-GGUF:Q4_K_MQ4_K_Mollama8.4 GiB on diskquantized by unsloth
hf.co/unsloth/Phi-4-reasoning-plus-GGUF:Q8_0Q8_0ollama14.5 GiB on diskquantized by unsloth
microsoft/Phi-4-reasoning-plusBF16vllm27.3 GiB on diskpublished by microsoft
hf.co/unsloth/Phi-4-reasoning-plus-GGUF:BF16BF16ollama27.3 GiB on diskquantized by unsloth
Phi 4 TINY-RANDOM-MULTIMODAL · optimum-intel-internal-testing
optimum-intel-internal-testing/tiny-random-phi-4-multimodalFP32vllm24 MiB on diskderived by optimum-intel-internal-testing
ask your own gram

Your concierge can answer this from the network rather than from this page. The ask carries the operator id, so it resolves to a capability and an engine — not to a name somebody has to recognise.

What has this network measured about the Phi 4 family (epn.family.phi-4), and can my gram run any of it? See /inferences/phi-4

open a gramx with this ask →epn.family.phi-4