model family

Devstral Small

Published by mistralai. No machine on this network has measured this family yet. The members below are what the catalog knows exists; nothing about what they can do is claimed here until somebody runs one.

what it takes, what it returns

text → text

Declared by the network’s catalog, not measured — a signature says what this family would be asked. Whether it answered is the signed capability flags on each member.

0 of 55 builds measured · 55 still open

Devstral-Small-2-24B-Instruct-25121 known build · not measured

Devstral-Small-25071 known build · not measured

Devstral Small 24B-INSTRUCT-251212 known builds · not measured

Devstral-Small-2-24B-Instruct-2512-OptiQ-4bit1 known build · not measured

Huihui-Devstral-Small-2-24B-Instruct-2512-abliterated-mlx-4bit1 known build · not measured

Devstral-Small-2-24B-AWQ1 known build · not measured

Devstral-Small-2-24B-Instruct-abliterated6 known builds · not measured

Devstral Small 25059 known builds · not measured

Devstral Small 250712 known builds · not measured

Devstral-Small-2507-Vision7 known builds · not measured

Devstral-Small-2507-NVFP4A161 known build · not measured

Devstral-Small-2507-MLX-bf161 known build · not measured

Devstral-Small-2507-unsloth-bnb-4bit1 known build · not measured

Builds this network knows of

Declared, not measured — this is what the catalog says exists and what it would cost a machine to hold. Nothing here is signed, and none of it claims the build works.

how much memory does your machine have

13 of 55 builds fit a 16 GB machine — budgeting 70% of it, or 11.2 GiB, because the cache and the runtime want the rest.

hf.co/unsloth/Devstral-Small-2-24B-Instruct-2512-GGUF:IQ1_SIQ1_Sollamaquantized by unsloth
5.2 GiB
hf.co/unsloth/Devstral-Small-2505-GGUF:IQ1_SIQ1_Sollamaquantized by unsloth
5.2 GiB
hf.co/unsloth/Devstral-Small-2507-GGUF:IQ1_SIQ1_Sollamaquantized by unsloth
5.2 GiB
hf.co/unsloth/Devstral-Small-2-24B-Instruct-2512-GGUF:IQ2_XXSIQ2_XXSollamaquantized by unsloth
6.3 GiB
hf.co/unsloth/Devstral-Small-2505-GGUF:IQ2_XXSIQ2_XXSollamaquantized by unsloth
6.3 GiB
hf.co/unsloth/Devstral-Small-2507-GGUF:IQ2_XXSIQ2_XXSollamaquantized by unsloth
6.3 GiB
hf.co/mradermacher/Devstral-Small-2-24B-Instruct-abliterated-GGUF:Q2_KQ2_Kollamaderived by mradermacher
8.3 GiB
hf.co/EnlistedGhost/Devstral-Small-2507-Vision-GGUF:Q2_KQ2_Kollamaderived by EnlistedGhost
8.6 GiB
hf.co/unsloth/Devstral-Small-2-24B-Instruct-2512-GGUF:IQ3_XXSIQ3_XXSollamaquantized by unsloth
8.8 GiB
hf.co/unsloth/Devstral-Small-2505-GGUF:IQ3_XXSIQ3_XXSollamaquantized by unsloth
8.8 GiB
hf.co/unsloth/Devstral-Small-2507-GGUF:IQ3_XXSIQ3_XXSollamaquantized by unsloth
8.8 GiB
hf.co/mradermacher/Devstral-Small-2-24B-Instruct-abliterated-GGUF:Q3_K_SQ3_K_Sollamaderived by mradermacher
9.7 GiB
hf.co/EnlistedGhost/Devstral-Small-2507-Vision-GGUF:Q3_K_SQ3_K_Sollamaderived by EnlistedGhost
9.9 GiB
hf.co/mradermacher/Devstral-Small-2-24B-Instruct-abliterated-GGUF:Q3_K_LQ3_K_Lollamaderived by mradermacher
11.5 GiB
hf.co/EnlistedGhost/Devstral-Small-2507-Vision-GGUF:Q3_K_LQ3_K_Lollamaderived by EnlistedGhost
11.8 GiB
veeceey/Huihui-Devstral-Small-2-24B-Instruct-2512-abliterated-mlx-4bit4BITmlxderived by veeceey
12.3 GiB
lmstudio-community/Devstral-Small-2505-MLX-4bit4BITmlxquantized by lmstudio-community
12.3 GiB
lmstudio-community/Devstral-Small-2507-MLX-4bit4BITmlxquantized by lmstudio-community
12.3 GiB
hf.co/unsloth/Devstral-Small-2-24B-Instruct-2512-GGUF:Q4_0Q4_0ollamaquantized by unsloth
12.6 GiB
hf.co/mradermacher/Devstral-Small-2-24B-Instruct-abliterated-GGUF:Q4_K_SQ4_K_Sollamaderived by mradermacher
12.6 GiB
hf.co/unsloth/Devstral-Small-2505-GGUF:Q4_K_SQ4_K_Sollamaquantized by unsloth
12.6 GiB
hf.co/EnlistedGhost/Devstral-Small-2507-Vision-GGUF:Q4_K_SQ4_K_Sollamaderived by EnlistedGhost
12.8 GiB
cyankiwi/Devstral-Small-2507-AWQ-4bitAWQvllmquantized by cyankiwi
13.3 GiB
hf.co/mradermacher/Devstral-Small-2-24B-Instruct-abliterated-GGUF:Q4_K_MQ4_K_Mollamaderived by mradermacher
13.3 GiB
hf.co/unsloth/Devstral-Small-2505-GGUF:Q4_K_MQ4_K_Mollamaquantized by unsloth
13.3 GiB
hf.co/mistralai/Devstral-Small-2507_gguf:Q4_K_MQ4_K_Mollamapublished by mistralai
13.3 GiB
hf.co/unsloth/Devstral-Small-2-24B-Instruct-2512-GGUF:Q4_K_MQ4_K_Mollamaquantized by unsloth
13.3 GiB
hf.co/EnlistedGhost/Devstral-Small-2507-Vision-GGUF:Q4_K_MQ4_K_Mollamaderived by EnlistedGhost
13.5 GiB
unsloth/Devstral-Small-2507-unsloth-bnb-4bitBITSANDBYTESvllmderived by unsloth
13.9 GiB
mlx-community/Devstral-Small-2-24B-Instruct-2512-4bit4BITmlxquantized by mlx-community
14.1 GiB
mattbucci/Devstral-Small-2-24B-AWQAWQvllmderived by mattbucci
14.1 GiB
apolloparty/Devstral-Small-2507-NVFP4A16W4A16vllmderived by apolloparty
14.1 GiB
Firworks/Devstral-Small-2-24B-Instruct-2512-nvfp4W4A4vllmquantized by Firworks
15.0 GiB
hf.co/mistralai/Devstral-Small-2507_gguf:Q5_K_MQ5_K_Mollamapublished by mistralai
15.6 GiB
mlx-community/Devstral-Small-2-24B-Instruct-2512-OptiQ-4bit4BITmlxderived by mlx-community
16.2 GiB
lmstudio-community/Devstral-Small-2507-MLX-6bit6BITmlxquantized by lmstudio-community
17.8 GiB
lmstudio-community/Devstral-Small-2507-MLX-8bit8BITmlxquantized by lmstudio-community
23.3 GiB
hf.co/unsloth/Devstral-Small-2-24B-Instruct-2512-GGUF:Q8_0Q8_0ollamaquantized by unsloth
23.3 GiB
hf.co/mradermacher/Devstral-Small-2-24B-Instruct-abliterated-GGUF:Q8_0Q8_0ollamaderived by mradermacher
23.3 GiB
hf.co/unsloth/Devstral-Small-2505-GGUF:Q8_0Q8_0ollamaquantized by unsloth
23.3 GiB
hf.co/mistralai/Devstral-Small-2507_gguf:Q8_0Q8_0ollamapublished by mistralai
23.3 GiB
hf.co/EnlistedGhost/Devstral-Small-2507-Vision-GGUF:Q8_0Q8_0ollamaderived by EnlistedGhost
23.3 GiB
mlx-community/mistralai_Devstral-Small-2-24B-Instruct-2512-MLX-8Bit8BITmlxquantized by mlx-community
24.7 GiB
cyankiwi/Devstral-Small-2-24B-Instruct-2512-AWQ-4bitW4A16vllmquantized by cyankiwi
29.9 GiB
unsloth/Devstral-Small-2507BF16vllmderived by unsloth
43.9 GiB
lmstudio-community/Devstral-Small-2507-MLX-bf16BF16mlxderived by lmstudio-community
43.9 GiB
hf.co/unsloth/Devstral-Small-2-24B-Instruct-2512-GGUF:BF16BF16ollamaquantized by unsloth
43.9 GiB
hf.co/unsloth/Devstral-Small-2505-GGUF:BF16BF16ollamaquantized by unsloth
43.9 GiB
hf.co/mistralai/Devstral-Small-2507_gguf:BF16BF16ollamapublished by mistralai
43.9 GiB
hf.co/EnlistedGhost/Devstral-Small-2507-Vision-GGUF:BF16BF16ollamaderived by EnlistedGhost
43.9 GiB
mistralai/Devstral-Small-2-24B-Instruct-2512FP8vllmderived by mistralai
48.0 GiB
RedHatAI/Devstral-Small-2-24B-Instruct-2512FP8vllmderived by RedHatAI
48.0 GiB
unsloth/Devstral-Small-2-24B-Instruct-2512FP8vllmquantized by unsloth
48.0 GiB
mistralai/Devstral-Small-2505BF16vllmpublished by mistralai
87.8 GiB
mistralai/Devstral-Small-2507BF16vllmpublished by mistralai
87.8 GiB

Sizes are what the catalog declares, not what a machine measured — fitting on disk is necessary and not sufficient. Nobody here has run these on your machine, and this narrows the candidates rather than certifying one.

the same builds, by member

Devstral-Small-2-24B-Instruct-2512

mistralai/Devstral-Small-2-24B-Instruct-2512FP8vllm48.0 GiB on diskderived by mistralai

Devstral-Small-2-24B-Instruct-2512

RedHatAI/Devstral-Small-2-24B-Instruct-2512FP8vllm48.0 GiB on diskderived by RedHatAI

Devstral-Small-2507

unsloth/Devstral-Small-2507BF16vllm43.9 GiB on diskderived by unsloth

Devstral Small 24B-INSTRUCT-2512

hf.co/unsloth/Devstral-Small-2-24B-Instruct-2512-GGUF:IQ1_SIQ1_Sollama5.2 GiB on diskquantized by unsloth

hf.co/unsloth/Devstral-Small-2-24B-Instruct-2512-GGUF:IQ2_XXSIQ2_XXSollama6.3 GiB on diskquantized by unsloth

hf.co/unsloth/Devstral-Small-2-24B-Instruct-2512-GGUF:IQ3_XXSIQ3_XXSollama8.8 GiB on diskquantized by unsloth

hf.co/unsloth/Devstral-Small-2-24B-Instruct-2512-GGUF:Q4_0Q4_0ollama12.6 GiB on diskquantized by unsloth

hf.co/unsloth/Devstral-Small-2-24B-Instruct-2512-GGUF:Q4_K_MQ4_K_Mollama13.3 GiB on diskquantized by unsloth

mlx-community/Devstral-Small-2-24B-Instruct-2512-4bit4BITmlx14.1 GiB on diskquantized by mlx-community

Firworks/Devstral-Small-2-24B-Instruct-2512-nvfp4W4A4vllm15.0 GiB on diskquantized by Firworks

hf.co/unsloth/Devstral-Small-2-24B-Instruct-2512-GGUF:Q8_0Q8_0ollama23.3 GiB on diskquantized by unsloth

mlx-community/mistralai_Devstral-Small-2-24B-Instruct-2512-MLX-8Bit8BITmlx24.7 GiB on diskquantized by mlx-community

cyankiwi/Devstral-Small-2-24B-Instruct-2512-AWQ-4bitW4A16vllm29.9 GiB on diskquantized by cyankiwi

hf.co/unsloth/Devstral-Small-2-24B-Instruct-2512-GGUF:BF16BF16ollama43.9 GiB on diskquantized by unsloth

unsloth/Devstral-Small-2-24B-Instruct-2512FP8vllm48.0 GiB on diskquantized by unsloth

Devstral-Small-2-24B-Instruct-2512-OptiQ-4bit

mlx-community/Devstral-Small-2-24B-Instruct-2512-OptiQ-4bit4BITmlx16.2 GiB on diskderived by mlx-community

Huihui-Devstral-Small-2-24B-Instruct-2512-abliterated-mlx-4bit

veeceey/Huihui-Devstral-Small-2-24B-Instruct-2512-abliterated-mlx-4bit4BITmlx12.3 GiB on diskderived by veeceey

Devstral-Small-2-24B-AWQ

mattbucci/Devstral-Small-2-24B-AWQAWQvllm14.1 GiB on diskderived by mattbucci

Devstral-Small-2-24B-Instruct-abliterated

hf.co/mradermacher/Devstral-Small-2-24B-Instruct-abliterated-GGUF:Q2_KQ2_Kollama8.3 GiB on diskderived by mradermacher

hf.co/mradermacher/Devstral-Small-2-24B-Instruct-abliterated-GGUF:Q3_K_SQ3_K_Sollama9.7 GiB on diskderived by mradermacher

hf.co/mradermacher/Devstral-Small-2-24B-Instruct-abliterated-GGUF:Q3_K_LQ3_K_Lollama11.5 GiB on diskderived by mradermacher

hf.co/mradermacher/Devstral-Small-2-24B-Instruct-abliterated-GGUF:Q4_K_SQ4_K_Sollama12.6 GiB on diskderived by mradermacher

hf.co/mradermacher/Devstral-Small-2-24B-Instruct-abliterated-GGUF:Q4_K_MQ4_K_Mollama13.3 GiB on diskderived by mradermacher

hf.co/mradermacher/Devstral-Small-2-24B-Instruct-abliterated-GGUF:Q8_0Q8_0ollama23.3 GiB on diskderived by mradermacher

Devstral Small 2505

hf.co/unsloth/Devstral-Small-2505-GGUF:IQ1_SIQ1_Sollama5.2 GiB on diskquantized by unsloth

hf.co/unsloth/Devstral-Small-2505-GGUF:IQ2_XXSIQ2_XXSollama6.3 GiB on diskquantized by unsloth

hf.co/unsloth/Devstral-Small-2505-GGUF:IQ3_XXSIQ3_XXSollama8.8 GiB on diskquantized by unsloth

lmstudio-community/Devstral-Small-2505-MLX-4bit4BITmlx12.3 GiB on diskquantized by lmstudio-community

hf.co/unsloth/Devstral-Small-2505-GGUF:Q4_K_SQ4_K_Sollama12.6 GiB on diskquantized by unsloth

hf.co/unsloth/Devstral-Small-2505-GGUF:Q4_K_MQ4_K_Mollama13.3 GiB on diskquantized by unsloth

hf.co/unsloth/Devstral-Small-2505-GGUF:Q8_0Q8_0ollama23.3 GiB on diskquantized by unsloth

hf.co/unsloth/Devstral-Small-2505-GGUF:BF16BF16ollama43.9 GiB on diskquantized by unsloth

mistralai/Devstral-Small-2505BF16vllm87.8 GiB on diskpublished by mistralai

Devstral Small 2507

hf.co/unsloth/Devstral-Small-2507-GGUF:IQ1_SIQ1_Sollama5.2 GiB on diskquantized by unsloth

hf.co/unsloth/Devstral-Small-2507-GGUF:IQ2_XXSIQ2_XXSollama6.3 GiB on diskquantized by unsloth

hf.co/unsloth/Devstral-Small-2507-GGUF:IQ3_XXSIQ3_XXSollama8.8 GiB on diskquantized by unsloth

lmstudio-community/Devstral-Small-2507-MLX-4bit4BITmlx12.3 GiB on diskquantized by lmstudio-community

cyankiwi/Devstral-Small-2507-AWQ-4bitAWQvllm13.3 GiB on diskquantized by cyankiwi

hf.co/mistralai/Devstral-Small-2507_gguf:Q4_K_MQ4_K_Mollama13.3 GiB on diskpublished by mistralai

hf.co/mistralai/Devstral-Small-2507_gguf:Q5_K_MQ5_K_Mollama15.6 GiB on diskpublished by mistralai

lmstudio-community/Devstral-Small-2507-MLX-6bit6BITmlx17.8 GiB on diskquantized by lmstudio-community

lmstudio-community/Devstral-Small-2507-MLX-8bit8BITmlx23.3 GiB on diskquantized by lmstudio-community

hf.co/mistralai/Devstral-Small-2507_gguf:Q8_0Q8_0ollama23.3 GiB on diskpublished by mistralai

hf.co/mistralai/Devstral-Small-2507_gguf:BF16BF16ollama43.9 GiB on diskpublished by mistralai

mistralai/Devstral-Small-2507BF16vllm87.8 GiB on diskpublished by mistralai

Devstral-Small-2507-Vision

hf.co/EnlistedGhost/Devstral-Small-2507-Vision-GGUF:Q2_KQ2_Kollama8.6 GiB on diskderived by EnlistedGhost

hf.co/EnlistedGhost/Devstral-Small-2507-Vision-GGUF:Q3_K_SQ3_K_Sollama9.9 GiB on diskderived by EnlistedGhost

hf.co/EnlistedGhost/Devstral-Small-2507-Vision-GGUF:Q3_K_LQ3_K_Lollama11.8 GiB on diskderived by EnlistedGhost

hf.co/EnlistedGhost/Devstral-Small-2507-Vision-GGUF:Q4_K_SQ4_K_Sollama12.8 GiB on diskderived by EnlistedGhost

hf.co/EnlistedGhost/Devstral-Small-2507-Vision-GGUF:Q4_K_MQ4_K_Mollama13.5 GiB on diskderived by EnlistedGhost

hf.co/EnlistedGhost/Devstral-Small-2507-Vision-GGUF:Q8_0Q8_0ollama23.3 GiB on diskderived by EnlistedGhost

hf.co/EnlistedGhost/Devstral-Small-2507-Vision-GGUF:BF16BF16ollama43.9 GiB on diskderived by EnlistedGhost

Devstral-Small-2507-NVFP4A16

apolloparty/Devstral-Small-2507-NVFP4A16W4A16vllm14.1 GiB on diskderived by apolloparty

Devstral-Small-2507-MLX-bf16

lmstudio-community/Devstral-Small-2507-MLX-bf16BF16mlx43.9 GiB on diskderived by lmstudio-community

Devstral-Small-2507-unsloth-bnb-4bit

unsloth/Devstral-Small-2507-unsloth-bnb-4bitBITSANDBYTESvllm13.9 GiB on diskderived by unsloth

ask your own gram

Your concierge can answer this from the network rather than from this page. The ask carries the operator id, so it resolves to a capability and an engine — not to a name somebody has to recognise.

What has this network measured about the Devstral Small family (epn.family.devstral-small), and can my gram run any of it? See /inferences/devstral-small

open a gramx with this ask →epn.family.devstral-small