mlx-community
mlx-community/Devstral-Small-2-24B-Instruct-2512-4bit
No description available.
Model Documentation
mlx-community/Devstral-Small-2-24B-Instruct-2512-4bit
This model was converted to MLX format frommistralai/Devstral-Small-2-24B-Instruct-2512 using mlx-vlm version 0.3.9.
Refer to the original model card for more details on the model.
Use with mlx
bash
pip install -U mlx-vlm
bash
python -m mlx_vlm.generate --model mlx-community/Devstral-Small-2-24B-Instruct-2512-4bit --max-tokens 100 --temperature 0.0 --prompt "Describe this image." --image
Files & Weights
| Filename | Size | Action |
|---|---|---|
| model-00001-of-00003.safetensors | 4.93 GB | |
| model-00002-of-00003.safetensors | 4.95 GB | |
| model-00003-of-00003.safetensors | 3.24 GB |