mlx-community
mlx-community/gemma-3-27b-it-qat-4bit
No description available.
Model Documentation
mlx-community/gemma-3-27b-it-qat-4bit
This model was converted to MLX format fromgoogle/gemma-3-27b-it-qat-q4_0-unquantized using mlx-vlm version 0.1.23.
Refer to the original model card for more details on the model.
Use with mlx
bash
pip install -U mlx-vlm
bash
python -m mlx_vlm.generate --model mlx-community/gemma-3-27b-it-qat-4bit --max-tokens 100 --temperature 0.0 --prompt "Describe this image." --image
Files & Weights
| Filename | Size | Action |
|---|---|---|
| model-00001-of-00004.safetensors | 5.00 GB | |
| model-00002-of-00004.safetensors | 4.99 GB | |
| model-00003-of-00004.safetensors | 4.94 GB | |
| model-00004-of-00004.safetensors | 0.75 GB |