utDeepSeek · Downloadable
DeepSeek-R1-Distill-Qwen-1.5B
Generates text for conversations and writing. Supports a reasoning mode.
- Source listed
- Jan 20, 2025
- Parameters
- 1.5B
- 4-bit weights only
- ≈ 0.8 GB
- License
- mit
YOUR MEMORY BUDGET
Local AI models for 16GB VRAM.
Explore models by theoretical weight storage. This shortlist covers available downloadable language models with a known or name-derived parameter count.
14 GBleft for weights at 4-bit
16 GB budget − 2 GB reserve
16 GB budget − 2 GB reserve
The reserve is your assumption, not a measured overhead allowance. The default 2 GB may be too little for your runtime or context length. Results are not confirmed fits and have no verified speed rating. Weight estimates use decimal GB and do not include quantization overhead.
352 models within the weight budget
Largest parameter count first · not a quality rankingZ.ai · Downloadable
glm-edge-1.5b-chat
Generates text for conversations and writing.
- Source listed
- Nov 20, 2024
- Parameters
- 1.5B
- 4-bit weights only
- ≈ 0.8 GB
- License
- other
DeepSeek · Downloadable
deepseek-coder-1.3b-base
Designed for coding and software tasks. Generates text for conversations and writing.
- Source listed
- Oct 28, 2023
- Parameters
- 1.3B
- 4-bit weights only
- ≈ 0.7 GB
- License
- other
DeepSeek · Downloadable
deepseek-coder-1.3b-instruct
Designed for coding and software tasks. Generates text for conversations and writing.
- Source listed
- Oct 29, 2023
- Parameters
- 1.3B
- 4-bit weights only
- ≈ 0.7 GB
- License
- other
DeepSeek · Downloadable
deepseek-vl-1.3b-chat
Understands text and images and responds in text.
- Source listed
- Mar 7, 2024
- Parameters
- 1.3B
- 4-bit weights only
- ≈ 0.7 GB
- License
- other
Google · Downloadable
gemma-3-1b-it
Generates text for conversations and writing.
- Source listed
- Mar 10, 2025
- Parameters
- 1B
- 4-bit weights only
- ≈ 0.5 GB
- License
- gemma
Google · Downloadable
gemma-3-1b-it-qat-int4-unquantized
Generates text for conversations and writing.
- Source listed
- Apr 9, 2025
- Parameters
- 1B
- 4-bit weights only
- ≈ 0.5 GB
- License
- gemma
Google · Downloadable
gemma-3-1b-it-qat-q4_0
Generates text for conversations and writing.
- Source listed
- Mar 10, 2025
- Parameters
- 1B
- 4-bit weights only
- ≈ 0.5 GB
- License
- gemma
Google · Downloadable
gemma-3-1b-it-qat-q4_0-unquantized
Generates text for conversations and writing.
- Source listed
- Apr 8, 2025
- Parameters
- 1B
- 4-bit weights only
- ≈ 0.5 GB
- License
- gemma
Google · Downloadable
gemma-3-1b-pt
Generates text for conversations and writing.
- Source listed
- Feb 20, 2025
- Parameters
- 1B
- 4-bit weights only
- ≈ 0.5 GB
- License
- gemma
Google · Downloadable
gemma-3-1b-pt-qat-q4_0
Generates text for conversations and writing.
- Source listed
- Mar 12, 2025
- Parameters
- 1B
- 4-bit weights only
- ≈ 0.5 GB
- License
- gemma
Google · Downloadable
t5gemma-2-1b-1b
Understands text and images and responds in text.
- Source listed
- Oct 25, 2025
- Parameters
- 1B
- 4-bit weights only
- ≈ 0.5 GB
- License
- gemma
Google · Downloadable
vaultgemma-1b
Generates text for conversations and writing.
- Source listed
- Sep 5, 2025
- Parameters
- 1B
- 4-bit weights only
- ≈ 0.5 GB
- License
- gemma
Meta · Downloadable
Llama-3.2-1B
Generates text for conversations and writing.
- Source listed
- Sep 18, 2024
- Parameters
- 1B
- 4-bit weights only
- ≈ 0.5 GB
- License
- llama3.2
Meta · Downloadable
Llama-3.2-1B-Instruct
Generates text for conversations and writing.
- Source listed
- Sep 18, 2024
- Parameters
- 1B
- 4-bit weights only
- ≈ 0.5 GB
- License
- llama3.2
Meta · Downloadable
Llama-3.2-1B-Instruct-QLORA_INT4_EO8
Generates text for conversations and writing.
- Source listed
- Oct 23, 2024
- Parameters
- 1B
- 4-bit weights only
- ≈ 0.5 GB
- License
- llama3.2
Meta · Downloadable
Llama-3.2-1B-Instruct-SpinQuant_INT4_EO8
Generates text for conversations and writing.
- Source listed
- Oct 23, 2024
- Parameters
- 1B
- 4-bit weights only
- ≈ 0.5 GB
- License
- llama3.2
Meta · Downloadable
Llama-Guard-3-1B
Generates text for conversations and writing.
- Source listed
- Sep 20, 2024
- Parameters
- 1B
- 4-bit weights only
- ≈ 0.5 GB
- License
- llama3.2
Meta · Downloadable
Llama-Guard-3-1B-INT4
Generates text for conversations and writing.
- Source listed
- Sep 20, 2024
- Parameters
- 1B
- 4-bit weights only
- ≈ 0.5 GB
- License
- llama3.2
Qwen · Alibaba · Downloadable
Qwen3.5-0.8B
Understands text and images and responds in text.
- Source listed
- Feb 28, 2026
- Parameters
- 800M
- 4-bit weights only
- ≈ 0.4 GB
- License
- apache-2.0
Qwen · Alibaba · Downloadable
Qwen3.5-0.8B-Base
Understands text and images and responds in text.
- Source listed
- Feb 28, 2026
- Parameters
- 800M
- 4-bit weights only
- ≈ 0.4 GB
- License
- apache-2.0
NVIDIA · Downloadable
Privasis-Cleaner-0.6B
Generates text for conversations and writing.
- Source listed
- Jun 8, 2026
- Parameters
- 600M
- 4-bit weights only
- ≈ 0.3 GB
- License
- other
Qwen · Alibaba · Downloadable
Qwen3-0.6B
Generates text for conversations and writing.
- Source listed
- May 23, 2025
- Parameters
- 600M
- 4-bit weights only
- ≈ 0.3 GB
- License
- apache-2.0
Qwen · Alibaba · Downloadable
Qwen3-0.6B-MLX
Generates text for conversations and writing.
- Source listed
- May 23, 2025
- Parameters
- 600M
- 4-bit weights only
- ≈ 0.3 GB
- License
- apache-2.0
What changes with a 16GB budget?
With 2 GB set aside, 14 GB remains for weights. At 4-bit that allows up to 28 billion parameters in the theoretical calculation. An 8-billion-parameter model alone needs approximately 4 GB at this precision, before its conversation cache and runtime.
Why might a listed model still fail to load?
Its actual weight format may need more space, the runtime may not support its architecture, or the conversation cache may exceed your reserve. Vision models can also need space for image processing. Check the original model card and measure your exact setup before relying on it.
Read the memory guide and technical sources · Compare two models