utMeta · Downloadable
Llama-Guard-3-8B
Generates text for conversations and writing.
- Source listed
- Jul 22, 2024
- Parameters
- 8B
- 4-bit weights only
- ≈ 4 GB
- License
- llama3.1
YOUR MEMORY BUDGET
Local AI models for 8GB VRAM.
Explore models by theoretical weight storage. This shortlist covers available downloadable language models with a known or name-derived parameter count.
6 GBleft for weights at 4-bit
8 GB budget − 2 GB reserve
8 GB budget − 2 GB reserve
The reserve is your assumption, not a measured overhead allowance. The default 2 GB may be too little for your runtime or context length. Results are not confirmed fits and have no verified speed rating. Weight estimates use decimal GB and do not include quantization overhead.
291 models within the weight budget
Largest parameter count first · not a quality rankingMeta · Downloadable
Llama-Guard-3-8B-INT8
Generates text for conversations and writing.
- Source listed
- Jul 21, 2024
- Parameters
- 8B
- 4-bit weights only
- ≈ 4 GB
- License
- llama3.1
Meta · Downloadable
Meta-Llama-3-8B
Generates text for conversations and writing.
- Source listed
- Apr 17, 2024
- Parameters
- 8B
- 4-bit weights only
- ≈ 4 GB
- License
- llama3
Meta · Downloadable
Meta-Llama-3-8B-Instruct
Generates text for conversations and writing.
- Source listed
- Apr 17, 2024
- Parameters
- 8B
- 4-bit weights only
- ≈ 4 GB
- License
- llama3
Meta · Downloadable
Meta-Llama-Guard-2-8B
Generates text for conversations and writing.
- Source listed
- Apr 17, 2024
- Parameters
- 8B
- 4-bit weights only
- ≈ 4 GB
- License
- llama3
Microsoft · Downloadable
HARC-Llama-3.1-8B-Instruct
Generates text for conversations and writing.
- Source listed
- Jul 2, 2026
- Parameters
- 8B
- 4-bit weights only
- ≈ 4 GB
- License
- llama3.1
Microsoft · Downloadable
UserLM-8b
Generates text for conversations and writing.
- Source listed
- Sep 30, 2025
- Parameters
- 8B
- 4-bit weights only
- ≈ 4 GB
- License
- mit
NVIDIA · Downloadable
4D-RGPT-8B
Generates text for conversations and writing.
- Source listed
- Jun 2, 2026
- Parameters
- 8B
- 4-bit weights only
- ≈ 4 GB
- License
- cc-by-nc-4.0
NVIDIA · Downloadable
EGM-8B-SFT
Understands text and images and responds in text.
- Source listed
- Apr 2, 2026
- Parameters
- 8B
- 4-bit weights only
- ≈ 4 GB
- License
- apache-2.0
NVIDIA · Downloadable
Nemotron-Labs-Diffusion-8B
Generates text for conversations and writing.
- Source listed
- Mar 18, 2026
- Parameters
- 8B
- 4-bit weights only
- ≈ 4 GB
- License
- other
NVIDIA · Downloadable
Nemotron-Labs-Diffusion-VLM-8B
Understands text and images and responds in text.
- Source listed
- May 8, 2026
- Parameters
- 8B
- 4-bit weights only
- ≈ 4 GB
- License
- other
Qwen · Alibaba · Downloadable
Qwen3-8B
Generates text for conversations and writing.
- Source listed
- May 23, 2025
- Parameters
- 8B
- 4-bit weights only
- ≈ 4 GB
- License
- apache-2.0
Qwen · Alibaba · Downloadable
Qwen3-8B-MLX
Generates text for conversations and writing.
- Source listed
- May 23, 2025
- Parameters
- 8B
- 4-bit weights only
- ≈ 4 GB
- License
- apache-2.0
Qwen · Alibaba · Downloadable
Qwen3-VL-8B-Instruct
Understands text and images and responds in text.
- Source listed
- Oct 11, 2025
- Parameters
- 8B
- 4-bit weights only
- ≈ 4 GB
- License
- apache-2.0
Qwen · Alibaba · Downloadable
Qwen3-VL-8B-Thinking
Understands text and images and responds in text. Supports a reasoning mode.
- Source listed
- Oct 11, 2025
- Parameters
- 8B
- 4-bit weights only
- ≈ 4 GB
- License
- apache-2.0
Qwen · Alibaba · Downloadable
Qwen3Guard-Gen-8B
Generates text for conversations and writing.
- Source listed
- Sep 23, 2025
- Parameters
- 8B
- 4-bit weights only
- ≈ 4 GB
- License
- apache-2.0
Qwen · Alibaba · Downloadable
WebWorld-8B
Generates text for conversations and writing.
- Source listed
- Feb 13, 2026
- Parameters
- 8B
- 4-bit weights only
- ≈ 4 GB
- License
- apache-2.0
Z.ai · Downloadable
LongCite-llama3.1-8b
Generates text for conversations and writing.
- Source listed
- Sep 2, 2024
- Parameters
- 8B
- 4-bit weights only
- ≈ 4 GB
- License
- Not disclosed
Z.ai · Downloadable
LongReward-llama3.1-8b-DPO
Generates text for conversations and writing.
- Source listed
- Oct 22, 2024
- Parameters
- 8B
- 4-bit weights only
- ≈ 4 GB
- License
- Not disclosed
Z.ai · Downloadable
LongWriter-llama3.1-8b
Generates text for conversations and writing.
- Source listed
- Aug 12, 2024
- Parameters
- 8B
- 4-bit weights only
- ≈ 4 GB
- License
- llama3.1
DeepSeek · Downloadable
deepseek-coder-7b-base-v1.5
Designed for coding and software tasks. Generates text for conversations and writing.
- Source listed
- Jan 25, 2024
- Parameters
- 7B
- 4-bit weights only
- ≈ 3.5 GB
- License
- other
DeepSeek · Downloadable
deepseek-coder-7b-instruct-v1.5
Designed for coding and software tasks. Generates text for conversations and writing.
- Source listed
- Jan 25, 2024
- Parameters
- 7B
- 4-bit weights only
- ≈ 3.5 GB
- License
- other
DeepSeek · Downloadable
deepseek-llm-7b-base
Generates text for conversations and writing.
- Source listed
- Nov 29, 2023
- Parameters
- 7B
- 4-bit weights only
- ≈ 3.5 GB
- License
- other
DeepSeek · Downloadable
deepseek-llm-7b-chat
Generates text for conversations and writing.
- Source listed
- Nov 29, 2023
- Parameters
- 7B
- 4-bit weights only
- ≈ 3.5 GB
- License
- other
What changes with a 8GB budget?
With 2 GB set aside, 6 GB remains for weights. At 4-bit that allows up to 12 billion parameters in the theoretical calculation. An 8-billion-parameter model alone needs approximately 4 GB at this precision, before its conversation cache and runtime.
Why might a listed model still fail to load?
Its actual weight format may need more space, the runtime may not support its architecture, or the conversation cache may exceed your reserve. Vision models can also need space for image processing. Check the original model card and measure your exact setup before relying on it.
Read the memory guide and technical sources · Compare two models