1. The Footprint of Local LLMs
With Unified Memory architectures on Apple Silicon (M1/M2/M3/M4 Pro & Max), running AI models locally is fast and private. However, a single 7B model requires ~4.5 GB, 14B requires ~9 GB, and 70B models exceed 40 GB. Testing 4–5 models can easily consume half of a 256 GB or 512 GB MacBook SSD.
2. Default Storage Paths on macOS
- Ollama Blobs:
~/.ollama/models/blobs/(Content-addressed SHA-256 binary blobs) - Ollama Manifests:
~/.ollama/models/manifests/ - LM Studio Cache:
~/.cache/lm-studio/models/ - HuggingFace Hub:
~/.cache/huggingface/hub/