Running Gemma models on a NAS
Updated
Which NAS can run Gemma?
Gemma 3 4B runs on almost any AI NAS, the 12B needs about 18GB of memory and the 27B about 29GB at 4-bit (Estimated). The 4B, 12B and 27B models also understand images, which suits photo and document tasks on a NAS.
How much memory does each Gemma model need?
File sizes from the Ollama library for each quantization; recommended memory is the Q4 size x 1.2 plus 8GB for the NAS (Estimated). Quantizations Ollama does not publish are marked.
| Model | Params | Context | Q2 | Q3 | Q4 | Q5 | Q8 | Recommended NAS memory |
|---|---|---|---|---|---|---|---|---|
| Gemma 3 1BSource: Ollama library | 1B | 32K | Not published | Not published | 0.81GB | Not published | 1.1GB | 9GB |
| Gemma 3 4BSource: Ollama library | 3.88B | 128K | Not published | Not published | 3.4GB | Not published | 5GB | 13GB |
| Gemma 3 12BSource: Ollama library | 11.8B | 128K | Not published | Not published | 8.2GB | Not published | 13GB | 18GB |
| Gemma 3 27BSource: Ollama library | 27B | 128K | Not published | Not published | 17GB | Not published | 30GB | 29GB |
Which Gemma model should you run on a NAS?
Gemma 3 4B is small enough for 16GB systems and answers quickly. Gemma 3 12B, at about 8.2GB at 4-bit, is a strong all-rounder for 32GB systems. Gemma 3 27B, at about 17GB, is one of the most capable models that fits a 32GB to 64GB NAS (Estimated). The 1B model suits very light tasks.
Can Gemma read images on a NAS?
The 4B, 12B and 27B models accept images as well as text, so you can ask about a photo or a scanned page. That pairs well with a NAS that already holds your photo library and documents, through tools such as Open WebUI.
Does Gemma need a GPU?
No. The 4B and 12B run comfortably on modern AI NAS processors. The 27B works on CPU but answers more slowly; a graphics card with 24GB of memory runs it at full speed.
Common questions
Which quantizations does Ollama publish for Gemma 3?
Q4, Q8 and full precision, plus quantization-aware versions. Q2, Q3 and Q5 are not published, as the table shows.
Is Gemma free to use?
Gemma is released under Google's Gemma terms, which allow broad personal and commercial use. Check them for your case.
Which NAS can run Gemma?
The largest Gemma model each system runs comfortably at 4-bit or better, from its memory (Estimated). 28 systems qualify.
| System | Class | Largest Gemma model | Max RAM | Price | Buy |
|---|---|---|---|---|---|
 | Native AI NAS | Gemma 3 27B (Estimated) | 1024GB | No verified price | |
| NIMO Nexus Pro | Native AI NAS | Gemma 3 27B (Estimated) | 96GB | No verified price | |
 | Native AI NAS | Gemma 3 27B (Estimated) | 96GB | £1,040.41 Amazon UK · Verified | View Deal |
 | AI Ready | Gemma 3 27B (Estimated) | 1024GB | £10,614.20 Amazon UK · Verified | View Deal |
 | Native AI NAS | Gemma 3 27B (Estimated) | 64GB | £1,999.99 Amazon UK · Verified | View Deal |
 | Native AI NAS | Gemma 3 27B (Estimated) | 64GB | $5,999.99 Amazon US · Verified Ships from the US; delivery and import charges shown at checkout | View Deal |
 | AI Ready | Gemma 3 27B (Estimated) | 96GB | $919.00 Amazon US · Verified Ships from the US; delivery and import charges shown at checkout | View Deal |
 | AI Ready | Gemma 3 27B (Estimated) | 64GB | £3,834 Amazon UK · Verified | View Deal |
 | AI Ready | Gemma 3 27B (Estimated) | 64GB | £874.99 Amazon UK · Verified | View Deal |
 | AI Ready | Gemma 3 27B (Estimated) | 64GB | £1,189.99 Amazon UK · Verified | View Deal |
 | AI Capable | Gemma 3 27B (Estimated) | 64GB | £3,161 Amazon UK · Verified | View Deal |
 | AI Ready | Gemma 3 27B (Estimated) | 64GB | £773.99 Amazon UK · Verified | View Deal |
 | AI Capable | Gemma 3 27B (Estimated) | 64GB | No verified price | |
 | AI Capable | Gemma 3 27B (Estimated) | 64GB | £822 Amazon UK · Verified | View Deal |
 | AI Capable | Gemma 3 27B (Estimated) | 64GB | £1,138 Amazon UK · Verified | View Deal |
 | AI Capable | Gemma 3 27B (Estimated) | 64GB | £1,239 Amazon UK · Verified | View Deal |
 | AI Capable | Gemma 3 27B (Estimated) | 64GB | £1,599 Amazon UK · Verified | View Deal |
 | AI Capable | Gemma 3 27B (Estimated) | 32GB | £819.99 Amazon UK · Verified | View Deal |
 | AI Capable | Gemma 3 27B (Estimated) | 32GB | £789.99 Amazon UK · Verified | View Deal |
 | AI Capable | Gemma 3 27B (Estimated) | 32GB | No verified price | |
 | AI Capable | Gemma 3 27B (Estimated) | 32GB | £659.28 Amazon UK · Verified | View Deal |
 | AI Capable | Gemma 3 27B (Estimated) | 32GB | £1,079.99 Amazon UK · Verified | View Deal |
 | AI Capable | Gemma 3 27B (Estimated) | 32GB | £1,446 Amazon UK · Verified | View Deal |
 | AI Capable | Gemma 3 27B (Estimated) | 32GB | £509.11 Amazon UK · Verified | View Deal |
 | Native AI NAS | Gemma 3 4B (Estimated) | 16GB | No verified price | |
 | AI Capable | Gemma 3 4B (Estimated) | 16GB | $389.99 Amazon US · Verified Ships from the US; delivery and import charges shown at checkout | View Deal |
 | AI Capable | Gemma 3 4B (Estimated) | 16GB | £479 Amazon UK · Verified | View Deal |
 | AI Capable | Gemma 3 4B (Estimated) | 16GB | £636 Amazon UK · Verified | View Deal |
Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon.co.uk or Amazon.com, as applicable, at the time of purchase will apply to the purchase of this product.
Find a NAS for Gemma with your budget in the Finder · Check a specific NAS and model