embeddinggemma-300m
embeddinggemma-300m is an open-weight embedding model from Google with 303M parameters. At 4-bit it needs about 0.2 GB of memory, so the smallest current device that fits it is the Mac mini M6 (16GB).
Overview
Estimated memory for the weights at 4-bit (plus runtime overhead). Image, video and speech models also need working memory that depends on resolution or clip length.
Key information
- Lab
- Released
- 17 Jul 2025
- Parameters
- 303M
- Type
- Embedding
- License
- Gemma terms
- HF downloads, 30 days
- 1,085,038
- Repository
- google/embeddinggemma-300m
More from Google
View allWill it run on your hardware?
How we estimate| Estimate or device | Memory |
|---|---|
| Q4 | 0.2 GB |
| Q8 | 0.4 GB |
| BF16 | 0.7 GB |
| RTX 5060 Ti 16 GB | 16 GB usable |
| RTX 5090 32 GB | 32 GB usable |
| DGX Spark 128 GB | 108.8 GB usable |
| Mac Studio M5 Ultra 256 GB | 192 GB usable |
Single-device memory estimate. Pick a device to update the On your device column.
36 GB usable memory
| Format | Memory needed | On your device | Example hardware |
|---|---|---|---|
| 4-bit (Q4) | ≈ 0.2 GB | Fits 1% | Mac mini M6 (16GB)16 GB memory |
| 8-bit (Q8) | ≈ 0.4 GB | Fits 1% | Mac mini M6 (16GB)16 GB memory |
| 16-bit (BF16) | ≈ 0.7 GB | Fits 2% | Mac mini M6 (16GB)16 GB memory |
Fits means the estimate stays within 90% of usable memory. Tight is above 90% and up to 100%. Too big is above 100%. These are memory checks, not speed or compatibility tests.
Mac allowances are 66% of total RAM up to 36 GB, and 75% above. AI boxes allow 85% because their memory is shared with the operating system.
Where to run it
On a Mac
Start with the MLX files, built for Apple Silicon.
mlx-community/embeddinggemma-300m-4bitCheck your MacWith GGUF
GGUF build for compatible runtimes (for example ComfyUI GGUF nodes).
ggml-org/embeddinggemma-300M-GGUFFind compatible hardwareThrough an API
No hosted API found.
More about this model
Frequently asked questions
How much memory does embeddinggemma-300m need? About 0.2 GB at 4-bit, 0.4 GB at 8-bit and 0.7 GB at 16-bit (BF16), for the weights plus runtime overhead.
Can I run embeddinggemma-300m on a Mac? The smallest current Mac that fits the 4-bit estimate of 0.2 GB is the Mac mini M6 (16GB). An MLX build is available: mlx-community/embeddinggemma-300m-4bit.
What does it need to run? The weights need about 0.2 GB at 4-bit and 0.7 GB at 16-bit. Image, video and speech models also need working memory that depends on resolution or clip length, so leave extra room. MLX build: mlx-community/embeddinggemma-300m-4bit. GGUF build: ggml-org/embeddinggemma-300M-GGUF.
What does it cost through an API? We did not find a hosted API for this model.
License in plain English
Gemma terms. These are Google's Gemma terms of use. They allow use and distribution with conditions, including a prohibited use policy. This summary is not legal advice.
OMHQ RigBench
Not yet tested. We show no speed or quality score without a measurement.
Revision history and sources
Last updated . Sources:Hugging Face model card, MLX repository, GGUF repository.