Model benchmarks

google/gemma-4-e2b local LLM performance

As of November 2026, google/gemma-4-e2b runs at up to 106.2 tok/s for local inference (best of 25 community benchmark runs across 5 GPUs).

BionicLM Studio4bit6bit8bitQ4_K_M
ShareRedditX

Model size

2B

Peak speed

106.2 tok/s

Average speed

64.2 tok/s

Avg PP

1586.2 tok/s

Min memory

4.6 GB

Max context

65,536 tokens

Avg output / run

8,167 tokens

Avg runtime / run

4m 42s

Avg quality

62.9

Benchmark runs

25

GPUs tested

5

Quality by task

Average LLM-judged quality (0–100) with the run-to-run spread shown as a P5–P95 band, overall and for each benchmark task, across all 25 runs. The low and high columns show how much the judge’s score varies between runs, and need at least two runs to display.

TaskP5 (low)AvgP95 (high)
Overall57.562.968.2
Agent Workflow57.369.885.0
Code Generation22.346.159.8
Role Play & Narrative68.977.485.0
Research & Analysis38.258.168.0

Performance by hardware and tool

Every hardware/tool/quantization combination google/gemma-4-e2b has been benchmarked on, ranked by peak token generation speed. Last updated November 2026.

HardwareToolQuantBest tok/sAvg tok/sMemoryContextQualityRuns
NVIDIA GeForce RTX 3060 Laptop GPUBionic—106.2 tok/s105.4 tok/s6.3 GB32,768 tokens62.44
Apple M1 MaxLM Studio4bit78.9 tok/s78.6 tok/s5.3 GB65,536 tokens60.48
Apple M1 MaxLM Studio6bit76.4 tok/s76.4 tok/s6.6 GB8,192 tokens68.21
Apple M1 MaxLM Studio8bit74.4 tok/s65.6 tok/s7.2 GB65,536 tokens66.32
Apple M1 MaxLM StudioQ4_K_M71.3 tok/s71.3 tok/s4.6 GB32,768 tokens61.81
NVIDIA RTX PRO 500 Blackwell Generation Laptop GPULM Studio—57.1 tok/s46.7 tok/sn/a8,192 tokens63.23
AMD Radeon RX 6600LM Studio—41.9 tok/s41.2 tok/sn/a8,192 tokens65.52
AMD Radeon Vega Series / Radeon Vega Mobile SeriesBionic—20.2 tok/s20.2 tok/s7.5 GB16,384 tokens60.82
CPU onlyLM StudioQ4_K_M8.4 tok/s6.9 tok/s5.9 GB8,192 tokens67.22

Benchmark runs

All 25 google/gemma-4-e2b runs submitted so far — expand one for its hardware, quality breakdown and per-scenario detail.

Frequently asked questions

Is google/gemma-4-e2b good for coding?
In our benchmarks, google/gemma-4-e2b scores 46.1/100 for coding. It runs at about 64.2 tok/s, so if you want more speed, ornith-ai/Ornith-1.5-35B-A3B-GGUF is faster (~80.3 tok/s) and still scores well for coding (82.1/100).
Is google/gemma-4-e2b good for agentic (tool-using) tasks?
In our benchmarks, google/gemma-4-e2b scores 69.8/100 for agentic workflows. It runs at about 64.2 tok/s, so if you want more speed, swift-iq2_xs is faster (~91.5 tok/s) and still scores well for agentic workflows (91.4/100).
How fast is google/gemma-4-e2b for local inference?
Across 25 community benchmark runs, google/gemma-4-e2b reaches up to 106.2 tok/s and averages 64.2 tok/s, with the fastest results on NVIDIA GeForce RTX 3060 Laptop GPU.
How much memory does google/gemma-4-e2b need?
The leanest observed configuration used about 4.6 GB of memory (quantizations tested: 4bit, 6bit, 8bit, Q4_K_M).
Which tools have been used to run google/gemma-4-e2b?
Benchmarks were submitted using Bionic, LM Studio. Results are community-contributed and updated as new runs arrive.