Ollama LLM SBC Benchmark Rankings

Compare local large language model speed and efficiency across Single Board Computers

66 boards tested · speeds from 0.2 to 23.7 (Tokens/s, DeepSeek R1 1.5B)

66 results

Manufacturer

Architecture

SoC Model

Top Picks

Fastest OverallRadxa Fogwise Airbox Q900 36GBIQ-907523.7Tokens/s#1 of 66 · $849 Best ValueRadxa ROCK 2F 2GBRK3528A0.19per $ (2.8 at $15)#47 of 66 Fastest Under $100Radxa X4 8GBN10013.8Tokens/s#6 of 66 · $100

Model

Full Results

Ranked by

00.20.40.60.811.21.4

median 0.72

1
Fastest Overall: Radxa Fogwise Airbox Q900 36GBIQ-9075 · $849
1.37 tok/s/W
1.37 tok/s/WIQ-9075 · $849
2
Orange Pi Zero 3W 4GBA733 · $50
1.31 tok/s/W
1.31 tok/s/WA733 · $50
3
Raspberry Pi 5 16GBBCM2712 · $329
1.31 tok/s/W
1.31 tok/s/WBCM2712 · $329
4
Radxa ROCK 4D 8GBRK3576 · $106
1.3 tok/s/W
1.3 tok/s/WRK3576 · $106
5
Raspberry Pi 5 8GBBCM2712 · $189
1.24 tok/s/W
1.24 tok/s/WBCM2712 · $189
6
Dshan Pi A1 4GBRK3576 · $69
1.19 tok/s/W
1.19 tok/s/WRK3576 · $69
7
Radxa Dragon Q6A 6GBQCS6490 · $119
1.18 tok/s/W
1.18 tok/s/WQCS6490 · $119
8
Raspberry Pi 500 8GBBCM2712 · $194
1.13 tok/s/W
1.13 tok/s/WBCM2712 · $194
9
Radxa CM5 Lite 8GBRK3582 · $119
1.09 tok/s/W
1.09 tok/s/WRK3582 · $119
10
Raspberry Pi 5 4GBBCM2712 · $118
1.09 tok/s/W
1.09 tok/s/WBCM2712 · $118
11
Raspberry Pi 5 2GBBCM2712 · $82
1.07 tok/s/W
1.07 tok/s/WBCM2712 · $82
12
Libre Computer Alta 4GBA311D · $125
1.05 tok/s/W
1.05 tok/s/WA311D · $125
13
Raspberry Pi Compute Module 5 4GBBCM2712 · $100
1.04 tok/s/W
1.04 tok/s/WBCM2712 · $100
14
ArmSoM Sige5 8GBRK3576 · $239
1.01 tok/s/W
1.01 tok/s/WRK3576 · $239
15
Forlinx FET3576-C 2GBRK3576 · $210
0.96 tok/s/W
0.96 tok/s/WRK3576 · $210
16
Best Value: Radxa ROCK 2F 2GBRK3528A · $15
0.93 tok/s/W
0.93 tok/s/WRK3528A · $15
17
Radxa Dragon Q8B 32GBSnapdragon 8cx Gen 3 · $677
0.91 tok/s/W
0.91 tok/s/WSnapdragon 8cx Gen 3 · $677
18
Banana Pi M4 Zero 4GBH618 · $118
0.9 tok/s/W
0.9 tok/s/WH618 · $118
19
Orange Pi Zero 3 4GBH618 · $40
0.9 tok/s/W
0.9 tok/s/WH618 · $40
20
Orange Pi 5B 4GBRK3588S · $75
0.88 tok/s/W
0.88 tok/s/WRK3588S · $75
21
Orange Pi Zero 4 4GBA733 · $68
0.88 tok/s/W
0.88 tok/s/WA733 · $68
22
Raspberry Pi 500+ 16GBBCM2712 · $443
0.88 tok/s/W
0.88 tok/s/WBCM2712 · $443
23
Orange Pi 5 Plus 8GBRK3588 · $135
0.87 tok/s/W
0.87 tok/s/WRK3588 · $135
24
Radxa ROCK 2A 4GBRK3528A · $30
0.85 tok/s/W
0.85 tok/s/WRK3528A · $30
25
Banana Pi M5 4GBS905X3 · $146
0.84 tok/s/W
0.84 tok/s/WS905X3 · $146
26
Radxa NX5 8GBRK3588S · $119
0.82 tok/s/W
0.82 tok/s/WRK3588S · $119
27
Orange Pi 5 Pro 16GBRK3588S · $120
0.78 tok/s/W
0.78 tok/s/WRK3588S · $120
28
ArmSoM AIM7 8GBRK3588 · $297
0.77 tok/s/W
0.77 tok/s/WRK3588 · $297
29
Banana Pi R4 8GBMT7988A · $146
0.73 tok/s/W
0.73 tok/s/WMT7988A · $146
30
Libre Computer Solitude 4GBS905D3 · $100
0.73 tok/s/W
0.73 tok/s/WS905D3 · $100
31
Orange Pi 4A 4GBT527 · $50
0.73 tok/s/W
0.73 tok/s/WT527 · $50
32
Orange Pi Zero 2W 4GBH618 · $40
0.72 tok/s/W
0.72 tok/s/WH618 · $40
33
Raspberry Pi Compute Module 4 (CM4) 2GBBCM2711 · $62
0.72 tok/s/W
0.72 tok/s/WBCM2711 · $62
34
DEBIX Model A 4GBiMX 8M Plus · $135
0.71 tok/s/W
0.71 tok/s/WiMX 8M Plus · $135
35
Radxa Zero 3W 8GBRK3566 · $92
0.71 tok/s/W
0.71 tok/s/WRK3566 · $92
36
Cool Pi 4B 4GBRK3588S · $140
0.7 tok/s/W
0.7 tok/s/WRK3588S · $140
37
Radxa ROCK 5T 12GBRK3588 · $125
0.69 tok/s/W
0.69 tok/s/WRK3588 · $125
38
Fastest Under $100: Radxa X4 8GBN100 · $100
0.69 tok/s/W
0.69 tok/s/WN100 · $100
39
ArmSoM W3 8GBRK3588 · $316
0.68 tok/s/W
0.68 tok/s/WRK3588 · $316
40
Radxa Orion O6N 32GBP1 · $549
0.68 tok/s/W
0.68 tok/s/WP1 · $549
41
Libre Computer Le Potato 2GBS905X · $60
0.67 tok/s/W
0.67 tok/s/WS905X · $60
42
Raspberry Pi 4 2GBBCM2711 · $72
0.65 tok/s/W
0.65 tok/s/WBCM2711 · $72
43
LattePanda Mu 8GBN100 · $398
0.62 tok/s/W
0.62 tok/s/WN100 · $398
44
Radxa ROCK 5 ITX 8GBRK3588 · $120
0.62 tok/s/W
0.62 tok/s/WRK3588 · $120
45
Orange Pi CM4 2GBRK3566 · $40
0.58 tok/s/W
0.58 tok/s/WRK3566 · $40
46
Libre Computer Renegade 2GBRK3328 · $45
0.56 tok/s/W
0.56 tok/s/WRK3328 · $45
47
Orange Pi 6 Plus 32GBP1 · $669
0.56 tok/s/W
0.56 tok/s/WP1 · $669
48
Raspberry Pi 400 4GBBCM2711 · $65
0.56 tok/s/W
0.56 tok/s/WBCM2711 · $65
49
DEBIX Model C 2GBiMX 93 · $65
0.54 tok/s/W
0.54 tok/s/WiMX 93 · $65
50
Orange Pi 3B 4GBRK3566 · $94
0.53 tok/s/W
0.53 tok/s/WRK3566 · $94
51
Radxa 4 SE 4GBRK3399-T · $80
0.53 tok/s/W
0.53 tok/s/WRK3399-T · $80
52
Radxa ROCK 4C+ 4GBRK3399-T · $80
0.5 tok/s/W
0.5 tok/s/WRK3399-T · $80
53
Radxa ROCK 3C 2GBRK3566 · $40
0.44 tok/s/W
0.44 tok/s/WRK3566 · $40
54
Radxa ROCK 4B+ 4GBRK3399 OP1 · $170
0.35 tok/s/W
0.35 tok/s/WRK3399 OP1 · $170
55
ADLINK I-Pi SMARC 1200 4GBMT8395 · $394
0.33 tok/s/W
0.33 tok/s/WMT8395 · $394
56
Banana Pi CM4 4GBA311D · $104
0.18 tok/s/W
0.18 tok/s/WA311D · $104
57
Radxa Cubie A7A 6GBA733 · $80
0.09 tok/s/W
0.09 tok/s/WA733 · $80
58
Radxa ROCK 5B+ 16GBRK3588 · $135
0.09 tok/s/W
0.09 tok/s/WRK3588 · $135
59
Libre Computer Renegade Elite 4GBRK3399 · $100
0.04 tok/s/W
0.04 tok/s/WRK3399 · $100
60
Banana Pi M2S (S922X) 4GBS922X · $67
0.03 tok/s/W
0.03 tok/s/WS922X · $67
61
ArmSoM Sige7 8GBRK3588 · $312
0.02 tok/s/W
0.02 tok/s/WRK3588 · $312
62
Radxa ROCK 5A 4GBRK3588S · $130
0.02 tok/s/W
0.02 tok/s/WRK3588S · $130
63
Radxa ROCK 5B 8GBRK3588 · $160
0.02 tok/s/W
0.02 tok/s/WRK3588 · $160
64
Radxa ROCK 5C 4GBRK3588S2 · $166
0.02 tok/s/W
0.02 tok/s/WRK3588S2 · $166

00.20.40.60.811.21.4

Efficiency (tokens/s per watt), higher is better

Showing 64 boards · median 0.72 tok/s/W (2 without a Per Watt result not shown)Top Picks from above

Frequently Asked Questions

What is the fastest single board computer in Ollama LLM (DeepSeek R1 1.5B)?

The Radxa Fogwise Airbox Q900 36GB currently tops our Ollama LLM (DeepSeek R1 1.5B) ranking with 23.7 (Tokens/s), measured on real hardware with our standardised test setup.

What is a good Ollama LLM (DeepSeek R1 1.5B) score for an SBC?

Across the 66 boards we have tested, Ollama LLM (DeepSeek R1 1.5B) results range from 0.2 to 23.7 (Tokens/s), with a median of 5.61. Anything above the median puts a board in the faster half of the market.

More benchmarks:Geekbench 6 Geekbench 7 Linpack 7-Zip TinyMemBench glmark2 (OpenGL)Fastest SBC Storage vkmark (Vulkan)vkpeak (Vulkan Compute)SuperTuxKart UnixBench PassMark cpuminer MAME Power Consumption Test methodology

About Ollama LLM SBC Benchmark Rankings testing

This ranking shows how fast each board runs a large language model locally with Ollama. We use the DeepSeek R1 distilled models and run each one three times through the ollama-benchmark script, reporting the average generation speed (eval rate) in tokens per second: how quickly the answer appears, not counting prompt processing. Ollama runs on the CPU on these boards, so RAM size decides which models we can run: every board with around 2GB or more gets the 1.5B model, 8GB boards add the 8B model, and 16GB boards add 14B. Each model has its own ranking; switch between them above. Tokens per watt divides that speed by the board's peak power draw during the run, measured with a USB power meter, and tokens per dollar divides it by the board's current price. Higher is better for all three.