Hardware platform
NVIDIA Jetson, module by module
Manufacturer specifications for every platform we build on. Peak TOPS is theoretical; open a platform to see measured LLM throughput where we have it.
7 of 7 platforms
CPU | GPU | Power | Stock | ||||
|---|---|---|---|---|---|---|---|
| Jetson Orin Nano 4GB | 6-core Arm Cortex-A78AE, 1.5 MB L2 + 4 MB L3 | 512 CUDA · 16 Tensor · NVIDIA Ampere architecture | 34 TOPS INT8, sparse (Super mode) | 4 | 51 | 7–25 W | In stock |
| Jetson Orin Nano 8GB | 6-core Arm Cortex-A78AE, 1.5 MB L2 + 4 MB L3 | 1024 CUDA · 32 Tensor · NVIDIA Ampere architecture | 67 TOPS INT8, sparse (Super mode) | 8 | 102 | 7–25 W | In stock |
| Jetson Orin NX 8GB | 6-core Arm Cortex-A78AE, 1.5 MB L2 + 4 MB L3 | 1024 CUDA · 32 Tensor · NVIDIA Ampere architecture | 117 TOPS INT8, sparse (Super mode) | 8 | 102 | 10–40 W | In stock |
| Jetson Orin NX 16GB | 8-core Arm Cortex-A78AE, 2 MB L2 + 4 MB L3 | 1024 CUDA · 32 Tensor · NVIDIA Ampere architecture | 157 TOPS INT8, sparse (Super mode) | 16 | 102 | 10–40 W | In stock |
| Jetson AGX Orin 32GB | 8-core Arm Cortex-A78AE, 2 MB L2 + 4 MB L3 | 1792 CUDA · 56 Tensor · NVIDIA Ampere architecture | 200 TOPS INT8, sparse | 32 | 204.8 | 15–40 W | In stock |
7 items