Jetson Orin Nano 4GB
512-core NVIDIA Ampere architecture GPU · 6-core Arm Cortex-A78AE, 1.5 MB L2 + 4 MB L3 · 4 GB 64-bit LPDDR5
Manufacturer specifications
- Processor architecture
- NVIDIA Orin SoC, Arm v8.2 64-bit
- CPU
- 6-core Arm Cortex-A78AE, 1.5 MB L2 + 4 MB L3
- GPU
- 512-core NVIDIA Ampere architecture with 16 Tensor Cores
- AI performance
- 34 TOPS (INT8, sparse (Super mode))
- Memory
- 4 GB 64-bit LPDDR5
- Memory bandwidth
- 51 GB/s
- Storage
- None on module; boots from NVMe · 2 M.2 NVMe slot(s) on our carrier
- Networking
- 1× Gigabit Ethernet
- Power
- 7 W – 25 W (configurable power modes)
- Dimensions
- 69.6 × 45 mm module (260-pin SO-DIMM)
- Cooling
- Active or large passive heatsink; fan recommended above 15 W
- Expansion
- PCIe Gen3 1×4 + 3×1, 3× USB 3.2 Gen2, 4-lane CSI camera
- Supported frameworks
- JetPack 6
- CUDA 12
- cuDNN
- TensorRT
- TensorRT-LLM (selected models)
- PyTorch
- ONNX Runtime
- DeepStream
- Isaac ROS
- Ollama
- llama.cpp
- MLC
- Docker
Source: NVIDIA product pages. Figures are manufacturer specifications, not our measurements.
Theoretical vs real-world
34 TOPS is a peak figure at INT8, sparse (Super mode) with structured sparsity. Chat-style LLM generation is limited by the 51 GB/s memory bus and by how much model fits in 4 GB. Rough rule: tokens/s ≈ bandwidth ÷ model bytes.
Estimates assume ~0.6 bytes/parameter at INT4 and ~70% achieved bandwidth. Real results vary by runtime.
Measured LLM inference
We only publish figures we or NVIDIA have measured. None are published yet for this module; use the estimates above for planning.