Rubin → Blackwell → Hopper → Ada Lovelace. Isaac → Omniverse → TensorRT → CUDA. From Jetson edge to H100 cloud — the sovereign NVIDIA stack for defence AI.
DEFONEOS integrates across the entire NVIDIA hardware and software stack — from $500 edge devices to H100 cloud clusters. The architecture is hardware-agnostic (DEFONEOS runs on CPU, Apple Silicon, AMD, and NVIDIA), but NVIDIA provides the highest performance acceleration for defence AI workloads.
| Component | Generation | Role in DEFONEOS | Deployment Tier |
|---|---|---|---|
| NVIDIA Rubin | 2026 (upcoming) | Next-gen GPU for SOV3 OLM training. Expected 50x H100 throughput for transformer training. Planned Q4 2026. | Cloud |
| Blackwell B200 | 2025 | 2M token context window — entire SIGIL chains (49K+ receipts) processed in one pass. 15 TFLOPS FP4. Inference for 188+ SOV3 tools. | Cloud |
| H100 / H200 | 2022/2024 | Current training backbone for OLM brain. H200 has 141GB HBM3e — runs 70B parameter models in production. Fine-tuning with LoRA/QLoRA. | Cloud |
| L4 / L40S | 2023 | Cost-effective inference. GCP L4 is DEFONEOS's current production GPU. L40S for on-prem enterprise deployment. | Cloud / On-Prem |
| Jetson Orin Nano | 2023 | 40 TOPS edge inference. Runs quantized models (llama3.2:3b Q4 = 2GB) for real-time ISR. $500. 15W. Battery-capable. | Edge |
| Jetson AGX Orin | 2023 | 275 TOPS at the tactical edge. Full SOV3 instance on a 60W device. Forward operating base compute. Drone payload. | Fog / Edge |
| Drive Thor | 2025 | Autonomous vehicle platform — 2000 TOPS. DEFONEOS autonomous ground vehicle (UGV) control. Planned 2027. | Edge (mobile) |
| Isaac Sim | Software | Robotics simulation. DEFONEOS uses Isaac Sim for drone swarm training, UGV navigation, manipulation. Transfers directly to real hardware via Isaac ROS. | Development |
| Omniverse | Software | Photorealistic digital twin. DEFONEOS exports Cesium scenes to Omniverse for high-fidelity simulation. Real-time bidirectional sync via Omniverse Connector. | Enterprise |
| TensorRT | Software | Inference optimisation. DEFONEOS quantises models to INT8/FP8 for 5–10x speedup on NVIDIA hardware. TensorRT-LLM for LLM serving. | All tiers |
| CUDA 12.x | Software | Core compute for all neural models. cuDNN for deep learning, cuBLAS for linear algebra, NCCL for multi-GPU. | All tiers |
| NVIDIA NIM | Software | Containerised model deployment. Each MCP server packaged as a NIM container for one-command deployment. | Cloud / On-Prem |
| cuRNN / Mamba-SSD | Software | State-space model (SSM) acceleration for Mamba-2. DEFONEOS's organic learning model uses Mamba-2 for long-context compression. | Cloud |
| Triton Inference Server | Software | Multi-model serving. DEFONEOS serves 188+ tools via Triton — dynamic batching, model versioning, multi-GPU scheduling. | Cloud / On-Prem |
| DeepStream | Software | Video analytics pipeline. DEFONEOS processes RTSP camera feeds, drone video, and satellite imagery through DeepStream for real-time object detection (YOLOv8). | Edge / Fog |
The forward edge: drone-mounted, vehicle-mounted, or man-portable. Runs quantized models for real-time intelligence:
| Model | Size (Q4) | Speed | Use Case |
|---|---|---|---|
| Llama 3.2 3B (Q4) | 2.0 GB | 40 tok/s | Multilingual comms, tactical Q&A |
| Qwen 2.5 3B (Q4) | 1.9 GB | 38 tok/s | Reasoning, code generation |
| BGE-M3 embeddings | 0.6 GB | Instant | Semantic search over intel documents |
| YOLOv8-nano | 6 MB | 120 FPS | Real-time object detection (vehicles, persons, vessels) |
| Whisper-tiny | 75 MB | Real-time | Speech-to-text for intercepted comms |
Power: 15W (USB-C battery). Weight: 150g. Operating temp: -25°C to +80°C. Air-gapped mode: Wi-Fi off, data stays on device, SIGIL receipts queued for sync.
The forward operating base compute layer. Runs a full SOV3 instance:
Power: 60W (vehicle power or generator). Weight: 900g. Storage: 2TB NVMe. Network: 10GbE + Wi-Fi 6 + 5G modem.
The strategic compute layer. Heavy training, large-scale inference, federation coordination:
| Workload | Hardware | Performance |
|---|---|---|
| SOV3 OLM training | 8× H100 SXM5 | Full retrain in 4 hours (vs 36h on L4) |
| 70B model inference | H200 (141GB) | Production LLM at 60 tok/s |
| SIGIL chain analysis | B200 (2M tokens) | Entire 49K-receipt chain in one context |
| Drone swarm simulation | Isaac Sim + H100 | 10,000 drone swarm in real-time |
| Omniverse digital twin | RTX 6000 Ada + H100 | Photorealistic Yorkshire terrain, 4K @ 60fps |
DEFONEOS uses TensorRT to optimise all inference workloads on NVIDIA hardware. Benchmark results (L4 GPU):
| Model | Raw (PyTorch) | TensorRT INT8 | Speedup |
|---|---|---|---|
| Llama 3.2 3B | 45 tok/s | 180 tok/s | 4.0× |
| YOLOv8-large | 45 FPS | 340 FPS | 7.6× |
| BGE-M3 embeddings | 2,000 docs/s | 12,000 docs/s | 6.0× |
| Whisper-large-v3 | 3x real-time | 25x real-time | 8.3× |
| Falcon3 7B | 30 tok/s | 120 tok/s | 4.0× |
# DEFONEOS swarm training pipeline using NVIDIA Isaac Sim 1. DEFINE MISSION → DEFONEOS BFT council approves mission parameters → SIGIL emitted: "M|defoneos|swarm|Reconnaissance mission sector-7 approved" 2. SIMULATE IN ISAAC SIM → 10,000 drone agents in photorealistic Yorkshire terrain → NVIDIA PhysX physics simulation → Wind, weather, EM interference modelled → 1000 mission runs in 4 hours (H100 cluster) 3. TRAIN POLICY → PPO / SAC reinforcement learning → Curriculum: easy → hard scenarios → Transfer to real hardware via Isaac ROS 4. DEPLOY TO EDGE → Trained policy → Jetson Orin Nano (40 TOPS) → TensorRT INT8 quantization → On-device inference at 120 FPS 5. OPERATIONAL FEEDBACK → Real-world telemetry → SOV3 OLM → Online learning adjusts policy → Updated weights deployed via NIM containers → Full SIGIL chain for audit
DEFONEOS exports its Cesium 3D globe scenes to NVIDIA Omniverse for photorealistic digital twin rendering. This enables:
For classified environments (SECRET+), DEFONEOS can deploy a fully air-gapped NVIDIA cluster:
| Air-Gapped Config | Hardware | Cost | Capability |
|---|---|---|---|
| Mobile edge kit | 1× Jetson AGX Orin + battery + rugged case | £3,500 | Full SOV3, 8B models, 8 cameras |
| FOB compute | 2× Jetson AGX Orin + network switch | £8,000 | Dual-redundant, 550 TOPS |
| Classified rack | DGX H100 (4 GPU) + UPS + air gap diode | £250,000 | 70B model training + inference, SECRET+ |
| Strategic cloud | 8× H100 SXM5 (sovereign data centre) | £30K/month | Full OLM training, large-scale ops |
DEFONEOS is hardware-agnostic. Here's how Apple Silicon compares to NVIDIA for key workloads:
| Workload | M4 Mac (40 GPU cores) | NVIDIA L4 (24GB) | NVIDIA H100 (80GB) |
|---|---|---|---|
| 3B model inference | 45 tok/s (MLX) | 45 tok/s (CUDA) | 80 tok/s |
| 70B model inference | ⚠️ Needs 48GB+ Mac | ❌ OOM (24GB) | ✅ 60 tok/s |
| YOLOv8 detection | 30 FPS (Metal) | 120 FPS (CUDA) | 500 FPS |
| OLM training | 36 hours (M4 Max) | 24 hours | 4 hours |
| Power draw | 40W | 72W | 700W |
| Edge portability | ✅ Laptop class | ⚠️ Needs host PC | ❌ Data centre |
| Air-gapped operation | ✅ Battery 10–12h | ⚠️ Needs UPS | ❌ No |
| Ecosystem | MLX (growing) | CUDA (mature) | CUDA (mature) |
Conclusion: Apple Silicon excels at edge deployment (battery, portability, MLX). NVIDIA excels at training and high-throughput inference. DEFONEOS uses both — M4 Mac for tactical edge, NVIDIA for cloud training.
Each DEFONEOS MCP server is packaged as an NVIDIA NIM container for one-command deployment:
# Deploy the maritime ISR MCP as a NIM container
docker run --gpus all -p 8101:8101 \
-e NVIDIA_VISIBLE_DEVICES=all \
nvcr.io/csoai/defoneos/maritime-isr-mcp:latest
# Deploy the full 30-MCP fleet via Docker Compose
docker-compose -f defoneos-nim-fleet.yaml up -d
# Verify deployment
curl http://localhost:3101/mcp -d '{"jsonrpc":"2.0","method":"tools/list","id":1}'
# → 188 tools across 30 servers, all TensorRT-optimised
| Quarter | Milestone | Status |
|---|---|---|
| Q3 2026 (now) | Jetson Orin Nano edge deployment. L4 cloud inference. TensorRT optimisation live. | LIVE |
| Q4 2026 | H100 training cluster for OLM. Isaac Sim swarm training pipeline. DeepStream camera analytics. | Planned |
| Q1 2027 | Omniverse digital twin integration. NIM container fleet packaging. DGX air-gapped deployment. | Planned |
| Q2 2027 | Blackwell B200 deployment for 2M-token SIGIL analysis. Drive Thor UGV integration. | Roadmap |
| Q3 2027 | Rubin cluster for next-gen OLM training. Full NVIDIA stack operational across edge/fog/cloud. | Vision |