Posts tagged “hardware”

8 posts on SDAD Writes.

Qwen3.8-27B Benchmark on NVIDIA DGX Spark GB10

Real Qwen3.8-27B numbers on the DGX Spark GB10: the memory wall caps single-stream decode at 11-12 tok/s, and speculative decoding is the only way out. SGLang with DSpark hits 34 tok/s, veloGB10 reaches about 40 tok/s, and NVFP4 keeps quality within noise of FP8.

Local AI Agent Hardware Builds - Budget Tiers VRAM Guide

VRAM is everything for local AI agents: the 4-bit cheat sheet runs 7B at about 5GB, 14B at 10GB, 30B at 20GB, and 70B at 40GB. Three builds cover it, from a $1,200-1,500 RTX 4060 Ti 16GB starter to the used 24GB-card sweet spot that runs 32B models at near-cloud quality for daily work.

NVIDIA DGX Station - Trillion Parameter Desktop AI Deep Dive

The memory wall ends here: NVIDIA's DGX Station pairs 252GB of HBM3e at 7.1TB/s with 496GB of LPDDR5X into one 748GB coherent pool on GB300 Grace Blackwell Ultra, adds NVFP4 quantization and 800Gbps ConnectX-8 networking (two boxes pool about 1.5TB), at roughly $94,930.

Posts tagged "hardware" · SDAD Writes