Posts tagged “hardware”

10 posts on SDAD Writes.

The AI Bottleneck Is Not Chips. It Is a Steel and Copper Box With a Three-Year Lead Time.

Generator step-up transformer lead times passed 160 weeks by Q1 2026, up from about 52 weeks in 2020. Johns Hopkins projects unmet demand of 14.1 GVA for data centre transformers and 22.1 GVA for UPS by 2027, and Kimmeridge says as many as half of planned US data centre projects are at risk of delay or cancellation. FERC is fast-tracking grid connections. A faster queue does not conjure a transformer.

Qwen3.8-27B Benchmark on NVIDIA DGX Spark GB10

Real Qwen3.8-27B numbers on the DGX Spark GB10: the memory wall caps single-stream decode at 11-12 tok/s, and speculative decoding is the only way out. SGLang with DSpark hits 34 tok/s, veloGB10 reaches about 40 tok/s, and NVFP4 keeps quality within noise of FP8.

Local AI Agent Hardware Builds - Budget Tiers VRAM Guide

VRAM is everything for local AI agents: the 4-bit cheat sheet runs 7B at about 5GB, 14B at 10GB, 30B at 20GB, and 70B at 40GB. Three builds cover it, from a $1,200-1,500 RTX 4060 Ti 16GB starter to the used 24GB-card sweet spot that runs 32B models at near-cloud quality for daily work.

NVIDIA DGX Station - Trillion Parameter Desktop AI Deep Dive

The memory wall ends here: NVIDIA's DGX Station pairs 252GB of HBM3e at 7.1TB/s with 496GB of LPDDR5X into one 748GB coherent pool on GB300 Grace Blackwell Ultra, adds NVFP4 quantization and 800Gbps ConnectX-8 networking (two boxes pool about 1.5TB), at roughly $94,930.

Posts tagged "hardware" · SDAD Writes