HyperTensorCloud Infrastructure
Engineering & Research Blog

Deep Dives from the HyperTensor Team

Systems engineering notes on distributed GPU scheduling, InfiniBand fabrics, kernel optimization, and AI infrastructure economics.

Architecture6 min read

Scaling LLM Training to 10,000 GPUs on NVIDIA Blackwell B200

An in-depth technical analysis of interconnect bottlenecks, FP4 precision optimizations, and distributed tensor parallelism.

AM
Alex Mercer
October 14, 2024
Read
Engineering8 min read

Achieving 800ms Cold Starts on Bare-Metal H100 Nodes

How we engineered custom Linux kernel modules and NVMe-over-Fabrics caching to eliminate cluster provisioning lag.

DM
Dr. Marcus Vance
September 28, 2024
Read
Business5 min read

The Economic Reality of Serverless vs. Reserved GPU Instances

Analyzing cost efficiencies, utilization curves, and why scale-to-zero infrastructure is transforming AI startups.

SL
Sophia Lin
September 12, 2024
Read
Monthly Engineering Digest

Stay ahead on GPU cluster architecture

Get new benchmark reports, kernel optimizations, and Blackwell B200 deployment guides delivered straight to your inbox.