Introducing AMD Helion, Agentic AI Compute at Rack Scale (10 minute read)
AMD's Helion agentic AI rack is designed for flexible AI infrastructure that caters to hyperscale deployments and enterprise needs. It supports a range of configurations, including CPU-only and GPU-integrated systems, aligning with diverse AI workloads. Helion, part of an upcoming open blueprint by AMD for OCP, is set for release in November.
|
|
Engineering and Applications
|
Physical Intelligence opens a beta API to fine-tune and host π robot models (3 minute read)
Physical Intelligence opened a beta API for its π robotics foundation models: upload demonstrations, fine-tune on Pi-managed compute, and run the result on your own robot through a hosted inference gateway. Early partners spanned hardware from Actor's autonomous wheel loader, running a commercial deployment with no operator onboard, to Almond's dual-arm Axol, which learned to deburr its own spacers in four days. Since most ran cloud-hosted inference, network connectivity was a pain point for some.
|
Building a GPU compiler from scratch, from PyTorch to CUDA (10 minute read)
This deep dive uses the Emmy compiler framework to follow PyTorch operations down to CUDA one lowering stage at a time: Tensor IR, Loop IR, Tile IR, Kernel IR, and finally emitted code. It uses RMSNorm and matrix multiplication as worked examples. It also covers operator fusion, schedule selection, and online attention rewrites, so readers can see what Triton-style stacks do under the hood.
|
|
Apple's Minions pools idle Macs into a virtual GPU cloud (10 minute read)
Apple Silicon Macs have powerful GPUs that sit mostly idle in normal use. Minions combines them across machines into a virtual GPU cloud for large ML inference jobs, with fault tolerance and flexible task scheduling. The pitch is that teams can use hardware they already own instead of waiting for expensive, centralized GPU capacity.
|
Anthropic runs a 26B model across 15 $55 TV boxes to test IoT self-replication (5 minute read)
Anthropic's Frontier Red Team ran Gemma4-26B-A4B across 15 off-brand Android TV boxes with 4GB of RAM each, using pipeline parallelism at 0.39 tokens per second, to test whether small models could replicate across cheap IoT hardware. A 9B model got inference running on 8 of 9 hardware types tested, and a Kimwolf-sized botnet would total only about 40 H100s of compute. By their trend line, small models reach the needed capability in simplified tests by year-end.
|
|
Apple Home Collection brings LG and Schneider cameras, a lock, and thermostats to Apple Home (3 minute read)
Apple's Home Collection, built with LG and Schneider Electric, covers cameras, thermostats, sensors, a doorbell, and a deadbolt. LG's lock uses Ultra Wideband to unlock as you approach and works locally over Matter and Aliro, while its indoor cam physically tilts away when someone's home. Every device supports Thread, and cameras keep recording to built-in storage if Wi-Fi drops. Prices run $199.95 to $399.95, with availability starting in December.
|
|
|
|
|
0 Comments