iroh

A Rust peer-to-peer networking stack that meshes hosts with QUIC transport, content-addressed blobs, and NAT hole-punching, now being used as the substrate for spreading LLM inference across peers.

grounded in: Latest-trends NOTABLE item: 'Mesh LLM: Distributed AI compute layer that spreads model inference across peers over iroh' (HN front page, 2026-07-12).

Connected concepts

Decentralized mesh inference, P2P overlay network, QUIC transport, Content-addressed networking, Distributed inference, NAT Traversal / Hole Punching