Google Brings Colossus-Backed Rapid Buckets to PyTorch via gcsfs
Google says PyTorch workloads on Google Cloud can train faster with a new gcsfs integration for Rapid Buckets, a Colossus-backed storage path designed to reduce data-loading and checkpoint bottlenecks.