Clustering Four DGX Sparks in a 200Gb/s Ring
The planned 200Gb/s switch never happened. Instead we cabled four DGX Sparks directly to each other in a closed ring, pointed a setup script at it, and ended up serving a 552-billion-parameter model from the home office for under AUD $50,000.