fairscale — Expert Playground
PyTorch extensions for high-performance large-scale training
fairscale expert patternsRun locally
Install
pip install fairscalePython CodeRun locally
Expert-level fairscale usage for performance-critical and production-grade applications.
Challenge
Try modifying the code above to explore different behaviors. Can you extend the example to handle a new use case?