MosaicML Composer

Training efficiency library with algorithmic speedups and multi-GPU orchestration

View on GitHub

Overview

MosaicML Composer is a PyTorch training library that provides algorithmic speedups, efficient multi-GPU training, and composable training recipes for faster model convergence.

Key Features

  • Algorithmic speedups โ€” Mix of training efficiency methods (e.g., progressive resizing, label smoothing)
  • Composable recipes โ€” Stack multiple methods without conflicts
  • Multi-GPU โ€” Native distributed training support
  • Efficient data loading โ€” Streaming datasets from object storage