Micro-Benchmarks & Validation
Tools to validate your cluster, measure performance, and profile training workloads.
📡
Communication Benchmarks
DeepEP Benchmark
Build and run DeepEP's Mixture-of-Experts dispatch/combine micro-benchmarks with an EFA (libfabric) NVSHMEM transport on AWS GPU clusters
Expert-Parallelism Backend Comparison on EFA
Compares three expert-parallel dispatch/combine backends (UCCL, DeepEP V1 NVSHMEM, DeepEP V2 NCCL GIN) under common Decode-like and Prefill-like workloads on B200 nodes over EFA.
Perplexity Kernels Benchmark
Benchmark expert-parallelism communication kernels (pplx-kernels) that accelerate Mixture-of-Experts communication using NVSHMEM
UCCL-EP Benchmark
Micro-benchmark for UCCL expert-parallelism dispatch/combine on NVLink and RDMA over EFA, runnable on Slurm and Amazon EKS
NCCL Tests
NCCL Tests micro-benchmark for distributed AI on AWS
NCCOM Tests
NCCOM Tests micro-benchmark for distributed AI on AWS
NVSHMEM
NVSHMEM micro-benchmark for distributed AI on AWS
Expert Parallelism
Mixture-of-Experts routing and communication benchmarks
DeepEP V2 Benchmark (NCCL GIN / EFA-GDA)
Install and validate DeepEP V2 MoE expert-parallelism dispatch/combine kernels over NCCL GIN with the EFA-GDA backend on Slurm and EKS.
NCCL Send/Recv Ring Test
A minimal, self-contained NCCL point-to-point benchmark that measures send/recv latency and bandwidth across GPUs in a ring topology
PPLX Garden Expert Parallelism Benchmark
All-to-all dispatch and combine latency benchmarks for MoE expert parallelism using pplx-garden and UCCL-EP over EFA
✅
Validation & Health
📊
Monitoring
🔬