DomainBed is a PyTorch-based research suite created by Facebook Research for benchmarking and evaluating domain generalization algorithms. It provides a unified framework for comparing methods that aim to train models capable of performing well across unseen domains, as introduced in the paper In Search of Lost Domain Generalization. The library includes a wide range of well-known domain generalization algorithms, from classical baselines such as Empirical Risk Minimization (ERM) and Invariant Risk Minimization (IRM) to more advanced techniques like Domain Adversarial Neural Networks (DANN), Adaptive Risk Minimization (ARM), and Invariance Principle Meets Information Bottleneck (IB-ERM/IB-IRM). DomainBed also integrates multiple standard datasets—including RotatedMNIST, PACS, VLCS, Office-Home, DomainNet, and subsets from WILDS—allowing consistent experimentation across image classification tasks.
Features
- Comprehensive PyTorch suite for domain generalization research and benchmarking
- Implements 25+ algorithms including ERM, IRM, DANN, Fish, and more
- Includes diverse domain generalization datasets such as PACS, DomainNet, and WILDS subsets
- Supports reproducible model selection methods and evaluation protocols
- Automates large-scale training sweeps and hyperparameter optimization
- Provides detailed result collection and LaTeX-compatible reporting utilities