Lightly Files

What's Changed

• Speed up function _same_mask in DetConBLoss by 25% by @misrasaurabh1 in https://github.com/lightly-ai/lightly/pull/1847
• Fix DINOv2 Bugs
• Add DINOv2 to Docs with Example
• Fix: vicregl_loss tensor RuntimeError by @RDR2Blackwater in https://github.com/lightly-ai/lightly/pull/1850
• Add iBOTTransform
• Add iBOT Implementation
• Add iBOT to Docs with Example
• Fix KNN dtype for ResNet benchmark
• Fix CUDA Tests for Losses
• Fix OnlineClassifier Issues
• Support Tensor Input for GaussianBlur
• Use ToTensor Helper Function by @ajtritt in https://github.com/lightly-ai/lightly/pull/1862
• Move Rotation After Flip for Transforms by @KylevdLangemheen in https://github.com/lightly-ai/lightly/pull/1865
• Improve pre-commit hooks for Dev Env
• Add iBOT Benchmarks

New Contributors

• @misrasaurabh1 made their first contribution in https://github.com/lightly-ai/lightly/pull/1847
• @RDR2Blackwater made their first contribution in https://github.com/lightly-ai/lightly/pull/1850
• @ajtritt made their first contribution in https://github.com/lightly-ai/lightly/pull/1862
• @KylevdLangemheen made their first contribution in https://github.com/lightly-ai/lightly/pull/1865

Full Changelog: https://github.com/lightly-ai/lightly/compare/v1.15.21...v1.15.22

Many thanks to our contributors!

Models

• AIM: Scalable Pre-training of Large Autoregressive Image Models
• Barlow Twins: Self-Supervised Learning via Redundancy Reduction, 2021
• Bootstrap your own latent: A new approach to self-supervised Learning, 2020
• DCL: Decoupled Contrastive Learning, 2021
• DenseCL: Dense Contrastive Learning for Self-Supervised Visual Pre-Training, 2021
• DINO: Emerging Properties in Self-Supervised Vision Transformers, 2021
• DINOv2: Learning Robust Visual Features without Supervision, 2023
• FastSiam: Resource-Efficient Self-supervised Learning on a Single GPU, 2022
• iBOT: Image BERT Pre-Training with Online Tokenizer, 2021
• I-JEPA: Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture, 2023
• MAE: Masked Autoencoders Are Scalable Vision Learners, 2021
• MSN: Masked Siamese Networks for Label-Efficient Learning, 2022
• MoCo: Momentum Contrast for Unsupervised Visual Representation Learning, 2019
• NNCLR: Nearest-Neighbor Contrastive Learning of Visual Representations, 2021
• PMSN: Prior Matching for Siamese Networks, 2022
• SimCLR: A Simple Framework for Contrastive Learning of Visual Representations, 2020
• SimMIM: A Simple Framework for Masked Image Modeling, 2021
• SimSiam: Exploring Simple Siamese Representation Learning, 2020
• SMoG: Unsupervised Visual Representation Learning by Synchronous Momentum Grouping, 2022
• SwAV: Unsupervised Learning of Visual Features by Contrasting Cluster Assignments, M. Caron, 2020
• TiCo: Transformation Invariance and Covariance Contrast for Self-Supervised Visual Representation Learning, 2022
• VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning, Bardes, A. et. al, 2022
• VICRegL: VICRegL: Self-Supervised Learning of Local Visual Features, 2022