Lightly Files

What's Changed

• Fix deprecation warning totensor (#1864) by @KylevdLangemheen in https://github.com/lightly-ai/lightly/pull/1866
• Move functional transforms API to compatibility layer (#1867) by @KylevdLangemheen in https://github.com/lightly-ai/lightly/pull/1870
• Fix the banner and tab name of LightlySSL Docs by @yutong-xiang-97 in https://github.com/lightly-ai/lightly/pull/1872
• Add DINOv2 to Readme (#1873) by @KylevdLangemheen in https://github.com/lightly-ai/lightly/pull/1875
• Fixed SMoG examples by @thomasmarchioro3 in https://github.com/lightly-ai/lightly/pull/1876
• Add DirectCLR (#781) by @KylevdLangemheen in https://github.com/lightly-ai/lightly/pull/1874
• Update README badge links by @Olexandr88 in https://github.com/lightly-ai/lightly/pull/1880
• Add link to social network twitter by @Olexandr88 in https://github.com/lightly-ai/lightly/pull/1883
• Update packages for CI by @IgorSusmelj in https://github.com/lightly-ai/lightly/pull/1896
• Contributing Guide: Add instructions on Imports by @liopeer in https://github.com/lightly-ai/lightly/pull/1895
• Add LeJEPA SIGReg Loss implementation by @gabrielfruet in https://github.com/lightly-ai/lightly/pull/1893
• Speed up momentum update by @vsey in https://github.com/lightly-ai/lightly/pull/1899
• Add LightlyStudio reference to README by @michal-lightly in https://github.com/lightly-ai/lightly/pull/1903
• Add DINOv2-3D: Self-Supervised 3D Vision Transformer Pretraining to README by @guarin in https://github.com/lightly-ai/lightly/pull/1890
• Add torchvision 0.26 support by @guarin in https://github.com/lightly-ai/lightly/pull/1904

New Contributors

• @thomasmarchioro3 made their first contribution in https://github.com/lightly-ai/lightly/pull/1876
• @Olexandr88 made their first contribution in https://github.com/lightly-ai/lightly/pull/1880
• @gabrielfruet made their first contribution in https://github.com/lightly-ai/lightly/pull/1893
• @vsey made their first contribution in https://github.com/lightly-ai/lightly/pull/1899

Full Changelog: https://github.com/lightly-ai/lightly/compare/v1.15.22...v1.15.23

Many thanks to our contributors!

Models

• AIM: Scalable Pre-training of Large Autoregressive Image Models
• Barlow Twins: Self-Supervised Learning via Redundancy Reduction, 2021
• Bootstrap your own latent: A new approach to self-supervised Learning, 2020
• DCL: Decoupled Contrastive Learning, 2021
• DenseCL: Dense Contrastive Learning for Self-Supervised Visual Pre-Training, 2021
• DINO: Emerging Properties in Self-Supervised Vision Transformers, 2021
• DINOv2: Learning Robust Visual Features without Supervision, 2023
• FastSiam: Resource-Efficient Self-supervised Learning on a Single GPU, 2022
• iBOT: Image BERT Pre-Training with Online Tokenizer, 2021
• I-JEPA: Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture, 2023
• MAE: Masked Autoencoders Are Scalable Vision Learners, 2021
• MSN: Masked Siamese Networks for Label-Efficient Learning, 2022
• MoCo: Momentum Contrast for Unsupervised Visual Representation Learning, 2019
• NNCLR: Nearest-Neighbor Contrastive Learning of Visual Representations, 2021
• PMSN: Prior Matching for Siamese Networks, 2022
• SimCLR: A Simple Framework for Contrastive Learning of Visual Representations, 2020
• SimMIM: A Simple Framework for Masked Image Modeling, 2021
• SimSiam: Exploring Simple Siamese Representation Learning, 2020
• SMoG: Unsupervised Visual Representation Learning by Synchronous Momentum Grouping, 2022
• SwAV: Unsupervised Learning of Visual Features by Contrasting Cluster Assignments, M. Caron, 2020
• TiCo: Transformation Invariance and Covariance Contrast for Self-Supervised Visual Representation Learning, 2022
• VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning, Bardes, A. et. al, 2022
• VICRegL: VICRegL: Self-Supervised Learning of Local Visual Features, 2022