Download Latest Version torchmetrics-1.8.0.tar.gz (578.9 kB)
Email in envelope

Get an email when there's a new version of TorchMetrics AI

Home / v1.8.0
Name Modified Size InfoDownloads / Week
Parent folder
torchmetrics-1.8.0.tar.gz 2025-07-23 578.9 kB
0
torchmetrics-1.8.0-py3-none-any.whl 2025-07-23 981.9 kB
0
First video and vertex metrics source code.tar.gz 2025-07-23 1.0 MB
0
First video and vertex metrics source code.zip 2025-07-23 1.8 MB
2 2 weekly downloads
README.md 2025-07-23 3.3 kB
0
Totals: 5 Items   4.4 MB 2

The upcoming TorchMetrics v1.8.0 release introduces three flagship metrics, each designed to address critical evaluation needs in real-world applications.

Video Multi-Method Assessment Fusion (VMAF) brings a perceptual video-quality score that closely mirrors human judgment, powering streaming services such as Netflix and YouTube to optimize encoding ladders for consistent viewer experiences and enabling video-restoration labs to quantify improvements achieved by denoising and super-resolution algorithms.

Continuous Ranked Probability Score (CRPS) enables comprehensive evaluation of full predictive distributions rather than point estimates; meteorological centers leverage CRPS to benchmark probabilistic precipitation and temperature forecasts, improving public weather alerts, while energy companies apply it to assess uncertainty in load-demand predictions and refine grid management and trading strategies.

Lip Vertex Error (LVE) measures the discrepancy between predicted and ground-truth lip landmarks to quantify audio-visual synchronization. Localization studios use LVE to validate lip-sync accuracy during film dubbing, while AR/VR developers integrate it into avatar pipelines to ensure natural mouth movements in real-time virtual meetings and social experiences.

[1.8.0] - 2025-07-23

Added

  • Added VMAF metric to new video domain (#2991)
  • Added CRPS in regression domain (#3024)
  • Added aggregation_level argument to DiceScore (#3018)
  • Added support for reduction="none" to LearnedPerceptualImagePatchSimilarity (#3053)
  • Added support single str input for functional interface of bert_score (#3056)
  • Enhance: BERTScore to evaluate hypotheses against multiple references (#3069)
  • Added Lip Vertex Error (LVE) in multimodal domain (#3090)
  • Added antialias argument to FID metric (#3177)
  • Added mixed input format to segmentation metrics (#3176)

Changed

  • Changed data_range argument in PSNR metric to be a required argument (#3178)

Removed

  • Removed zero_division argument from DiceScore (#3018)

Key Contributors

@nkaenzig, @rittik9, @simonreise, @SkafteNicki

New Contributors

If we forgot someone due to not matching commit email with GitHub account, let us know :]

Full Changelog: https://github.com/Lightning-AI/torchmetrics/compare/v1.7.0...v1.8.0

Source: README.md, updated 2025-07-23