Theseus
A library for differentiable nonlinear optimization
Theseus is a library for differentiable nonlinear optimization that lets you embed solvers like Gauss-Newton or Levenberg–Marquardt inside PyTorch models. Problems are expressed as factor graphs with variables on manifolds (e.g., SE(3), SO(3)), so classical robotics and vision tasks—bundle adjustment, pose graph optimization, hand–eye calibration—can be written succinctly and solved efficiently. Because solves are differentiable, you can backpropagate through optimization to learn cost weights, feature extractors, or initialization networks end-to-end. ...