DVC
Data Version Control | Git for Data & Models
..., and intermediate files. DVC connects them with code and uses Amazon S3, Microsoft Azure Blob Storage, Google Drive, Google Cloud Storage, Aliyun OSS, SSH/SFTP, HDFS, HTTP, network-attached storage, or disc to store file contents. Harness the full power of Git branches to try different ideas instead of sloppy file suffixes and comments in code. Use automatic metric tracking to navigate instead of paper and pencil. DVC introduces lightweight pipelines as a first-class citizen mechanism in Git.