Menu

Tree [dd149f] master /
 History

HTTPS access


File Date Author Commit
 .github 2024-02-04 Andrey Tatarinov Andrey Tatarinov [a15612] pin pytest<8 until fixed
 .vscode 2024-01-09 Andrey Tatarinov Andrey Tatarinov [93be2d] try to fix stuck test
 datapipe 2024-01-16 Andrey Tatarinov Andrey Tatarinov [1d2bd9] add serialization for TableStoreDB
 design-docs 2022-11-15 Andrey Tatarinov Andrey Tatarinov [d50f6a] *
 docs 2024-01-30 puritanne puritanne [b09fbe] Update introduction.md
 examples 2024-02-04 Andrey Tatarinov Andrey Tatarinov [70f0ad] rename & reformat
 tests 2024-01-12 Alexander Kozlov Alexander Kozlov [81675b] fix read_rows_meta_pseudo_df for multiply suffi...
 .gitattributes 2023-02-17 Andrey Tatarinov Andrey Tatarinov [7bb3f4] do not use git lfs for ipynb
 .gitignore 2022-07-30 Andrey Tatarinov Andrey Tatarinov [302672] fix CI
 .readthedocs.yml 2023-03-21 Andrey Tatarinov Andrey Tatarinov [52a8fe] remove requirements.txt from readthedocs build
 CHANGELOG.md 2024-01-16 Andrey Tatarinov Andrey Tatarinov [32692b] v0.13.10
 LICENSE 2021-12-15 Andrey Tatarinov Andrey Tatarinov [1e7aca] Create LICENSE
 README.md 2024-02-07 puritanne puritanne [dd149f] Update README.md
 pyproject.toml 2024-02-04 Andrey Tatarinov Andrey Tatarinov [82f9e9] fix docs extras
 .dockerignore 2021-01-07 Andrey Tatarinov Andrey Tatarinov [38347f] log events to db

Read Me

Datapipe

Datapipe is a real-time, incremental ETL library for Python with record-level dependency tracking.

The library is designed for describing data processing pipelines and is capable
of tracking dependencies for each record in the pipeline. This ensures that
tasks within the pipeline receive only the data that has been modified, thereby
improving the overall efficiency of data handling.

https://datapipe.dev/

Development

At the moment these branches are active:

  • master - current development state, will be promoted to 0.13.x series
    release once ready
  • v0.13 - current stable version
  • v0.11 - legacy stable version (v0.12 was skipped due reasons)

Version compatibility

At the moment, the datapipe library is under active development. Versions:
v0.*.*

It should be expected that each minor version is not backward compatible with
the previous one. That is, v0.7.0 is not compatible with v0.6.1. Dependencies
should be fixed to the exact minor version.

After stabilization and transition to the major version v1.*.*, the common
rules will apply: all versions with the same major component are compatible.

Want the latest updates on software, tech news, and AI?
Get latest updates about software, tech news, and AI from SourceForge directly in your inbox once a month.