+
+

Related Products

  • Teradata VantageCloud
    1,122 Ratings
    Visit Website
  • AnalyticsCreator
    46 Ratings
    Visit Website
  • dbt
    263 Ratings
    Visit Website
  • Comet Backup
    218 Ratings
    Visit Website
  • Docket
    59 Ratings
    Visit Website
  • DataBuck
    6 Ratings
    Visit Website
  • RaimaDB
    12 Ratings
    Visit Website
  • Google Cloud BigQuery
    2,017 Ratings
    Visit Website
  • Google Cloud Platform
    61,011 Ratings
    Visit Website
  • Denodo
    387 Ratings
    Visit Website

About

Delta Lake is an open-source storage layer that brings ACID transactions to Apache Spark™ and big data workloads. Data lakes typically have multiple data pipelines reading and writing data concurrently, and data engineers have to go through a tedious process to ensure data integrity, due to the lack of transactions. Delta Lake brings ACID transactions to your data lakes. It provides serializability, the strongest level of isolation level. Learn more at Diving into Delta Lake: Unpacking the Transaction Log. In big data, even the metadata itself can be "big data". Delta Lake treats metadata just like data, leveraging Spark's distributed processing power to handle all its metadata. As a result, Delta Lake can handle petabyte-scale tables with billions of partitions and files at ease. Delta Lake provides snapshots of data enabling developers to access and revert to earlier versions of data for audits, rollbacks or to reproduce experiments.

About

Pachyderm’s Data Versioning gives teams an automated and performant way to keep track of all data changes. File-based versioning provides a complete audit trail for all data and artifacts across pipeline stages, including intermediate results. Stored as native objects (not metadata pointers) so that versioning is automated and guaranteed. Autoscale with parallel processing of data without writing additional code. Incremental processing saves compute by only processing differences and automatically skipping duplicate data. Pachyderm’s Global IDs make it easy for teams to track any result all the way back to its raw input, including all analysis, parameters, code, and intermediate results. The Pachyderm Console provides an intuitive visualization of your DAG (directed acyclic graph), and aids in reproducibility with Global IDs.

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Audience

Companies looking for a storage layer software solution for big data workloads

Audience

Machine Learning solution for companies

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

API

Offers API

API

Offers API

Screenshots and Videos

Screenshots and Videos

Pricing

No information available.
Free Version
Free Trial

Pricing

No information available.
Free Version
Free Trial

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Company Information

Delta Lake
Founded: 2019
United States
delta.io

Company Information

Pachyderm
www.pachyderm.com

Alternatives

Apache Hudi

Apache Hudi

Apache Corporation

Alternatives

Apache Iceberg

Apache Iceberg

Apache Software Foundation
Apache Kudu

Apache Kudu

The Apache Software Foundation
Prevision

Prevision

Prevision.io
Keepsake

Keepsake

Replicate

Categories

Categories

Integrations

Arroyo
Ascend
Comcast Business VoiceEdge
DataHub
Dell AI-Ready Data Platform
Determined AI
Edmunds Financial Management
Feast
Hackolade
IBM watsonx.data integration
Informatica Cloud Application Integration
Kyvos Semantic Layer
Label Studio
McGraw-Hill Connect
PuppyGraph
Subsalt
Talend Data Fabric
TencentDB
Trellix Data Encryption

Integrations

Arroyo
Ascend
Comcast Business VoiceEdge
DataHub
Dell AI-Ready Data Platform
Determined AI
Edmunds Financial Management
Feast
Hackolade
IBM watsonx.data integration
Informatica Cloud Application Integration
Kyvos Semantic Layer
Label Studio
McGraw-Hill Connect
PuppyGraph
Subsalt
Talend Data Fabric
TencentDB
Trellix Data Encryption
Claim Delta Lake and update features and information
Claim Delta Lake and update features and information
Claim Pachyderm and update features and information
Claim Pachyderm and update features and information