lakeFS

lakeFS

Treeverse
+
+

Related Products

  • Teradata VantageCloud
    1,120 Ratings
    Visit Website
  • AnalyticsCreator
    46 Ratings
    Visit Website
  • dbt
    259 Ratings
    Visit Website
  • Comet Backup
    218 Ratings
    Visit Website
  • Docket
    59 Ratings
    Visit Website
  • Yodeck
    7,730 Ratings
    Visit Website
  • DataBuck
    6 Ratings
    Visit Website
  • RaimaDB
    12 Ratings
    Visit Website
  • Google Cloud BigQuery
    2,016 Ratings
    Visit Website
  • Google Cloud Platform
    60,933 Ratings
    Visit Website

About

Delta Lake is an open-source storage layer that brings ACID transactions to Apache Spark™ and big data workloads. Data lakes typically have multiple data pipelines reading and writing data concurrently, and data engineers have to go through a tedious process to ensure data integrity, due to the lack of transactions. Delta Lake brings ACID transactions to your data lakes. It provides serializability, the strongest level of isolation level. Learn more at Diving into Delta Lake: Unpacking the Transaction Log. In big data, even the metadata itself can be "big data". Delta Lake treats metadata just like data, leveraging Spark's distributed processing power to handle all its metadata. As a result, Delta Lake can handle petabyte-scale tables with billions of partitions and files at ease. Delta Lake provides snapshots of data enabling developers to access and revert to earlier versions of data for audits, rollbacks or to reproduce experiments.

About

lakeFS enables you to manage your data lake the way you manage your code. Run parallel pipelines for experimentation and CI/CD for your data. Simplifying the lives of engineers, data scientists and analysts who are transforming the world with data. lakeFS is an open source platform that delivers resilience and manageability to object-storage based data lakes. With lakeFS you can build repeatable, atomic and versioned data lake operations, from complex ETL jobs to data science and analytics. lakeFS supports AWS S3, Azure Blob Storage and Google Cloud Storage (GCS) as its underlying storage service. It is API compatible with S3 and works seamlessly with all modern data frameworks such as Spark, Hive, AWS Athena, Presto, etc. lakeFS provides a Git-like branching and committing model that scales to exabytes of data by utilizing S3, GCS, or Azure Blob for storage.

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Audience

Companies looking for a storage layer software solution for big data workloads

Audience

Enterprises seeking an open source platform that delivers resilience and manageability to object-storage based data lakes

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

API

Offers API

API

Offers API

Screenshots and Videos

Screenshots and Videos

Pricing

No information available.
Free Version
Free Trial

Pricing

No information available.
Free Version
Free Trial

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Company Information

Delta Lake
Founded: 2019
United States
delta.io

Company Information

Treeverse
Founded: 2020
Israel
lakefs.io

Alternatives

Apache Hudi

Apache Hudi

Apache Corporation

Alternatives

Apache Iceberg

Apache Iceberg

Apache Software Foundation
Apache Kudu

Apache Kudu

The Apache Software Foundation

Categories

Categories

Integrations

Apache Spark
Databricks
Apache Airflow
Astro by Astronomer
Azure Blob Storage
CelerData Cloud
Delta Lake
Edmunds Financial Management
Hackolade
Hadoop
IBM watsonx.data integration
Okera
Onehouse
OpenMetadata
PuppyGraph
SimpleKPI
StarTree
Talend Data Fabric
Tecton
TencentDB

Integrations

Apache Spark
Databricks
Apache Airflow
Astro by Astronomer
Azure Blob Storage
CelerData Cloud
Delta Lake
Edmunds Financial Management
Hackolade
Hadoop
IBM watsonx.data integration
Okera
Onehouse
OpenMetadata
PuppyGraph
SimpleKPI
StarTree
Talend Data Fabric
Tecton
TencentDB
Claim Delta Lake and update features and information
Claim Delta Lake and update features and information
Claim lakeFS and update features and information
Claim lakeFS and update features and information