Apache Gobblin

Apache Gobblin

Apache Software Foundation
Apache Kafka

Apache Kafka

The Apache Software Foundation
+

Related Products

  • dbt
    197 Ratings
    Visit Website
  • AnalyticsCreator
    46 Ratings
    Visit Website
  • DataBuck
    6 Ratings
    Visit Website
  • Semarchy xDM
    63 Ratings
    Visit Website
  • ActiveBatch Workload Automation
    353 Ratings
    Visit Website
  • Vertex AI
    727 Ratings
    Visit Website
  • Declarative Webhooks
    2 Ratings
    Visit Website
  • Amazon Bedrock
    77 Ratings
    Visit Website
  • Google Cloud BigQuery
    1,851 Ratings
    Visit Website
  • MindCloud
    20 Ratings
    Visit Website

About

Airbyte is an open-source data integration platform designed to help businesses synchronize data from various sources to their data warehouses, lakes, or databases. The platform provides over 550 pre-built connectors and enables users to easily create custom connectors using low-code or no-code tools. Airbyte's solution is optimized for large-scale data movement, enhancing AI workflows by seamlessly integrating unstructured data into vector databases like Pinecone and Weaviate. It offers flexible deployment options, ensuring security, compliance, and governance across all models.

About

A distributed data integration framework that simplifies common aspects of Big Data integration such as data ingestion, replication, organization, and lifecycle management for both streaming and batch data ecosystems. Runs as a standalone application on a single box. Also supports embedded mode. Runs as an mapreduce application on multiple Hadoop versions. Also supports Azkaban for launching mapreduce jobs. Runs as a standalone cluster with primary and worker nodes. This mode supports high availability and can run on bare metals as well. Runs as an elastic cluster on public cloud. This mode supports high availability. Gobblin as it exists today is a framework that can be used to build different data integration applications like ingest, replication, etc. Each of these applications is typically configured as a separate job and executed through a scheduler like Azkaban.

About

Apache Kafka® is an open-source, distributed streaming platform. Scale production clusters up to a thousand brokers, trillions of messages per day, petabytes of data, hundreds of thousands of partitions. Elastically expand and contract storage and processing. Stretch clusters efficiently over availability zones or connect separate clusters across geographic regions. Process streams of events with joins, aggregations, filters, transformations, and more, using event-time and exactly-once processing. Kafka’s out-of-the-box Connect interface integrates with hundreds of event sources and event sinks including Postgres, JMS, Elasticsearch, AWS S3, and more. Read, write, and process streams of events in a vast array of programming languages.

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Audience

Data engineers, businesses, and AI developers looking for scalable, secure, and flexible solutions to automate data movement and optimize AI workflows

Audience

Anyone seeking a solution to simplify data integration for their streaming and batch data ecosystems

Audience

Companies searching for an open-source distributed event streaming platform for high-performance data pipelines, streaming analytics, data integration, and mission-critical applications

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

API

Offers API

API

Offers API

API

Offers API

Screenshots and Videos

Screenshots and Videos

Screenshots and Videos

Pricing

$2.50 per credit
Free Version
Free Trial

Pricing

No information available.
Free Version
Free Trial

Pricing

No information available.
Free Version
Free Trial

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 5.0 / 5
ease 4.0 / 5
features 5.0 / 5
design 5.0 / 5
support 5.0 / 5

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Company Information

Airbyte
Founded: 2020
United States
airbyte.com

Company Information

Apache Software Foundation
United States
gobblin.apache.org

Company Information

The Apache Software Foundation
Founded: 1999
United States
kafka.apache.org

Alternatives

Alternatives

Alternatives

Apache Spark

Apache Spark

Apache Software Foundation
InDriver

InDriver

ANDSystems
EMQX

EMQX

EMQ Technologies
Hadoop

Hadoop

Apache Software Foundation

Categories

Categories

Categories

Message Queue Features

Asynchronous Communications Protocol
Data Error Reduction
Message Encryption
On-Premise Installation
Roles / Permissions
Storage / Retrieval / Deletion
System Decoupling

Integrations

100x
Apache Druid
Baidu Messaging System
Circonus IRONdb
Diamanti
FairCom EDGE
Feast
HubSpot Customer Platform
IBM Z System Automation
IBM watsonx.data
LOGIQ
Netdata
Onehouse
Oracle In-Memory Cost Management
PayPal
Rhapsody
Specmatic
Telmai
Waterstream
Windmill

Integrations

100x
Apache Druid
Baidu Messaging System
Circonus IRONdb
Diamanti
FairCom EDGE
Feast
HubSpot Customer Platform
IBM Z System Automation
IBM watsonx.data
LOGIQ
Netdata
Onehouse
Oracle In-Memory Cost Management
PayPal
Rhapsody
Specmatic
Telmai
Waterstream
Windmill

Integrations

100x
Apache Druid
Baidu Messaging System
Circonus IRONdb
Diamanti
FairCom EDGE
Feast
HubSpot Customer Platform
IBM Z System Automation
IBM watsonx.data
LOGIQ
Netdata
Onehouse
Oracle In-Memory Cost Management
PayPal
Rhapsody
Specmatic
Telmai
Waterstream
Windmill
Claim Airbyte and update features and information
Claim Airbyte and update features and information
Claim Apache Gobblin and update features and information
Claim Apache Gobblin and update features and information
Claim Apache Kafka and update features and information
Claim Apache Kafka and update features and information