Spark Streaming

Spark Streaming

Apache Software Foundation
+
+

Related Products

  • Google Cloud BigQuery
    2,027 Ratings
    Visit Website
  • Runpod
    230 Ratings
    Visit Website
  • Servers.com by Nexcess
    15 Ratings
    Visit Website
  • AnalyticsCreator
    46 Ratings
    Visit Website
  • Chainstack
    34 Ratings
    Visit Website
  • DataBuck
    6 Ratings
    Visit Website
  • Dragonfly
    16 Ratings
    Visit Website
  • Ganttic
    242 Ratings
    Visit Website
  • Apify
    1,800 Ratings
    Visit Website
  • Project Insight
    122 Ratings
    Visit Website

About

Unified stream and batch data processing that's serverless, fast, and cost-effective. Fully managed data processing service. Automated provisioning and management of processing resources. Horizontal autoscaling of worker resources to maximize resource utilization. OSS community-driven innovation with Apache Beam SDK. Reliable and consistent exactly-once processing. Streaming data analytics with speed. Dataflow enables fast, simplified streaming data pipeline development with lower data latency. Allow teams to focus on programming instead of managing server clusters as Dataflow’s serverless approach removes operational overhead from data engineering workloads. Allow teams to focus on programming instead of managing server clusters as Dataflow’s serverless approach removes operational overhead from data engineering workloads. Dataflow automates provisioning and management of processing resources to minimize latency and maximize utilization.

About

Spark Streaming brings Apache Spark's language-integrated API to stream processing, letting you write streaming jobs the same way you write batch jobs. It supports Java, Scala and Python. Spark Streaming recovers both lost work and operator state (e.g. sliding windows) out of the box, without any extra code on your part. By running on Spark, Spark Streaming lets you reuse the same code for batch processing, join streams against historical data, or run ad-hoc queries on stream state. Build powerful interactive applications, not just analytics. Spark Streaming is developed as part of Apache Spark. It thus gets tested and updated with each Spark release. You can run Spark Streaming on Spark's standalone cluster mode or other supported cluster resource managers. It also includes a local run mode for development. In production, Spark Streaming uses ZooKeeper and HDFS for high availability.

Platforms Supported

Windows Not Supported
Mac Not Supported
Linux Not Supported
Cloud Supported
On-Premises Not Supported
iPhone Not Supported
iPad Not Supported
Android Not Supported
Chromebook Not Supported

Platforms Supported

Windows Not Supported
Mac Not Supported
Linux Not Supported
Cloud Supported
On-Premises Not Supported
iPhone Not Supported
iPad Not Supported
Android Not Supported
Chromebook Not Supported

Audience

Teams that want unified stream and batch data processing that's serverless, fast, and cost-effective

Audience

Real-Time Data Streaming solution for businesses

Support

Phone Support Not Supported
24/7 Live Support Not Supported
Online Not Supported

Support

Phone Support Not Supported
24/7 Live Support Not Supported
Online Supported

API

Offers API Not Supported

API

Offers API Not Supported

Screenshots and Videos

Screenshots and Videos

Pricing

No information available.
Free Version Not Supported
Free Trial Not Supported

Pricing

No information available.
Free Version Not Supported
Free Trial Not Supported

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation Supported
Webinars Not Supported
Live Online Not Supported
In Person Not Supported

Training

Documentation Supported
Webinars Not Supported
Live Online Not Supported
In Person Not Supported

Company Information

Google
Founded: 1998
United States
cloud.google.com/dataflow

Company Information

Apache Software Foundation
Founded: 1999
United States
spark.apache.org/streaming/

Alternatives

Apache Beam

Apache Beam

Apache Software Foundation

Alternatives

ksqlDB

ksqlDB

Confluent
Samza

Samza

Apache Software Foundation
Apache Spark

Apache Spark

Apache Software Foundation
MLlib

MLlib

Apache Software Foundation

Categories

Categories

Streaming Analytics Features

Data Enrichment Supported
Data Wrangling / Data Prep Supported
Multiple Data Source Support Supported
Process Automation Supported
Real-time Analysis / Reporting Supported
Visualization Dashboards Supported

Integrations

Apache Spark Not Supported
CData Connect Supported
DataBuck Supported
Google Cloud Bigtable Supported
Google Cloud Confidential VMs Supported
Google Cloud Datastream Supported
Google Cloud IoT Core Supported
Google Cloud Knowledge Catalog Supported
Google Cloud Managed Service for Apache Airflow Supported
Google Cloud Platform Supported
Google Cloud Profiler Supported
New Relic Supported
Orchestra Supported
Pantomath Supported
Protegrity Supported
PubSub+ Platform Not Supported
Sedai Supported
Telmai Supported
Ternary Supported

Integrations

Apache Spark Supported
CData Connect Not Supported
DataBuck Not Supported
Google Cloud Bigtable Not Supported
Google Cloud Confidential VMs Not Supported
Google Cloud Datastream Not Supported
Google Cloud IoT Core Not Supported
Google Cloud Knowledge Catalog Not Supported
Google Cloud Managed Service for Apache Airflow Not Supported
Google Cloud Platform Not Supported
Google Cloud Profiler Not Supported
New Relic Not Supported
Orchestra Not Supported
Pantomath Not Supported
Protegrity Not Supported
PubSub+ Platform Supported
Sedai Not Supported
Telmai Not Supported
Ternary Not Supported
Claim Google Cloud Dataflow and update features and information
Claim Google Cloud Dataflow and update features and information
Claim Spark Streaming and update features and information
Claim Spark Streaming and update features and information