Business Software for Apache Spark
View:
Compare business software, products, and services to find the best solution for your business or organization. Use the filters on the left to drill down by category, pricing, features, organization size, organization type, region, user reviews, integrations, and more. View and sort the products and solutions that match your needs in the results below.
-
1
Vertex AI
Google
Build, deploy, and scale machine learning (ML) models faster, with fully managed ML tools for any use case. Through Vertex AI Workbench, Vertex AI is natively integrated with BigQuery, Dataproc, and Spark. You can use BigQuery ML to create and execute machine learning models in BigQuery using standard SQL queries on existing business intelligence tools and spreadsheets, or you can export datasets from BigQuery directly into Vertex AI Workbench and run your models from there. Use Vertex Data Labeling to generate highly accurate labels for your data collection. Vertex AI Agent Builder enables developers to create and deploy enterprise-grade generative AI applications. It offers both no-code and code-first approaches, allowing users to build AI agents using natural language instructions or by leveraging frameworks like LangChain and LlamaIndex.Starting Price: Free ($300 in free credits) -
2
Scalytics Connect
Scalytics
Scalytics Connect enables AI and ML to process and analyze data, makes it easier and more secure to use different data processing platforms at the same time. Built by the inventors of Apache Wayang, Scalytics Connect is the most enhanced data management platform, reducing the complexity of ETL data pipelines dramatically. Scalytics Connect is a data management and ETL platform that helps organizations unlock the power of their data, regardless of where it resides. It empowers businesses to break down data silos, simplify access, and gain valuable insights through a variety of features, including: - AI-powered ETL: Automates tasks like data extraction, transformation, and loading, freeing up your resources for more strategic work. - Unified Data Landscape: Breaks down data silos and provides a holistic view of all your data, regardless of its location or format. - Effortless Scaling: Handles growing data volumes with ease, so you never get bottlenecked by information overloadStarting Price: $0 -
3
Kubernetes
Kubernetes
Kubernetes (K8s) is an open-source system for automating deployment, scaling, and management of containerized applications. It groups containers that make up an application into logical units for easy management and discovery. Kubernetes builds upon 15 years of experience of running production workloads at Google, combined with best-of-breed ideas and practices from the community. Designed on the same principles that allows Google to run billions of containers a week, Kubernetes can scale without increasing your ops team. Whether testing locally or running a global enterprise, Kubernetes flexibility grows with you to deliver your applications consistently and easily no matter how complex your need is. Kubernetes is open source giving you the freedom to take advantage of on-premises, hybrid, or public cloud infrastructure, letting you effortlessly move workloads to where it matters to you.Starting Price: Free -
4
Sematext Cloud
Sematext Group
Sematext Cloud is an innovative, unified platform with all-in-one solution for infrastructure monitoring, application performance monitoring, log management, real user monitoring, and synthetic monitoring to provide unified, real-time observability of your entire technology stack. It's used by organizations of all sizes and across a wide range of industries, with the goal of driving collaboration between engineering and business teams, reducing the time of root-cause analysis, understanding user behaviour and tracking key business metrics. The main capabilities range from log monitoring to APM, server monitoring, database monitoring, network monitoring, uptime monitoring, website monitoring or container monitoring Find complete details on our website. Or better: start a free demo, no email address required.Starting Price: $0 -
5
Jupyter Notebook
Project Jupyter
The Jupyter Notebook is an open-source web application that allows you to create and share documents that contain live code, equations, visualizations and narrative text. Uses include: data cleaning and transformation, numerical simulation, statistical modeling, data visualization, machine learning, and much more. -
6
Amazon EC2
Amazon
Amazon Elastic Compute Cloud (Amazon EC2) is a web service that provides secure, resizable compute capacity in the cloud. It is designed to make web-scale cloud computing easier for developers. Amazon EC2’s simple web service interface allows you to obtain and configure capacity with minimal friction. It provides you with complete control of your computing resources and lets you run on Amazon’s proven computing environment. Amazon EC2 delivers the broadest choice of compute, networking (up to 400 Gbps), and storage services purpose-built to optimize price performance for ML projects. Build, test, and sign on-demand macOS workloads. Access environments in minutes, dynamically scale capacity as needed, and benefit from AWS’s pay-as-you-go pricing. Access the on-demand infrastructure and capacity you need to run HPC applications faster and cost-effectively. Amazon EC2 delivers secure, reliable, high-performance, and cost-effective compute infrastructure to meet demanding business needs. -
7
Apache Cassandra
Apache Software Foundation
The Apache Cassandra database is the right choice when you need scalability and high availability without compromising performance. Linear scalability and proven fault-tolerance on commodity hardware or cloud infrastructure make it the perfect platform for mission-critical data. Cassandra's support for replicating across multiple datacenters is best-in-class, providing lower latency for your users and the peace of mind of knowing that you can survive regional outages. -
8
SingleStore
SingleStore
SingleStore (formerly MemSQL) is a distributed, highly-scalable SQL database that can run anywhere. We deliver maximum performance for transactional and analytical workloads with familiar relational models. SingleStore is a scalable SQL database that ingests data continuously to perform operational analytics for the front lines of your business. Ingest millions of events per second with ACID transactions while simultaneously analyzing billions of rows of data in relational SQL, JSON, geospatial, and full-text search formats. SingleStore delivers ultimate data ingestion performance at scale and supports built in batch loading and real time data pipelines. SingleStore lets you achieve ultra fast query response across both live and historical data using familiar ANSI SQL. Perform ad hoc analysis with business intelligence tools, run machine learning algorithms for real-time scoring, perform geoanalytic queries in real time.Starting Price: $0.69 per hour -
9
Dataiku
Dataiku
Dataiku is an advanced data science and machine learning platform designed to enable teams to build, deploy, and manage AI and analytics projects at scale. It empowers users, from data scientists to business analysts, to collaboratively create data pipelines, develop machine learning models, and prepare data using both visual and coding interfaces. Dataiku supports the entire AI lifecycle, offering tools for data preparation, model training, deployment, and monitoring. The platform also includes integrations for advanced capabilities like generative AI, helping organizations innovate and deploy AI solutions across industries. -
10
JupyterLab
Jupyter
Project Jupyter exists to develop open-source software, open-standards, and services for interactive computing across dozens of programming languages. JupyterLab is a web-based interactive development environment for Jupyter notebooks, code, and data. JupyterLab is flexible, configure and arrange the user interface to support a wide range of workflows in data science, scientific computing, and machine learning. JupyterLab is extensible and modular, write plugins that add new components and integrate with existing ones. The Jupyter Notebook is an open-source web application that allows you to create and share documents that contain live code, equations, visualizations and narrative text. Uses include, data cleaning and transformation, numerical simulation, statistical modeling, data visualization, machine learning, and much more. Jupyter supports over 40 programming languages, including Python, R, Julia, and Scala. -
11
Apache Hive
Apache Software Foundation
The Apache Hive data warehouse software facilitates reading, writing, and managing large datasets residing in distributed storage using SQL. Structure can be projected onto data already in storage. A command line tool and JDBC driver are provided to connect users to Hive. Apache Hive is an open source project run by volunteers at the Apache Software Foundation. Previously it was a subproject of Apache® Hadoop®, but has now graduated to become a top-level project of its own. We encourage you to learn about the project and contribute your expertise. Traditional SQL queries must be implemented in the MapReduce Java API to execute SQL applications and queries over distributed data. Hive provides the necessary SQL abstraction to integrate SQL-like queries (HiveQL) into the underlying Java without the need to implement queries in the low-level Java API. -
12
Sifflet
Sifflet
Automatically cover thousands of tables with ML-based anomaly detection and 50+ custom metrics. Comprehensive data and metadata monitoring. Exhaustive mapping of all dependencies between assets, from ingestion to BI. Enhanced productivity and collaboration between data engineers and data consumers. Sifflet seamlessly integrates into your data sources and preferred tools and can run on AWS, Google Cloud Platform, and Microsoft Azure. Keep an eye on the health of your data and alert the team when quality criteria aren’t met. Set up in a few clicks the fundamental coverage of all your tables. Configure the frequency of runs, their criticality, and even customized notifications at the same time. Leverage ML-based rules to detect any anomaly in your data. No need for an initial configuration. A unique model for each rule learns from historical data and from user feedback. Complement the automated rules with a library of 50+ templates that can be applied to any asset. -
13
Archon Data Store
Platform 3 Solutions
Archon Data Store™ is a powerful and secure open-source based archive lakehouse platform designed to store, manage, and provide insights from massive volumes of data. With its compliance features and minimal footprint, it enables large-scale search, processing, and analysis of structured, unstructured, & semi-structured data across your organization. Archon Data Store combines the best features of data warehouses and data lakes into a single, simplified platform. This unified approach eliminates data silos, streamlining data engineering, analytics, data science, and machine learning workflows. Through metadata centralization, optimized data storage, and distributed computing, Archon Data Store maintains data integrity. Its common approach to data management, security, and governance helps you operate more efficiently and innovate faster. Archon Data Store provides a single platform for archiving and analyzing all your organization's data while delivering operational efficiencies. -
14
LogIsland
Hurence
The LogIsland platform is at the heart of Hurence’s real-time analytics. It allows you to capture factory events (IIoT) but also events from your websites. According to Hurence a factory, or more generally a company, can be understood and supervised in real time through all the events it encounters: a sales order is an event, the production of a piece by a robot is an event, the delivery of a product is an event. Everything is actually an event. The LogIsland platform allows you to capture all these events, put them in a message bus for large volumes and analyze them in real time with plug and play analyzers ranging from simple (counting, alerts, recommendations), to the most sophisticated: artificial intelligence models for predictions and detection of anomalies or defects. Your Swiss knife for analyzing events in real time with custom analyzers for two verticals, web analytics and industry 4.0. -
15
Activeeon ProActive
Activeeon
The solution provided by Activeeon is suited to fit modern challenges such as the growth of data, new infrastructures, cloud strategy evolving, new application architecture, etc. It provides orchestration and scheduling to automate and build a solid base for future growth. ProActive Workflows & Scheduling is a java-based cross-platform workflow scheduler and resource manager that is able to run workflow tasks in multiple languages and multiple environments (Windows, Linux, Mac, Unix, etc). ProActive Resource Manager makes compute resources available for task execution. It handles on-premises and cloud compute resources in an elastic, on-demand and distributed fashion. ProActive AI Orchestration from Activeeon empowers data engineers and data scientists with a simple, portable and scalable solution for machine learning pipelines. It provides pre-built and customizable tasks that enable automation within the machine learning lifecycle, which helps data scientists and IT Operations work.Starting Price: $10,000 -
16
Alluxio
Alluxio
Alluxio is world’s first open source data orchestration technology for analytics and AI for the cloud. It bridges the gap between data driven applications and storage systems, bringing data from the storage tier closer to the data driven applications and makes it easily accessible enabling applications to connect to numerous storage systems through a common interface. Alluxio’s memory-first tiered architecture enables data access at speeds orders of magnitude faster than existing solutions. Imagine as an IT leader having the flexibility to choose any services that are available in public cloud and on premises. And imagine being able to scale your storage for your data lakes with control over data locality and protection for your organization. With these goals in mind, NetApp and Alluxio are joining forces to help our customers adapt to new requirements for modernizing data architecture with low-touch operations for analytics, machine learning, and artificial intelligence workflows.Starting Price: 26¢ Per SW Instance Per Hour -
17
Dagster
Dagster Labs
Dagster is a next-generation orchestration platform for the development, production, and observation of data assets. Unlike other data orchestration solutions, Dagster provides you with an end-to-end development lifecycle. Dagster gives you control over your disparate data tools and empowers you to build, test, deploy, run, and iterate on your data pipelines. It makes you and your data teams more productive, your operations more robust, and puts you in complete control of your data processes as you scale. Dagster brings a declarative approach to the engineering of data pipelines. Your team defines the data assets required, quickly assessing their status and resolving any discrepancies. An assets-based model is clearer than a tasks-based one and becomes a unifying abstraction across the whole workflow.Starting Price: $0 -
18
Union Cloud
Union.ai
Union.ai is an award-winning, Flyte-based data and ML orchestrator for scalable, reproducible ML pipelines. With Union.ai, you can write your code locally and easily deploy pipelines to remote Kubernetes clusters. “Flyte’s scalability, data lineage, and caching capabilities enable us to train hundreds of models on petabytes of geospatial data, giving us an edge in our business.” — Arno, CTO at Blackshark.ai “With Flyte, we want to give the power back to biologists. We want to stand up something that they can play around with different parameters for their models because not every … parameter is fixed. We want to make sure we are giving them the power to run the analyses.” — Krishna Yeramsetty, Principal Data Scientist at Infinome “Flyte plays a vital role as a key component of Gojek's ML Platform by providing exactly that." — Pradithya Aria Pura, Principal Engineer at GojStarting Price: Free (Flyte) -
19
Apache Iceberg
Apache Software Foundation
Iceberg is a high-performance format for huge analytic tables. Iceberg brings the reliability and simplicity of SQL tables to big data, while making it possible for engines like Spark, Trino, Flink, Presto, Hive and Impala to safely work with the same tables, at the same time. Iceberg supports flexible SQL commands to merge new data, update existing rows, and perform targeted deletes. Iceberg can eagerly rewrite data files for read performance, or it can use delete deltas for faster updates. Iceberg handles the tedious and error-prone task of producing partition values for rows in a table and skips unnecessary partitions and files automatically. No extra filters are needed for fast queries, and the table layout can be updated as data or queries change.Starting Price: Free -
20
Oxla
Oxla
Purpose-built for compute, memory, and storage efficiency, Oxla is a self-hosted data warehouse optimized for large-scale, low-latency analytics with robust time-series support. Cloud data warehouses aren’t for everyone. At scale, long-term cloud compute costs outweigh short-term infrastructure savings, and regulated industries require full control over data beyond VPC and BYOC deployments. Oxla outperforms both legacy and cloud warehouses through efficiency, enabling scale for growing datasets with predictable costs, on-prem or in any cloud. Easily deploy, run, and maintain Oxla with Docker and YAML to power diverse workloads in a single, self-hosted data warehouse.Starting Price: $50 per CPU core / monthly -
21
Style Intelligence
InetSoft
Style Intelligence by InetSoft is a complete business intelligence (BI) software platform that empowers companies to explore, analyze, monitor, report, and collaborate on critical business and operational data from disparate sources in real time. Its top features include a real-time data mashup Data Block architecture, professional atomic data block modeling tool, and database write-back option. Robust and easy to use, Style Intelligence is also fully scalable and offers granular security, multi-tenancy support, and multiple integrations. InetSoft's cloud flexible business intelligence solution delivers the benefit of cloud computing and software-as-a-service while giving you the maximum level of control. In terms of software-as-a-service, BI software is unique because it inherently depends on the data not being embedded in the application. InetSoft provides free expert fast-start mentoring that delivers the expertise even when no in-house dedicated BI expert is available.Starting Price: $165/month -
22
Instaclustr
Instaclustr
Instaclustr is the Open Source-as-a-Service company, delivering reliability at scale. We operate an automated, proven, and trusted managed environment, providing database, analytics, search, and messaging. We enable companies to focus internal development and operational resources on building cutting edge customer-facing applications. Instaclustr works with cloud providers including AWS, Heroku, Azure, IBM Cloud, and Google Cloud Platform. The company has SOC 2 certification and provides 24/7 customer support.Starting Price: $20 per node per month -
23
Serverless, interactive querying for analyzing data in IBM Cloud Object Storage. Query your data directly where it is stored, there's no ETL, no databases, and no infrastructure to manage. IBM Cloud SQL Query uses Apache Spark, an open-source, fast, extensible, in-memory data processing engine optimized for low latency and ad hoc analysis of data. No ETL or schema definition needed to enable SQL queries. Analyze data where it sits in IBM Cloud Object Storage using our query editor and REST API. Run as many queries as you need; with pay-per-query pricing, you pay only for the data scan. Compress or partition data to drive savings and performance. IBM Cloud SQL Query is highly available and executes queries using compute resources across multiple facilities. IBM Cloud SQL Query supports a variety of data formats such as CSV, JSON and Parquet, and allows for standard ANSI SQL.Starting Price: $5.00/Terabyte-Month
-
24
PubSub+ Platform
Solace
Solace PubSub+ Platform helps enterprises design, deploy and manage event-driven systems across hybrid and multi-cloud and IoT environments so they can be more event-driven and operate in real-time. The PubSub+ Platform includes the powerful PubSub+ Event Brokers, event management capabilities with PubSub+ Event Portal, as well as monitoring and integration capabilities all available via a single cloud console. PubSub+ allows easy creation of an event mesh, an interconnected network of event brokers, allowing for seamless and dynamic data movement across highly distributed network environments. PubSub+ Event Brokers can be deployed as fully managed cloud services, self-managed software in private cloud or on-premises environments, or as turnkey hardware appliances for unparalleled performance and low TCO. PubSub+ Event Portal is a complimentary toolset for design and governance of event-driven systems including both Solace and Kafka-based event broker environments. -
25
Coginiti
Coginiti
Coginiti, the AI-enabled enterprise data workspace, empowers everyone to get consistent answers fast to any business question. Accelerating the analytic development lifecycle from development to certification, Coginiti makes it easy for you to search and find approved metrics for your use case. Coginiti integrates all the functionality you need to build, approve, version, and curate analytics across all business domains for reuse, all while adhering to your data governance policy and standards. Data and analytic teams in the insurance, financial services, healthcare, and retail/consumer package goods industries trust Coginiti’s collaborative data workspace to deliver value to their customers.Starting Price: $189/user/year -
26
Rational BI
Rational BI
Spend less time preparing your data and more time analyzing it. Not only can you build better looking and more accurate reports, you can centralize all your data gathering, analytics and data science in a single interface, accessible to everyone in the organization. Import all your data no matter where it lives. Whether you’re looking to build scheduled reports from your Excel files, cross-reference data between files and databases or turn your data into SQL queryable databases, Rational BI gives you all the tools you need. Discover the signals hidden in your data, make it available without delay and move ahead of your competition. Magnify the analytics capabilities of your organization through business intelligence that makes it easy to find the latest up-to-date data and analyze it through an interface that delights both data scientists and casual data consumers.Starting Price: $129 per month -
27
Azure Data Science Virtual Machines
Microsoft
DSVMs are Azure Virtual Machine images, pre-installed, configured and tested with several popular tools that are commonly used for data analytics, machine learning and AI training. Consistent setup across team, promote sharing and collaboration, Azure scale and management, Near-Zero Setup, full cloud-based desktop for data science. Quick, Low friction startup for one to many classroom scenarios and online courses. Ability to run analytics on all Azure hardware configurations with vertical and horizontal scaling. Pay only for what you use, when you use it. Readily available GPU clusters with Deep Learning tools already pre-configured. Examples, templates and sample notebooks built or tested by Microsoft are provided on the VMs to enable easy onboarding to the various tools and capabilities such as Neural Networks (PYTorch, Tensorflow, etc.), Data Wrangling, R, Python, Julia, and SQL Server.Starting Price: $0.005 -
28
Riak TS
Riak
Riak® TS is the only enterprise-grade NoSQL time series database optimized specifically for IoT and Time Series data. It ingests, transforms, stores, and analyzes massive amounts of time series data. Riak TS is engineered to be faster than Cassandra. The Riak TS masterless architecture is designed to read and write data even in the event of hardware failures or network partitions. Data is evenly distributed across the Riak ring and, by default, there are three replicas of your data. This ensures at least one copy of your data is available for read operations. Riak TS is a distributed system with no central coordinator. It is easy to set up and operate. The masterless architecture makes it easy to add and remove nodes from a cluster. The masterless architecture of Riak TS makes it easy to add and remove nodes from your cluster. You can achieve predictable and near-linear scale by adding nodes using commodity hardware.Starting Price: $0 -
29
IBM Analytics Engine provides an architecture for Hadoop clusters that decouples the compute and storage tiers. Instead of a permanent cluster formed of dual-purpose nodes, the Analytics Engine allows users to store data in an object storage layer such as IBM Cloud Object Storage and spins up clusters of computing notes when needed. Separating compute from storage helps to transform the flexibility, scalability and maintainability of big data analytics platforms. Build on an ODPi compliant stack with pioneering data science tools with the broader Apache Hadoop and Apache Spark ecosystem. Define clusters based on your application's requirements. Choose the appropriate software pack, version, and size of the cluster. Use as long as required and delete as soon as an application finishes jobs. Configure clusters with third-party analytics libraries and packages. Deploy workloads from IBM Cloud services like machine learning.Starting Price: $0.014 per hour
-
30
Prophecy
Prophecy
Prophecy enables many more users - including visual ETL developers and Data Analysts. All you need to do is point-and-click and write a few SQL expressions to create your pipelines. As you use the Low-Code designer to build your workflows - you are developing high quality, readable code for Spark and Airflow that is committed to your Git. Prophecy gives you a gem builder - for you to quickly develop and rollout your own Frameworks. Examples are Data Quality, Encryption, new Sources and Targets that extend the built-in ones. Prophecy provides best practices and infrastructure as managed services – making your life and operations simple! With Prophecy, your workflows are high performance and use scale-out performance & scalability of the cloud.Starting Price: $299 per month
