Search Results for "spark engine"
Sort By:
Showing 23 open source projects for "spark engine"
View related business solutions-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
Enterprise-grade ITSM, for every businessFreshservice is an intuitive, AI-powered platform that helps IT, operations, and business teams deliver exceptional service without the usual complexity. Automate repetitive tasks, resolve issues faster, and provide seamless support across the organization. From managing incidents and assets to driving smarter decisions, Freshservice makes it easy to stay efficient and scale with confidence.
-
1
Apache Spark
A unified analytics engine for large-scale data processing
Apache Spark is a unified engine for large-scale data processing, offering APIs for batch jobs, streaming, machine learning, and graph computation. It builds on resilient distributed datasets (RDDs) and the newer DataFrame/Dataset abstractions to provide fault-tolerant, in-memory computation across clusters. Spark’s execution engine handles scheduling, shuffles, caching, and data locality so users can focus on transformations rather than infrastructure plumbing. ... -
2
SageMaker Spark Container
Docker image used to run data processing workloads
Apache Spark™ is a unified analytics engine for large-scale data processing. It provides high-level APIs in Scala, Java, Python, and R, and an optimized engine that supports general computation graphs for data analysis. It also supports a rich set of higher-level tools including Spark SQL for SQL and DataFrames, MLlib for machine learning, GraphX for graph processing, and Structured Streaming for stream processing. -
3
.NET for Apache Spark
A free, open-source, and cross-platform big data analytics framework
.NET for Apache Spark provides high-performance APIs for using Apache Spark from C# and F#. With these .NET APIs, you can access the most popular Dataframe and SparkSQL aspects of Apache Spark, for working with structured data, and Spark Structured Streaming, for working with streaming data. .NET for Apache Spark is compliant with .NET Standard - a formal specification of .NET APIs that are common across .NET implementations. This means you can use .NET for Apache Spark anywhere you write... -
4
Sail
A drop-in Apache Spark replacement written in Rust
Sail is an open-source distributed computation framework designed to unify batch processing, stream processing, and AI workloads into a single, high-performance engine. It is built entirely in Rust, eliminating JVM overhead and enabling predictable performance, fast startup times, and improved memory safety compared to traditional big data frameworks. Sail is compatible with the Spark Connect protocol, which means existing Spark SQL and DataFrame workloads can run without code changes, making adoption seamless for teams already using Spark-based pipelines. ... -
Go From AI Idea to AI App FastAccess Gemini 3 and 200+ models. Build chatbots, agents, or custom models with built-in monitoring and scaling.
-
5
Bytewax
Python Stream Processing
Bytewax is a Python framework that simplifies event and stream processing. Because Bytewax couples the stream and event processing capabilities of Flink, Spark, and Kafka Streams with the friendly and familiar interface of Python, you can re-use the Python libraries you already know and love. Connect data sources, run stateful transformations, and write to various downstream systems with built-in connectors or existing Python libraries. Bytewax is a Python framework and Rust distributed processing engine that uses a dataflow computational model to provide parallelizable stream processing and event processing capabilities similar to Flink, Spark, and Kafka Streams. ... -
6
Genie
Distributed Big Data Orchestration Service
Genie is a completely open source distributed job orchestration engine developed by Netflix. Genie provides REST-ful APIs to run a variety of big data jobs like Hadoop, Pig, Hive, Spark, Presto, Sqoop and more. It also provides APIs for managing the metadata of many distributed processing clusters and the commands and applications which run on them. -
7
Smile
Statistical machine intelligence and learning engine
Smile is a fast and comprehensive machine learning engine. With advanced data structures and algorithms, Smile delivers the state-of-art performance. Compared to this third-party benchmark, Smile outperforms R, Python, Spark, H2O, xgboost significantly. Smile is a couple of times faster than the closest competitor. The memory usage is also very efficient. If we can train advanced machine learning models on a PC, why buy a cluster? -
8
Smallpond
A lightweight data processing framework built on DuckDB and 3FS
smallpond is a lightweight distributed data processing framework built by DeepSeek, designed to scale DuckDB workloads over clusters using their 3FS (Fire-Flyer File System) backend. The idea is to preserve DuckDB’s fast analytics engine but lift it from single-node to multi-node settings, giving you the ability to operate on large datasets (e.g. petabyte scale) without moving to a heavyweight system like Spark. Users write Python-like code (via DataFrame APIs or SQL strings) to express their transformations; behind the scenes, tasks are scheduled (often via Ray) and pushed into DuckDB instances operating on partitioned data. ... -
9
Speedb
A RocksDB compliant high performance scalable embedded key-value store
...By seamlessly integrating Speedb's advanced key-value storage engine with your projects, you'll experience immediate relief. -
Forever Free Full-Stack Observability | Grafana CloudBuilt on open standards like Prometheus and OpenTelemetry, Grafana Cloud includes Kubernetes Monitoring, Application Observability, Incident Response, plus the AI-powered Grafana Assistant. Get started with our generous free tier today.
-
10
WTFJS
A list of funny and tricky JavaScript examples
...Teachers, interviewers, and learners use it to spark discussion and deepen understanding of JavaScript’s semantics. -
11
CoolplaySpark
Spark Cool Play: Spark source code analysis, Spark class library, etc.
CoolplaySpark is a learning and practice repository designed to help users understand and work with Apache Spark. It serves as a companion resource for the book 深入理解Spark核心思想与源码分析 (In-Depth Understanding of Spark’s Core Concepts and Source Code Analysis). The project contains annotated examples, explanations, and exercises that guide learners through Spark’s architecture, execution model, and source code internals. It is particularly valuable for developers who want to strengthen their understanding of Spark by not only using it as a data processing engine but also exploring how its internals function. ... -
12
Automobile Engineering
Get more animated videos of automobile Engineering through Magic Marks
...The distributor consists of a rotor that rotates inside the distributor cap and opens the contact breaker point. This causes the high tension current to flow to the spark plug. 6. A spark is generated in the engine cylinder by the current upon reaching the spark plug which facilitates the combustion of fuel and air. -
13
Spark Notebook
Interactive and Reactive Data Science using Scala and Spark
Spark Notebook is an interactive web-based computational notebook designed to make working with Apache Spark more productive, exploratory, and expressive. It allows developers, data scientists, and analysts to write, run, and visualize Spark code in cells that support multiple languages such as Scala, Python, and SQL, all within the same notebook. -
14
Apache PredictionIO
Machine learning server for developers and ML engineers
Apache PredictionIO® is an open source Machine Learning Server built on top of a state-of-the-art open source stack for developers and data scientists to create predictive engines for any machine learning task. Quickly build and deploy an engine as a web service on production with customizable templates; respond to dynamic queries in real-time once deployed as a web service; evaluate and tune multiple engine variants systematically; unify data from multiple platforms in batch or in real-time for comprehensive predictive analytics; speed up machine learning modeling with systematic processes and pre-built evaluation measures; support machine learning and data processing libraries such as Spark MLLib and OpenNLP; implement your own machine learning models and seamlessly incorporate them into your engine; simplify data infrastructure management. -
15
PredictionIO
Machine learning server for building predictive applications
Apache PredictionIO is an open-source machine learning server designed to simplify the process of building and deploying predictive engines. It offers a scalable infrastructure with support for multiple ML algorithms, event data collection, and deployment workflows. Developers can use templates or build custom engines, making it a flexible solution for integrating machine learning into applications. -
16
Spark
Windows Desktop Search
This is a prototype for Desktop Search Engine for Windows -
17
SPARK is an advanced particle engine written in C++ It is designed to be generic and to be integrated in any rendering engine. Some rendering modules have already been designed for OpenGL, Irrlicht and SFML
-
18
ParabolaEngine is a 2D Game Engine under zlib license. It uses a lot of middleware to provide a lot of features that would be impossible otherwise. http://parabolaengine.comlu.com/ Active developed, in early stages. Free to use for all purposes.
-
19
Very simple and stable C++ game framework. This is the base of a new game engine based on the irrlicht rendering engine. Every feature can be easily removed if unwanted. Look features at project homepage. IrrSolid does not work on 64 bit systems
-
20
Shoot em' up/RACE 2D Game Programmed in C++ with SFML, box2D and SPARK.
-
21
This is the Spark Engine. Right now I'm working on making the Engine before I make the model/world editor. And from there, I intend to make a flow-chart logic editor.
-
22
The EFI332 project is a public domain development with the goal of developing a complete engine control system including fuel injection and spark control. This SourceForge based project is a companion to EFI332 to help focus the software development.
-
23
Thirst
3d Arcade Space Game.
Currently project is not ready for public use. I'd say more: I'm starting my first project. The project uses: SPARK particle engine Irrlicht engine Bullet physics engine SDL FTGL SDL Zlib Freetype Compiler: GNU GCC IDE: Code::Blocks
- Previous
- You're on page 1
- Next
