A Julia interface to Apache Spark. Spark.jl provides an interface to Apache Spark™ platform, including SQL / DataFrame and Structured Streaming. It closely follows the PySpark API, making it easy to translate existing Python code to Julia. Spark.jl supports multiple cluster types (in client mode), and can be considered as an analog to PySpark or RSpark within the Julia ecosystem. It supports running within on-premise installations, as well as hosted instances such as Amazon EMR and Azure HDInsight.
Features
- Documentation available
- Spark.jl provides an interface to Apache Spark™ platform
- SQL / DataFrame and Structured Streaming
- It closely follows the PySpark API
- Easy to translate existing Python code to Julia
- Spark.jl supports multiple cluster types
Categories
Data VisualizationLicense
MIT LicenseFollow Spark.jl
You Might Also Like
Free CRM Software With Something for Everyone
Think CRM software is just about contact management? Think again. HubSpot CRM has free tools for everyone on your team, and it’s 100% free. Here’s how our free CRM solution makes your job easier.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of Spark.jl!