JetBrains DataSpell
Switch between command and editor modes with a single keystroke. Navigate over cells with arrow keys. Use all of the standard Jupyter shortcuts. Enjoy fully interactive outputs – right under the cell. When editing code cells, enjoy smart code completion, on-the-fly error checking and quick-fixes, easy navigation, and much more. Work with local Jupyter notebooks or connect easily to remote Jupyter, JupyterHub, or JupyterLab servers right from the IDE. Run Python scripts or arbitrary expressions interactively in a Python Console. See the outputs and the state of variables in real-time. Split Python scripts into code cells with the #%% separator and run them individually as you would in a Jupyter notebook. Browse DataFrames and visualizations right in place via interactive controls. All popular Python scientific libraries are supported, including Plotly, Bokeh, Altair, ipywidgets, and others.
Learn more
PySpark
PySpark is an interface for Apache Spark in Python. It not only allows you to write Spark applications using Python APIs, but also provides the PySpark shell for interactively analyzing your data in a distributed environment. PySpark supports most of Spark’s features such as Spark SQL, DataFrame, Streaming, MLlib (Machine Learning) and Spark Core. Spark SQL is a Spark module for structured data processing. It provides a programming abstraction called DataFrame and can also act as distributed SQL query engine. Running on top of Spark, the streaming feature in Apache Spark enables powerful interactive and analytical applications across both streaming and historical data, while inheriting Spark’s ease of use and fault tolerance characteristics.
Learn more
Azure Data Science Virtual Machines
DSVMs are Azure Virtual Machine images, pre-installed, configured and tested with several popular tools that are commonly used for data analytics, machine learning and AI training. Consistent setup across team, promote sharing and collaboration, Azure scale and management, Near-Zero Setup, full cloud-based desktop for data science. Quick, Low friction startup for one to many classroom scenarios and online courses. Ability to run analytics on all Azure hardware configurations with vertical and horizontal scaling. Pay only for what you use, when you use it. Readily available GPU clusters with Deep Learning tools already pre-configured. Examples, templates and sample notebooks built or tested by Microsoft are provided on the VMs to enable easy onboarding to the various tools and capabilities such as Neural Networks (PYTorch, Tensorflow, etc.), Data Wrangling, R, Python, Julia, and SQL Server.
Learn more
Composable DataOps Platform
Composable is an enterprise-grade DataOps platform built for business users that want to architect data intelligence solutions and deliver operational data-driven products leveraging disparate data sources, live feeds, and event data regardless of the format or structure of the data. With a modern, intuitive dataflow visual designer, built-in services to facilitate data engineering, and a composable architecture that enables abstraction and integration of any software or analytical approach, Composable is the leading integrated development environment to discover, manage, transform and analyze enterprise data.
Learn more
