Open Source Python Data Management Systems - Page 21

A Python package for geospatial analysis and interactive mapping in a Jupyter environment. Leafmap is a Python package for interactive mapping and geospatial analysis with minimal coding in a Jupyter environment. It is a spin-off project of the geemap Python package, which was designed specifically to work with Google Earth Engine (GEE). However, not everyone in the geospatial community has access to the GEE cloud computing platform. Leafmap is designed to fill this gap for non-GEE users. It is a free and open-source Python package that enables users to analyze and visualize geospatial data with minimal coding in a Jupyter environment, such as Google Colab, Jupyter Notebook, and JupyterLab. Leafmap is built upon several open-source packages, such as folium and ipyleaflet (for creating interactive maps), WhiteboxTools and whiteboxgui (for analyzing geospatial data), and ipywidgets (for designing interactive graphical user interface [GUI]).

Python software package for 3D tracking of leg joints in walking insects. Published as Bender et al., PLoS ONE, 2010 (http://dx.doi.org/10.1371/journal.pone.0013617)

L(atex)equation aims to be the simplest latex to bitmap converter there is. Its goals are: simple gui, simple install, mac + windows + ubuntu binaries and it just should work.

TODO

marimo is an open-source reactive notebook for Python, reproducible, git-friendly, executable as a script, and shareable as an app. marimo notebooks are reproducible, extremely interactive, designed for collaboration (git-friendly!), deployable as scripts or apps, and fit for modern Pythonista. Run one cell and marimo reacts by automatically running affected cells, eliminating the error-prone chore of managing the notebook state. marimo's reactive UI elements, like data frame GUIs and plots, make working with data feel refreshingly fast, futuristic, and intuitive. Version with git, run as Python scripts, import symbols from a notebook into other notebooks or Python files, and lint or format with your favorite tools. You'll always be able to reproduce your collaborators' results. Notebooks are executed in a deterministic order, with no hidden state, delete a cell and marimo deletes its variables while updating affected cells.

miepython is a pure Python module to calculate light scattering for non-absorbing, partially-absorbing, or perfectly-conducting spheres. Mie theory is used, following the procedure described by Wiscombe. This code has been validated against his results. This code provides functions for calculating the extinction efficiency, scattering efficiency, backscattering, and scattering asymmetry. Moreover, a set of angles can be given to calculate the scattering for a sphere at each of those angles.

Messy datasets? Missing values? missingno provides a small toolset of flexible and easy-to-use missing data visualizations and utilities that allows you to get a quick visual summary of the completeness (or lack thereof) of your dataset. Just pip install missingno to get started. This quickstart uses a sample of the NYPD Motor Vehicle Collisions Dataset dataset. The msno.matrix nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion. At a glance, date, time, the distribution of injuries, and the contribution factor of the first vehicle appear to be completely populated, while geographic information seems mostly complete, but spottier. The sparkline at right summarizes the general shape of the data completeness and points out the rows with the maximum and minimum nullity in the dataset. This visualization will comfortably accommodate up to 50 labelled variables.

nb-clean cleans Jupyter notebooks of cell execution counts, metadata, outputs, and (optionally) empty cells, preparing them for committing to version control. It provides both a Git filter and pre-commit hook to automatically clean notebooks before they're staged, and can also be used with other version control systems, as a command line tool, and as a Python library. It can determine if a notebook is clean or not, which can be used as a check in your continuous integration pipelines. nb-clean can also be used as a pre-commit hook. You may prefer this to the Git filter if your project already uses the pre-commit framework. Note that the Git filter and pre-commit hook work differently, with different effects on your working directory. The pre-commit hook operates on the notebook on disk, cleaning the copy in your working directory. The Git filter cleans notebooks as they are added to the index, leaving the copy in your working directory dirty.

NCVTK: A VTK-based tool to visualize data stored in the NetCDF file format.

nonechucks is a library that provides wrappers for PyTorch's datasets, samplers and transforms to allow for dropping unwanted or invalid samples dynamically. What if you have a dataset of 1000s of images, out of which a few dozen images are unreadable because the image files are corrupted? Or what if your dataset is a folder full of scanned PDFs that you have to OCRize, and then run a language detector on the resulting text, because you want only the ones that are in English? Or maybe you have an AlternateIndexSampler, and you want to be able to move to dataset[6] after dataset[4] fails while attempting to load! PyTorch's data processing module expects you to rid your dataset of any unwanted or invalid samples before you feed them into its pipeline, and provides no easy way to define a "fallback policy" in case such samples are encountered during dataset iteration.

ODD Collector is a lightweight service that gathers metadata from all your data sources. Push-client is a provider which sends information directly to the central repository of the Platform. ODDRN (Open Data Discovery Resource Name) is a unique resource name that identifies entities such as data sources, data entities, dataset fields etc. It is used to build lineage and update metadata.

ODD Collector GCP is a lightweight service which gathers metadata from all your Google Cloud Platform data sources.

This toolbox generates automatically a vtk-visualization for an ode (Open Dynamics Engine) simulation under Python. You only have to define the simulation space and world and forward these entities to the visualization. That's all... Install also via pip possible: pip install odeViz

A tool for autonomous and virtual topical data integration using the focused web-harvesting method.

openSim is a software platform for the creation, simulation and visualization of system dynamics models.

Real-time data visualization. Graphically view your data as it's being generated. Peakster is a very intuitive GUI written entirely in Python, which monitors data at regular intervals and uses gnuplot to render 2D, 3D and superimposed plots.

This software is being created to work with FLEXPART and other atmospheric transport model ouput. FLEXPART is a Lagrangian particle dispersion model written by Andreas Stohl. It is in active development at NILU and by Sabine Eckhardt, John Burkhart and numerous other research groups worldwide. For more information on FLEXPART visit the homepage Contact A maillist has been set up for users at sourceforge. Please direct inquiries via the pflexible_maillist Direct inquiries may be sent to:: John F Burkhart, University of Oslo [john.burkhart](mailto://john.burkhart@geo.uio.no) Get the Code: BitBucket Clone the bitbucket repository: %hg clone https://bitbucket.org/jfburkhart/pflexible pflexible

Portable Plot is a pure ansi/iso c++ plot library that makes the construction of native plot widgets easy.

A GPR processer and viewer written in Python!

pyastrolib is a python library providing professional astronomers a robust set of tools for astronomical data analysis. This project will provide all the functionality as NASA's IDL Astronomy User's Library in addition to other planned features.

pyEBSD-GUI is a free software to post-process Electron Backscatter Diffraction (EBSD) data, inducing IPF mapping, image quality mapping, phase mapping etc, plotting pole figure, data segmentation, statistic analysis of the misorientation distribution etc. The software is written by python, and it supports both script and graphic user interface (GUI). pyEBSD V1.0 will be released soon.

pyLastFM graph is commandline tool for creating a nice looking graph time graph from Last.fm profile data. It uses the audioscrobbler.net XML interface and can create very high resolution output images.

pyFormex is a program for generating, transforming and manipulating large geometrical models of 3D structures by sequences of mathematical operations.

pyMantis is a data-management system for (systems) biology build on the web2py framework. It features: tree based file explorer, relational db table wizzard with automated creation of user interfaces, internal and external access management, wiki, ..