Open Source Python Data Management Systems - Page 18

StreamMine is a distributed event processing (streaming) infrastructure. You can create low-latency, fault-tolerant stream processing functionality with any stream-oriented operators that can be implemented in Python.

idyuts is \"I Dare You to Use This Shell\"; a pre-hibernate approach to replacing an ORM written with jython functors into a pure-Java language command pattern. The \"pipeline codegen artifacts\" are simple IoC templates, and trivial to adapt

This project simulates a multi-agent system (swarm) behavior both graphically and not. The purpose of this project is to research the properties suggested in "stability analysis of swarms" V.Gazi & K.M.Passino. Using the vpython library for 3D modeling

Sweetviz is an open-source Python library that generates beautiful, high-density visualizations to kickstart EDA (Exploratory Data Analysis) with just two lines of code. Output is a fully self-contained HTML application. The system is built around quickly visualizing target values and comparing datasets. Its goal is to help quick analysis of target characteristics, training vs testing data, and other such data characterization tasks. Shows how a target value (e.g. "Survived" in the Titanic dataset) relates to other features. Sweetviz integrates associations for numerical (Pearson's correlation), categorical (uncertainty coefficient) and categorical-numerical (correlation ratio) datatypes seamlessly, to provide maximum information for all data types. Automatically detects numerical, categorical and text features, with optional manual overrides. min/max/range, quartiles, mean, mode, standard deviation, sum, median absolute deviation, coefficient of variation, kurtosis, skewness.

Swiple is an automated data monitoring platform that helps analytics and data engineering teams seamlessly monitor the quality of their data. With automated data analysis and profiling, scheduling and alerting, teams can resolve data quality issues before they impact mission critical resources. Experience hassle-free integration with Swiple's zero-infrastructure and zero-code setup. Seamlessly incorporate data quality checks into your existing workflows without any coding or infrastructure changes, allowing you to focus on what matters most - your data. Save engineers weeks of time generating data quality checks. Swiple analyzes your dataset and builds data quality checks based on what is observed in your data. You just pick the ones you want.

SyncBridge – File Synchronization and Update Utility: SyncBridge is a lightweight file synchronization and deployment utility designed to automate the copying and updating of files from a designated source location to one or multiple destination locations. The application ensures that the latest versions of files are consistently maintained across systems while providing detailed execution logs for auditing and troubleshooting purposes. Key Features: Automated File Copying: Copies files and folders from a specified source directory to a destination directory.Supports both local and network paths. File Update Management Detects new or modified files in the source location. Updates only the changed files at the destination, reducing transfer time and bandwidth usage. CSV-Based Logging: Generates detailed execution logs in CSV format. Benefits: Reduces manual effort in file deployment and updates. Provides traceability through detailed CSV logs.

Metropolis is a visualization tool for TRANSIMS traffic simulation output. It specializes in viewing the dynamic outputs of the micro-simulator, such as vehicle motion and other time-varying data.

The TRANSIMS Studio application is an integrated development environment for the TRansportation ANalysis and SIMulation System (TRANSIMS). Components include a run time environment to execute TRANSIMS in parallel, as well as a full featured GUI.

#FreeUkraine #SaveUkraine #StopRussia #StopPutin #CrimeaIsUkraine #UnitedForUkraine #RussiaInvadedUkraine UI written using wxPython. Allows you, to copy tables between Oracle databases using drag-n-drop interface. AKA filezilla, but for tables, not files.

This is a tool to organize and present complex, interrelated ideas visually in different ways. It aims to be many tools all at the same time -- outliner, mindmapping and concept mapping tool, PIM, project manager and tracker, literate programming editor,

The Taurus Project has *moved* to: https://github.com/taurus-org/taurus This SourceForge page is *outdated* and kept for historical reference only. Taurus is a python framework for control and data acquisition CLIs and GUIs in scientific/industrial environments. It supports multiple control systems or data sources: Tango, EPICS, ... New control system libraries and data sources can be integrated through plugins.

The SummaryWriter class provides a high-level API to create an event file in a given directory and add summaries and events to it. The class updates the file contents asynchronously. This allows a training program to call methods to add data to the file directly from the training loop, without slowing down training. TensorboardX now supports logging directly to Comet. Comet is a free cloud based solution that allows you to automatically track, compare and explain your experiments. It adds a lot of functionality on top of tensorboard such as dataset management, diffing experiments, seeing the code that generated the results and more. Create special chart by collecting charts tags in ‘scalars’. Note that this function can only be called once for each SummaryWriter() object. Because it only provides metadata to tensorboard, the function can be called before or after the training loop.

TensorWatch is an open source debugging and visualization platform created by Microsoft Research to support machine learning, deep learning, and reinforcement learning workflows. It enables developers to observe training behavior in real time through interactive visualizations, primarily within Jupyter Notebook environments. The tool treats most data interactions as streams, allowing flexible routing, storage, and visualization of metrics generated during model training. A distinctive capability is its “lazy logging” mode, which lets users query live training processes without pre-instrumenting all metrics ahead of time. TensorWatch supports multiple chart types and can be extended with custom visualizers and dashboards, making it highly adaptable for research workflows. Overall, the project acts as a powerful observability layer for ML experimentation, helping practitioners diagnose model behavior and compare runs more efficiently.

The CCP1GUI project aims to develop a free, extensible Graphical User Interface to various computational chemistry codes developed by the worldwide academic community, with an emphasis on ab initio Quantum Chemistry codes.

MayaVi is a free, cross platform, easy to use scientific data visualizer. It provides a GUI to ease the visualization process, is written in Python and uses the Visualization Toolkit (VTK) for the graphics.

This software enables easy creation and sharing of district maps online.

Data mines the voting record and other actions of Members of the UK Parliament. Extracts information from the parliament website and stores it in a database. Provides tools to analyse the information, producing statistics and tables about the MPs.

The Zope Weather applet allows you to access weather information as served by the NOAA (http://www.noaa.gov) directly from withing Zope scripting or templating languages. By default it looks similar to the Gnome Weather Applet.

ThemaVis is a Python library for thematic cartography. It allows creating print-quality (as SVG files) and interactive maps (for OpenLayers using the ThemaVis JavaScript library) in a easy and automatic way.

Quick reference for switching between mathematical computation environments for computer algebra, numeric processing and data visualisation. Examples are Matlab, IDL, SPlus, and their open-source counterparts Octave, Scilab, Python+NumPy and R.

Creates interactive plots of data lines over a time scale. Automatic detection of input format and scale will result in instantaneous results without any need for configuration.

This tool generates timing diagrams for documenting hardware design. It reads the description from a text file with a simple syntax. It generates vector graphic (EPS, SVG or EMF format). It can be used in command line mode or with a GUI. It is written in Python and works on any platform.

TransPose is a human pose estimation model based on a CNN feature extractor, a Transformer Encoder, and a prediction head. Given an image, the attention layers built in Transformer can efficiently capture long-range spatial relationships between keypoints and explain what dependencies the predicted keypoints locations highly rely on.

This project will design a CAD engine architecture which allows algorithms to be designed using Python and a robust GUI architecture.

Tributary is a library for constructing dataflow graphs in Python. Unlike many other DAG libraries in Python (airflow, luigi, prefect, dagster, dask, kedro, etc), tributary is not designed with data/etl pipelines or scheduling in mind. Instead, tributary is more similar to libraries like mdf, loman, pyungo, streamz, or pyfunctional, in that it is designed to be used as the implementation for a data model. One such example is the greeks library, which leverages tributary to build data models for options pricing.