Search Results for "data capture framework" - Page 4
Sort By:
Showing 301 open source projects for "data capture framework"
View related business solutions-
Custom VMs From 1 to 96 vCPUs With 99.95% UptimeLive migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
-
99.99% Uptime for MySQL and PostgreSQL DatabasesCloud SQL Enterprise Plus delivers near-zero downtime with 35 days of point-in-time recovery. Supports MySQL, PostgreSQL, and SQL Server.
-
1
MOA - Massive Online Analysis
Big Data Stream Analytics Framework.
A framework for learning from a continuous supply of examples, a data stream. Includes classification, regression, clustering, outlier detection and recommender systems. Related to the WEKA project, also written in Java, while scaling to adaptive large scale machine learning. -
2
data-diff
Efficiently diff rows across two different databases
...Replicating data at scale, across hundreds of tables, with low latency and at a reasonable infrastructure cost is a hard problem, and most data teams we’ve talked to, have faced data quality issues in their replication processes. The hard truth is that the quality of the replication is the quality of the data. Since copying entire datasets in batch is often infeasible at the modern data scale, businesses rely on the Change Data Capture (CDC) approach of replicating data using a continuous stream of updates. -
3
SQL*Plus Commander
Text-based user interface to query data on Oracle DB in a smart way
SQL*Plus Commander is Text-based user interface (TUI) / framework to query data on Oracle DB in a smart way. It consists in a fully customizable script shell for bash and ksh. It executes custom queries or procedures on DB with SQLPlus for Oracle. The results of queries can be browsed in a colorful text interface resulting data from a query can be selected and passed dinamically as parameters for others queries or procedures It may be useful for people who runs frequently a limited number of query and uses the results as parameters for other queries. ... -
4
elder-pt
data flow framework for data analysis applications
...Elder-Pt is the prototype of a framework, that facilitates the task of event-by-event data analysis. It provides: 1) a parser for textual graph description 2) an API to write processing nodes that will be used in the graph description for the graph 3) a set of frequently used processing nodes -
Our Free Plans just got better! | Auth0You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
-
5
Avogadro
An intuitive molecular editor and visualization tool
Avogadro is an advanced molecular editor designed for cross-platform use in computational chemistry, molecular modeling, bioinformatics, materials science and related areas. It offers a flexible rendering framework and a powerful plugin architecture. -
6
SMILI
Scientific Visualisation Made Easy
The Simple Medical Imaging Library Interface (SMILI), pronounced 'smilie', is an open-source, light-weight and easy-to-use medical imaging viewer and library for all major operating systems. The main sMILX application features for viewing n-D images, vector images, DICOMs, anonymizing, shape analysis and models/surfaces with easy drag and drop functions. It also features a number of standard processing algorithms for smoothing, thresholding, masking etc. images and models, both with... -
7
Fondant
Production-ready data processing made easy and shareable
Fondant is a modular, pipeline-based framework designed to simplify the preparation of large-scale datasets for training machine learning models, especially foundation models. It offers an end-to-end system for ingesting raw data, applying transformations, filtering, and formatting outputs—all while remaining scalable and traceable. Fondant is designed with reproducibility in mind and supports containerized steps using Docker, making it easy to share and reuse data processing components. ... -
8
MentDB Projects
Generalized Interoperability and Strong AI
MentDB is an open-source platform driving research into next-generation AI and universal data exchange. Our architecture is built around the revolutionary Mentalese Query Language (MQL). MentDB Weak (Generalized Interoperability): A unified data layer enabling seamless data exchange and application integration (SOA, ETL, Data Quality). We eliminate data silos through a single, generalized data language. MentDB Strong (Strong AI / AGI): The framework for exploring and building Machine Consciousness, free will, and advanced ethical reasoning systems. ... -
9
Uranie
Uranie is CEA's uncertainty analysis platform, based on ROOT
Uranie is a sensitivity and uncertainty analysis plateform based on the ROOT framework (http://root.cern.ch) . It is developed at CEA, the French Atomic Energy Commission (http://www.cea.fr). It provides various tools for: - data analysis - sampling - statistical modeling - optimisation - sensitivity analysis - uncertainty analysis - running code on high performance computers - etc. Thanks to ROOT, it is easily scriptable in CINT (c++ like syntax) and Python. ... -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
10
OpenPTV
OpenPTV
OpenPTV is an abbreviation of the open source particle tracking velocimetry. This is an open source framework, developed jointly by academic institutions, that deals primarily with the three-dimensional particle tracking experiments in complex and turbulent flows. More about 3D-PTV on Wikipedia and links from our website: http://www.openptv.net -
11
dbt-re-data
re_data - fix data issues before your users & CEO would discover them
re_data is an open-source data reliability framework for the modern data stack. Currently, re_data focuses on observing the dbt project (together with underlaying data warehouse - Postgres, BigQuery, Snowflake, Redshift). Data transformations in re_data are implemented and exposed as models & macros in this dbt package. Gather all relevant outputs about your data in one place using our cloud. -
12
FlowViewer
FlowViewer is a web-based netflow data analysis tool.
FlowViewer provides a convenient web-based user interface to Mark Fullmer’s flow-tools suite and CMU's netflow data capture/analyzer, SiLK. The inclusion of the underlying SiLK tool set enables FlowViewer users to continue to use the tool with the newer IPFIX netflow data protocol, which includes support for IPv6 and Cisco's v9 and FNF netflow. FlowViewer has been developed for NASA’s Earth Sciences Data and Information System (ESDIS) networks, and credit goes to NASA for their usual outstanding support of innovation. ... -
13
re_data
re_data - fix data issues before your users & CEO would discover them
re_data is an open-source data reliability framework for the modern data stack. Currently, re_data focuses on observing the dbt project (together with underlying data warehouse - Postgres, BigQuery, Snowflake, Redshift). Gather all relevant outputs about your data in one place using our cloud. Invite your team and debug it easily from there. Go back in time, and see your past metadata. -
14
Mara Pipelines
A lightweight opinionated ETL framework, halfway between plain scripts
This package contains a lightweight data transformation framework with a focus on transparency and complexity reduction. Data integration pipelines as code: pipelines, tasks and commands are created using declarative Python code. PostgreSQL as a data processing engine. Extensive web ui. The web browser as the main tool for inspecting, running and debugging pipelines. GNU make semantics. -
15
Rawgraphs app
A web interface to create custom vector-based visualizations
Inspired by and built on top of open-source projects. RAWGraphs is open to the community for contributions. Almost 30 visual models to visualize quantities, hierarchies, and time series and find insights in your data. Even though RAWGraphs is a web app, the data you insert will be processed only by your web browser. Save your project, or export it as a vector or raster image. Edit it within your favorite software. RAWGraphs is an open source data visualization framework built with the goal of making the visual representation of complex data easy for everyone. ... -
16
TensorFlow.NET
.NET Standard bindings for Google's TensorFlow for developing models
...It aims to implement the complete Tensorflow API in C# which allows .NET developers to develop, train and deploy Machine Learning models with the cross-platform .NET Standard framework. TensorFlow.NET has built-in Keras high-level interface and is released as an independent package TensorFlow.Keras. SciSharp STACK's mission is to bring popular data science technology into the .NET world and to provide .NET developers with a powerful Machine Learning tool set without reinventing the wheel. Since the APIs are kept as similar as possible you can immediately adapt any existing TensorFlow code in C# or F# with a zero learning curve. ... -
17
NBi
NBi is a testing framework (add-on to NUnit)
NBi is a testing framework (add-on to NUnit) for Business Intelligence. It supports most of the relational databases (SQL server, MySQL, postgreSQL ...) and OLAP platforms (Analysis Services, Mondrian ...) but also ETL and reporting components (Microsoft technologies). The main goal of this framework is to let users create tests with a declarative approach based on an Xml syntax. By the means of NBi, you don't need to develop C# code to specify your tests! Either, you don't need Visual... -
18
AbstractFFTs.jl
A Julia framework for implementing FFTs
A general framework for fast Fourier transforms (FFTs) in Julia. This package is mainly not intended to be used directly. Instead, developers of packages that implement FFTs (such as FFTW.jl or FastTransforms.jl) extend the types/functions defined in AbstractFFTs. This allows multiple FFT packages to co-exist with the same underlying fft(x) and plan_fft(x) interface. -
19
Kinetic.jl
Universal modeling and simulation of fluid mechanics upon ML
Kinetic is a computational fluid dynamics toolbox written in Julia. It aims to furnish efficient modeling and simulation methodologies for fluid dynamics, augmented by the power of machine learning. Based on differentiable programming, mechanical and neural network models are fused and solved in a unified framework. Simultaneous 1-3 dimensional numerical simulations can be performed on CPUs and GPUs. -
20
ScikitLearn.jl
Julia implementation of the scikit-learn API
The scikit-learn Python library has proven very popular with machine learning researchers and data scientists in the last five years. It provides a uniform interface for training and using models, as well as a set of tools for chaining (pipelines), evaluating, and tuning model hyperparameters. ScikitLearn.jl brings these capabilities to Julia. Its primary goal is to integrate both Julia- and Python-defined models together into the scikit-learn framework. -
21
Weave
Scientific reports/literate programming for Julia
Weave is a scientific report generator/literate programming tool for the Julia programming language. It resembles Pweave, knitr, R Markdown, and Sweave. You can write your documentation and code in an input document using Markdown, Noweb or ordinal Julia script syntax, and then use the weave function to execute code and generate an output document while capturing results and figures. Supports various output document formats: HTML, PDF, GitHub markdown, Jupyter Notebook, MultiMarkdown,... -
22
Amazon Kinesis Flink Connectors
Contains various Apache Flink connectors to connect to AWS data
This library contains various Apache Flink connectors to connect to AWS data sources and sinks. This repository contains various Apache Flink connectors to connect to AWS Kinesis data sources and sinks. Flink maintain backwards compatibility for the Sink interface used by the Firehose Producer. This project is compatible with Flink 1.x, there is no guarantee it will support Flink 2.x should it release in the future. -
23
SpecTcl is a Tcl/Tk based histogrammer suitable for analysis of nuclear physics data. SpecTcl is relatively easy to learn, and is based on top of a very open C++ histogramming class framework. SpecTcl has been developed under NSF grant PHY-9528844 and DOE grant DE-SC0000661 Note that as of July 2023, all future development and release packages will be occur at https://github.com/FRIBDAQ/SpecTcl
-
24
SQLBucket
Lightweight library to write, orchestrate and test your SQL ETL
SQLBucket is a lightweight framework to help write, orchestrate and validate SQL data pipelines. It gives the possibility to set variables and introduces some control flow using the fantastic Jinja2 library. It also implements a very simplistic unit and integration test framework where you can validate the results of your ETL in the form of SQL checks. With SQLBucket, you can apply TDD principles when writing data pipelines. -
25
Starlight.jl
A greedy game engine for greedy programmers
Welcome to the documentation for Starlight.jl, a greedy application framework for greedy developers. Its primary use case is video games, but the power of Julia, SDL2, Vulkan, and the Bullet Physics SDK can be leveraged to make just about anything you want. With a focus on flexibility and code quality, Starlight aims to be such a framework. It includes a suite of components and integrations that make it particuarly well-suited for video games, so it is not a stretch to call it a "game...
