Search Results for "data quality cleansing"
Sort By:
Showing 95 open source projects for "data quality cleansing"
View related business solutions-
Veeam Data Platform v13.1Try Veeam Data Platform today. Experience the unified platform that's secure by design, portable by default, and proven to recover clean, fast, and anywhere.
-
Fully Managed MySQL, PostgreSQL, and SQL ServerCloud SQL handles your database ops end to end, so you can focus on your app.
-
1
lakeFS
lakeFS - Git-like capabilities for your object storage
...Easily Collaborate on production data with your team. Automate data quality checks within data pipelines. -
2
BFG Repo-Cleaner
Remove large or troublesome blobs
The BFG is a simpler, faster alternative to git-filter-branch for cleansing bad data out of your Git repository history. You can use it for removing crazy big files, and for removing passwords, credentials and other private data. The git-filter-branch command is enormously powerful and can do things that the BFG can't, but the BFG is much better for the tasks above, because is faster and simpler. The BFG isn't particularily clever, but is focused on making the above tasks easy. ... -
3
Arize Phoenix
Uncover insights, surface problems, monitor, and fine tune your LLM
Phoenix provides ML insights at lightning speed with zero-config observability for model drift, performance, and data quality. Phoenix is an Open Source ML Observability library designed for the Notebook. The toolset is designed to ingest model inference data for LLMs, CV, NLP and tabular datasets. It allows Data Scientists to quickly visualize their model data, monitor performance, track down issues & insights, and easily export to improve. Deep Learning Models (CV, LLM, and Generative) are an amazing technology that will power many of future ML use cases. ... -
4
ODD Platform
First open-source data discovery and observability platform
...Know the impact of each code change with automatic testing. Enjoy lineage and alerts powered with data quality information. -
Build Securely on AWS with Proven FrameworksMoving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.
-
5
Dagster
An orchestration platform for the development, production
Dagster is an orchestration platform for the development, production, and observation of data assets. Dagster as a productivity platform: With Dagster, you can focus on running tasks, or you can identify the key assets you need to create using a declarative approach. Embrace CI/CD best practices from the get-go: build reusable components, spot data quality issues, and flag bugs early. Dagster as a robust orchestration engine: Put your pipelines into production with a robust multi-tenant, multi-tool engine that scales technically and organizationally. ... -
6
SDGym
Benchmarking synthetic data generation methods
...You also customize the process to include your own work. Select any of the publicly available datasets from the SDV project, or input your own data. Choose from any of the SDV synthesizers and baselines. Or write your own custom machine learning model. In addition to performance and memory usage, you can also measure synthetic data quality and privacy through a variety of metrics. Install SDGym using pip or conda. We recommend using a virtual environment to avoid conflicts with other software on your device. -
7
syslog-ng
Log management solution that improves the performance of SIEM
syslog-ng is the log management solution that improves the performance of your SIEM solution by reducing the amount and improving the quality of data feeding your SIEM. With syslog-ng Store Box, you can find the answer. Search billions of logs in seconds using full text queries with Boolean operators to pinpoint critical logs. syslog-ng Store Box provides secure, tamper-proof storage and custom reporting to demonstrate compliance. syslog-ng can deliver data from a wide variety of sources to Hadoop, Elasticsearch, MongoDB, and Kafka as well as many others. syslog-ng flexibly routes log data from X sources to Y destinations. ... -
8
AWS IoT FleetWise Edge
AWS IoT FleetWise Edge Agent
...Improve electric vehicle (EV) battery range estimates with crowdsourced environmental data, such as weather and driving conditions, from nearby vehicles. Collect select data from nearby vehicles and use it to notify drivers of changing road conditions, such as lane closures or construction. Use near real-time data to proactively detect and mitigate fleet-wide quality issues. -
9
OpenTelemetry
OpenTelemetry Go API and SDK
OpenTelemetry-Go is the Go implementation of OpenTelemetry. It provides a set of APIs to directly measure the performance and behavior of your software and send this data to observability platforms. High-quality, ubiquitous, and portable telemetry to enable effective observability. OpenTelemetry is a collection of APIs, SDKs, and tools. Use it to instrument, generate, collect, and export telemetry data (metrics, logs, and traces) to help you analyze your software’s performance and behavior. -
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
10
Elementary
Open-source data observability for analytics engineers
Elementary is an open-source data observability solution for data & analytics engineers. Monitor your dbt project and data in minutes, and be the first to know of data issues. Gain immediate visibility, detect data issues, send actionable alerts, and understand the impact and root cause. Generate a data observability report, host it or share with your team. Monitoring of data quality metrics, freshness, volume and schema changes, including anomaly detection. ... -
11
AdGuard Home
Network-wide ads and trackers blocking DNS server
...This includes video ads and ads in your favorite apps, browsers, games, and on any website you can imagine. Dozens of ad filters are available to you and are updated on a regular basis, guaranteeing the best filtering quality. Protecting your personal data is our top priority. With AdGuard, you and your sensitive data will be safe from any online tracker and analytics system that may attempt to steal your data while surfing the web. Use the Family protection mode to block access to all websites with adult content and enforce safe search in the browser, in addition to the regular perks of ad blocking and browsing security. -
12
Grafana
Leading open-source visualization and observability platform
Grafana OSS is the leading open-source platform for visualization and observability. It enables teams to query, visualize, alert on, and explore telemetry data from multiple sources in a single interface. With support for 100+ data source plugins—including Prometheus, Loki, Elasticsearch, InfluxDB, SQL/NoSQL databases, and OpenTelemetry—Grafana helps teams correlate metrics, logs, and traces across applications and infrastructure. Users can build interactive dashboards with rich... -
13
FanCtrl
FanCtrl allows you to automatically control the fan speed
...The project supports a range of control backends and integrations, including motherboard fan headers and several popular cooling ecosystems, and it can also pull sensor data from common monitoring tools so your fan logic can react to the readings you trust. A core concept is “auto fan control” profiles where you pick a target temperature sensor, select which fans should follow it, and then shape the curve via a graph-like interface. It also includes quality-of-life options like renaming items, choosing units (including Fahrenheit), and starting minimized for a set-it-and-forget-it setup. -
14
Helicone
Open source LLM-Observability Platform for Developers
Open source LLM-Observability Platform for Developers. One-line integration for monitoring, metrics, evals, agent tracing, prompt management, playground, etc. Supports OpenAI SDK, Vercel AI SDK, Anthropic SDK, LiteLLM, LLamaIndex, LangChain, and more. -
15
Inbucket
Disposable webmail server (similar to Mailinator) with built in SMTP
Inbucket is an email testing application; it will accept messages from any email address and make them available to view via a web interface. When you need to test your webapp's outbound emails with Mailinator but are stuck behind a firewall, Inbucket provides the solution. It allows you to keep your new application development secret until it's time to release it. Inbucket is ideal for validating that emails go out as part of your integration test suite, sending links to coworkers to... -
16
Glazier
A tool for automating the installation of Windows OS
...It streamlines the entire Windows imaging process by booting systems into the Windows Preinstallation Environment (WinPE), retrieving installation instructions from a web server, and automatically applying operating systems, software, and configurations. The tool is fully text-based and code-driven, with configurations written in YAML, allowing teams to leverage source control for versioning, collaboration, and quality assurance. By distributing installation data via HTTPS, Glazier ensures scalability and flexibility, supporting both simple local servers and large-scale cloud-based deployments. Its extensibility makes it easy for administrators to create custom actions using Python or PowerShell, enabling tailored automation for diverse enterprise environments. ... -
17
MentDB Projects
Generalized Interoperability and Strong AI
MentDB is an open-source platform driving research into next-generation AI and universal data exchange. Our architecture is built around the revolutionary Mentalese Query Language (MQL). MentDB Weak (Generalized Interoperability): A unified data layer enabling seamless data exchange and application integration (SOA, ETL, Data Quality). We eliminate data silos through a single, generalized data language. MentDB Strong (Strong AI / AGI): The framework for exploring and building Machine Consciousness, free will, and advanced ethical reasoning systems. ... -
18
ngrep strives to provide most of GNU grep's common features,applying them to the network layer. ngrep is a pcap-aware tool that will allow you to specify extended regular expressions to match against data payloads of packets. SUPPORT/REPORTING BUGS: please use https://github.com/jpr5/ngrep/issues Thank you!
-
19
RecordEditor
Editor for Fixed Width, Csv and Existing Xml files.
The RecordEditor is a Data File editor for Flat Files (delimited and fixed field position). It supports Unix / PC / Legacy (e.g. Mainframe) file formats, both Text and binary files. The Editor uses a Record-Layout description to format the files. This is ideal for Fixed width (Text or Binary) files, Cobol Data Files, Mainframe files and complicated Csv files. Cobol Copybooks can be used to format Cobol Data files. As well as an editor, The following utilities are supplied * Formatted... -
20
GeigerLog
Python program for Geiger counters and Environmental Sensors
...Continues to support Geiger counters like GQ Electronic's GMC-300/500/600 , RadMon, RadPro, Gamma-Scout, audio-click and other low-cost Geiger counters, IoT devices, I2C based sensors, GQ EMF devices. GeigerLog reads data from devices, saves them to databases, prints to screen and plots as auto-updated, customizable graphs. Quality control using Statistics, Scatter, Poisson, FFT & Autocorrelation, and more. Gamma Spectra - can be displayed, calibrated, and evaluated in GeigerLog! The Raspberry Pi 4, 5 qualify as GeigerLog hosts. -
21
Battery_Reader
Smart Battery Charge/Discharge Cycling Software
Smart Battery Reader (SBR) is a professional Windows application for Smart Battery communication, testing, monitoring, and automated charge/discharge cycling via SMBus/I²C. Designed for battery engineers, developers, researchers, and manufacturers, it supports battery characterization, validation, production testing, fuel gauge development, and long-term aging analysis. Features include real-time monitoring of up to 125 battery parameters, live graphs, programmable data logging, CSV export,... -
22
Bq40z50_SREC_Viewer
SREC firmware analysis and GG extraction tool for TI fuel gauges.
Bq40zXX SREC Viewer is a Windows utility that reads, analyzes and extracts Texas Instruments battery fuel gauge Data Flash settings directly from Motorola SREC (S-Record) firmware files. It allows developers to generate fully compatible GG (Golden Image) files without programming a battery or using BQStudio to read Data Flash first. The software supports BQ40z50, BQ40z50-R1/R2/R3/R4/R5, BQ40z60, BQ40z80 and BQ40z370 firmware versions. Features include SREC analysis, GG extraction, parameter... -
23
P2Lan Transfer
Make LAN transfers easy, no server needed
Github: https://github.com/TrongAJTT/p2lan-transfer. You want to transfer file between your devices and view them immediately, but: - Cable transfer: Fast, but the process of navigating and selecting photos on the laptop is unintuitive. - Third-party OTT apps: Inconvenient for sending many files, and photos may lose quality due to compression. - Cloud storage: Convenient and maintains photo quality, but requires the annoying extra step of deleting files afterward. Then, P2Lan... -
24
Win_Notebook_Batt_Logger
Battery data logger for charge-discharge profiling on Windows laptops.
Notebook Battery Logger is a Windows application for real-time monitoring, logging and analysis of notebook battery performance. It displays detailed battery information, automatically calculates State of Health (SOH), supports notebooks with one or two batteries, and records battery parameters at user-defined intervals. Features include live graphs of voltage, current, RSOC, OS RSOC, Full Charge Capacity (FCC), current capacity and charge cycles, delayed logging start, CSV export, automatic... -
25
AWA-Core
Full application for factory, process engineer and Automation..
IT'S HERE-----FINALLY. AWA-Core 2026 is here with a totally new architecture. The core is now in Client/Server architecture and open to other applications (including yours). New interfaces for the server and client sides. Please, go to our youTube channel to see many tutorials about this new release. Don't waste your time trying things and clicking everywhere. Wait for our tutorials, install AWA-Core on a single PC or in a complete C/S architecture (Servers provided) and run...
