Showing 280 open source projects for "data quality cleansing"

View related business solutions
  • $300 Free Credits to Build on Google Cloud Icon
    $300 Free Credits to Build on Google Cloud

    New customers can spin up VMs, build with AI, and query data at no cost.

    Put your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
    Start Free
  • MongoDB Atlas runs apps anywhere Icon
    MongoDB Atlas runs apps anywhere

    Deploy in 115+ regions with the modern database for every enterprise.

    MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
    Start Free
  • 1
    OPENRNDR

    OPENRNDR

    Kotlin library for creative coding, real-time and interactive graphics

    ...OPENRNDR provides simple, reusable utilities with which creative coders can build robust, fast, and reliable (interactive) applications for prototyping as well as building production-quality software. With ORML you can easily connect to a number of widely used Machine Learning models, such as Facemesh, Posenet, and Stylegan. You can use OPENRNDR to visualize the data coming from these models in order to create compelling (interactive) experiences. The ORML library includes both models and interface code to make the use of those models simple. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 2
    LLM Datasets

    LLM Datasets

    Curated list of datasets and tools for post-training

    ...The repository aims to make datasets easy to inspect and transform, with scripts for downloading, deduping, cleaning, and converting to formats like JSONL that slot into training pipelines. It highlights instruction-tuning and conversation-style corpora while also pointing to code, math, or domain-specific sets for targeted capabilities. Quality is a recurring theme: examples and utilities help filter low-value samples, enforce length limits, and split train/validation consistently so results are comparable. Licensing and provenance are surfaced to encourage compliant usage and to guide dataset selection in commercial settings. For practitioners, the repo is a practical “starting pantry” that accelerates experimentation and helps keep data wrangling from dominating the project timeline.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 3
    PyScaffold

    PyScaffold

    Python project template generator with batteries included

    PyScaffold is a project generator for bootstrapping high-quality Python packages, ready to be shared on PyPI and installable via pip. It is easy to use and encourages the adoption of the best tools and practices of the Python ecosystem, helping you and your team to stay sane, happy and productive. The best part? It is stable and has been used by thousands of developers for over half a decade! Checkout out this demo project, which was set up using PyScaffold and if you are still not convinced...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 4
    Jailer

    Jailer

    Database Subsetter and Relational Data Browser

    Database Subsetting and Relational Data Browsing Tool. Navigate bidirectionally through the database by following foreign-key-based or user-defined relationships. Exports consistent, referentially intact row-sets from relational databases. Removes data w/o violating integrity. Generates topologically sorted SQL-DML, hierarchically structured XML. and DbUnit datasets.
    Leader badge
    Downloads: 55 This Week
    Last Update:
    See Project
  • Build Agents and Models on One Platform Icon
    Build Agents and Models on One Platform

    Everything you need to build production-ready agents and models. Access 200+ Google and third-party AI models and tools.

    Gemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
    Start Free
  • 5
    CO3D (Common Objects in 3D)

    CO3D (Common Objects in 3D)

    Tooling for the Common Objects In 3D dataset

    CO3Dv2 (Common Objects in 3D, version 2) is a large-scale 3D computer vision dataset and toolkit from Facebook Research designed for training and evaluating category-level 3D reconstruction methods using real-world data. It builds upon the original CO3Dv1 dataset, expanding both scale and quality—featuring 2× more sequences and 4× more frames, with improved image fidelity, more accurate segmentation masks, and enhanced annotations for object-centric 3D reconstruction. CO3Dv2 enables research in multi-view 3D reconstruction, novel view synthesis, and geometry-aware representation learning. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 6
    Grassroots DICOM

    Grassroots DICOM

    Cross-platform DICOM implementation

    Grassroots DiCoM is a C++ library for DICOM medical files. It is accessible from Python, C#, Java and PHP. It supports RAW, JPEG, JPEG 2000, JPEG-LS, RLE and deflated transfer syntax. It comes with a super fast scanner implementation to quickly scan hundreds of DICOM files. It supports SCU network operations (C-ECHO, C-FIND, C-STORE, C-MOVE). PS 3.3 & 3.6 are distributed as XML files. It also provides PS 3.15 certificates and password based mecanism to anonymize and de-identify DICOM datasets.
    Leader badge
    Downloads: 212 This Week
    Last Update:
    See Project
  • 7

    RecordEditor

    Editor for Fixed Width, Csv and Existing Xml files.

    The RecordEditor is a Data File editor for Flat Files (delimited and fixed field position). It supports Unix / PC / Legacy (e.g. Mainframe) file formats, both Text and binary files. The Editor uses a Record-Layout description to format the files. This is ideal for Fixed width (Text or Binary) files, Cobol Data Files, Mainframe files and complicated Csv files. Cobol Copybooks can be used to format Cobol Data files. As well as an editor, The following utilities are supplied * Formatted...
    Leader badge
    Downloads: 33 This Week
    Last Update:
    See Project
  • 8
    TextTest is an application-independent tool for text-based functional testing. This means running a batch-mode binary in lots of different ways, and using the text output produced as a means of controlling the behaviour of that application.
    Leader badge
    Downloads: 25 This Week
    Last Update:
    See Project
  • 9

    Practically Random

    statistical tests & psuedo- random number generators (RNGs, PRNGs)

    Randon number generation & testing. The best suite of statistical tests for fast PRNGs anywhere. Multithreaded for speed, command line tools for automation, no upper limit on data size. Also, a variety of C++ pseudo-random number generators with well designed interfaces aimed at practical uses, not just research.
    Leader badge
    Downloads: 101 This Week
    Last Update:
    See Project
  • Paessler: Easy to Use With Enterprise Power. Free Trial Icon
    Paessler: Easy to Use With Enterprise Power. Free Trial

    A low-code dashboard makes monitoring intuitive for any admin, while scripting and custom sensors give experts full control.

    You shouldn't have to choose between a monitoring tool that's easy to use and one that's powerful enough for a complex environment. PRTG's low-code interface lets any admin build dashboards, set alerts and monitor devices without scripting, while custom sensors and full API access are there when your team needs deeper control. One platform, no compromise. Download a free 30-day trial now.
    Get Free Download
  • 10
    Cinemagoer

    Cinemagoer

    Python package to retrieve and manage data of the IMDb

    Cinemagoer is a Python package useful to retrieve and manage the data of the IMDb movie database about movies, people, characters and companies. Platform-independent, it can retrieve data from both the IMDb's web server and a local copy of the whole db.
    Downloads: 4 This Week
    Last Update:
    See Project
  • 11

    Instigate Application Framework

    Software libraries for effective development of desktop applications.

    ...The registration API also provides means to enter description of user data which is used for generation of high quality standard-compliant Reference Manual for the application. Registered database is wrapped into a scripting interface to enable of automatic generation of black-box tests.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 12
    Hypercube

    Hypercube

    Graph visualizing tool

    Hypercube is a tool for visualizing DOT (graphviz), GML, GraphML, GXL and simple text-based graph representations as SVG and EPS images. Hypercube comes with a Qt based GUI application and a Qt-independent command-line tool. It uses a simulated annealing algorithm to lay out the graph, that can be easily parameterized to achieve the desired look. The main development goals are portability and easy usage rather than high performance and complexity.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 13

    ai-wright

    Vision-enabled AI steps for Playwright tests. Bring your own LLM.

    ai-wright adds AI steps to any Playwright test. ai.act carries out UI actions from a plain-language objective, ai.verify makes vision-driven assertions that fail the step when the model is not confident enough, and ai.extract pulls structured data from the page. Screenshots are annotated with Set-of-Marks overlays and combined with DOM element maps, so the model can work through complex UIs. Keep most of each test as deterministic Playwright code and use AI only on the brittle steps. It...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 14

    Optimizer_sovkov

    Constructing and optimizing general mathematical and physical models

    We present the package Optimizer, aimed at constructing and optimizing general mathematical models of phenomena of versatile nature. It is written in the Matlab algorithmic language and is executed in the Matlab environment with partial functionality in Octave. The convenient visual interface and the detailed manuals are provided. The main benefit of the package is its capability to construct models of any level of complexity in a block-by-block manner. Elementary model blocks can be...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 15

    Text File Generator

    Generate large text files for various testing purposes

    Generate large text files with dummy data (i.e. for performance testing an app that needs to read a file). This is a console app. It allows to generate large files (you can specify the size in megabytes). There is a template which you can set to define how a single line should look like, e.g. you can make a CSV file from it. This can contain random words, random numbers and sequential numbers. It has a dictionary of English words which you can replace with your own set. You can...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 16
    Hoodland Toolbox

    Hoodland Toolbox

    An assorted miscellany of tools and toys.

    Hoodland Toolbox (formerly known as the Rockabilly Common Libraries) An assorted miscellany of tools and toys used by all other Hoodland Open Source Projects (formerly Rockabilly Software). This project has been rewritten in Kotlin for the JVM. Its new home is here: https://github.com/william-hood/toolbox-kotlin Available in Maven Central Repository... Kotlin: https://central.sonatype.com/artifact/io.github.william-hood/toolbox-kotlin Java:...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 17
    Koarse Grind (formerly Coarse Grind)

    Koarse Grind (formerly Coarse Grind)

    Test Automation framework intended for coarse-grained testing

    Koarse Grind has been rewritten in Kotlin (hence the 'K'). It's new home is here: https://github.com/william-hood/koarse-grind-kotlin __________________________________ Test Automation framework for Kotlin/Java with an integrated web-based user interface. It is intended for larger-grained testing of an installed & configured product, rather than unit testing.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 18
    Neiki's Gallery

    Neiki's Gallery

    Vanilla JavaScript image gallery & lightbox

    Neiki's Gallery is a lightweight, production-ready image gallery and lightbox library built with vanilla JavaScript and CSS. It requires no dependencies and can be integrated with a single <script> tag, with automatic initialization out of the box. It provides a highly customizable experience for modern web projects, combining performance, flexibility, and rich UI interactions. Designed for both developers and end users, it supports responsive layouts, advanced lightbox features, touch...
    Downloads: 7 This Week
    Last Update:
    See Project
  • 19
    Fronsetia

    Fronsetia

    A web application for testing webservices

    Fronsetia (Free Online Service Testing Application) is a Java web application that allows testing webservices (REST and SOAP). No end-user installations required, just deploy the application on your server and pass the link so that users can use their usual browsers to access Fronsetia. You can think of Fronsetia as a simple version of SoapUI on the web, or a simple and free and open-source version of the "wls_utc" utility. See the project homepage https://fronsetia.sourceforge.io and...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 20
    Ada industrial control widget library

    Ada industrial control widget library

    A GUI library for designing gauges, meters, oscilloscopes, plotters

    A library that is intended for designing high-quality industrial control widgets for Ada applications. The widgets are composed of transparent layers drawn by cairo. The widgets are fully scalable graphics. A time controlled refresh policy is supported for real-time and heavy-duty applications. The library supports caching graphical operations and stream I/O for serialization and deserialization. Ready-to-use gauge, meter, oscilloscope widgets are provided as samples as well as an editor...
    Downloads: 1 This Week
    Last Update:
    See Project
  • 21
    Step CI

    Step CI

    Automated API Testing and Quality Assurance

    Step CI is an open-source API Quality Assurance framework. Language-agnostic. Configure easily using YAML, JSON or JavaScript. REST, GraphQL, gRPC, tRPC, SOAP. Test different API types in one workflow. Self-hosted. Test services on your network, locally or with CI/CD. Integrated. Play nicely with others.
    Downloads: 3 This Week
    Last Update:
    See Project
  • 22
    Best-of React Web

    Best-of React Web

    A ranked list of awesome React open-source libraries and tools

    This curated list contains 430 awesome open-source projects with a total of 5M stars grouped into 22 categories. All projects are ranked by a project-quality score, which is calculated based on various metrics automatically collected from GitHub and different package managers. If you like to add or update projects, feel free to open an issue, submit a pull request, or directly edit the projects.yaml.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 23
    Software Engineering Blogs

    Software Engineering Blogs

    A curated list of engineering blogs

    Software Engineering Blogs is a curated collection of engineering-focused blog posts and resources aggregated from leading technology companies and developers. The repository serves as a centralized index that helps users discover high-quality technical content across a wide range of topics, including software engineering, system design, infrastructure, and data engineering. It is organized in a structured manner, making it easy to browse and find articles from specific companies or domains of interest. The project is continuously updated by the community, ensuring that the content remains relevant and reflective of current industry practices. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 24
    applied-ml

    applied-ml

    Papers & tech blogs by companies sharing their work on data science

    The applied-ml repository is a rich, curated collection of papers, technical articles, and case-study blog posts about how machine learning (ML) and data-driven systems are applied in real production environments by major companies. Instead of focusing solely on theoretical ML research, this repo highlights industry-scale challenges: data collection, quality, infrastructure, feature stores, model serving, monitoring, scalability, and how ML is embedded in product workflows. It acts as a living library for practitioners who want to learn from real-world successes and failures — giving insight into how large organizations structure their data pipelines, how they manage ML lifecycle at scale, and what architectural or operational tradeoffs they made. ...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 25
    SafeUtils

    SafeUtils

    110+ developer tools as native MacOS, Linux & Windows desktop apps.

    Tools: https://safeutils.com/barcode-generator https://safeutils.com/color-picker https://safeutils.com/qr-code-generator https://safeutils.com/qr-code-scanner https://safeutils.com/word-counter https://safeutils.com/base-64-decoder https://safeutils.com/diff-checker https://safeutils.com/hex-to-ascii https://safeutils.com/json-formatter https://safeutils.com/lorem-ipsum-generator https://safeutils.com/random-generator https://safeutils.com/time-converter https://safeutils.com/...
    Downloads: 0 This Week
    Last Update:
    See Project