Search Results for "data cleaning" - Page 2
Sort By:
Showing 61 open source projects for "data cleaning"
View related business solutions-
MongoDB Atlas runs apps anywhereMongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
-
$300 Free Credits to Build on Google CloudPut your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
-
1
Thunderbird Anti Virus v4.0
Thunderbird Anti Virus Free Scanner v4.0
...System Cleaner: A precision utility that securely eliminates bloated cache files across major browsers (Chrome, Edge, Firefox, Brave, Opera) and clears Windows temporary data. Performance Dashboard: Live tracking of hardware resource metrics with granular telemetry for CPU and RAM usage, tied directly to an active system health index. Advanced Registry Optimizer: Safe, deep-hive cleaning with tailored configurations to remove unknown keys and repair system registries. -
2
Zora Testing Pot
An open-source automated database testing tool
Zora is an open-source automated testing framework designed specifically for testing database functionalities. It supports multiple database management systems including MySQL, PostgreSQL, and MongoDB. The framework provides a comprehensive suite of tests to ensure data integrity, reliability, and performance across different database types. -
3
Practical Machine Learning with Python
Master the essential skills needed to recognize and solve problems
Practical Machine Learning with Python is a comprehensive repository built to accompany a project-centered guide for applying machine learning techniques to real-world problems using Python’s mature data science ecosystem. It centralizes example code, datasets, model pipelines, and explanatory notebooks that teach users how to approach problems from data ingestion and cleaning all the way through feature engineering, model selection, evaluation, tuning, and production-ready deployment patterns. The repository emphasizes end-to-end workflows rather than isolated code snippets, showing how to handle common challenges like class imbalance, overfitting, hyperparameter optimization, and interpretability. ... -
4
CryoUtilities
A utility to improve performance and help manage storage on Steam Deck
The CryoUtilities repository is a collection of scripts and graphical utilities developed to help Steam Deck owners optimize the performance of their handheld gaming systems and manage storage more easily under SteamOS (and other Linux distributions in a best-effort manner). It provides tools to tweak memory management parameters such as swap size and swappiness, adjust HugePages and kernel memory behaviors, and free up space by cleaning leftover game data, shader caches, and compatibility data for uninstalled titles. The utilities aim to balance performance and system responsiveness, especially in gaming scenarios where constrained RAM and storage throughput can cause stutters or slow load times. The project includes an installer, an easy GUI launcher, and numerous toggles for Linux kernel parameters, and it abstracts many common tweaks that would otherwise require manual command-line intervention. -
99.99% Uptime for MySQL and PostgreSQL DatabasesCloud SQL Enterprise Plus delivers near-zero downtime with 35 days of point-in-time recovery. Supports MySQL, PostgreSQL, and SQL Server.
-
5
Streamline Analyst
AI agent that streamlines the entire process of data analysis
Streamline Analyst is a cutting-edge, open-source application powered by Large Language Models (LLMs) designed to revolutionize data analysis. This Data Analysis Agent effortlessly automates all the tasks such as data cleaning, preprocessing, and even complex operations like identifying target objects, partitioning test sets, and selecting the best-fit models based on your data. With Streamline Analyst, results visualization and evaluation become seamless. -
6
sketch
AI code-writing assistant that understands data content
...The tool integrates directly into pandas dataframes through an extension, making it easy to use within existing Python workflows without requiring additional IDE plugins. Sketch supports a variety of tasks including data cleaning, feature engineering, visualization, and exploratory analysis, all driven by simple natural language prompts. It also includes advanced capabilities for generating structured outputs and applying transformations directly to datasets, reducing the need for manual coding. -
7
text-dedup
All-in-one text de-duplication
text-dedup is a Python library that enables efficient deduplication of large text corpora by using MinHash and other probabilistic techniques to detect near-duplicate content. This is especially useful for NLP tasks where duplicated training data can skew model performance. text-dedup scales to billions of documents and offers tools for chunking, hashing, and comparing text efficiently with low memory usage. It supports Jaccard similarity thresholding, parallel execution, and flexible deduplication strategies, making it ideal for cleaning web-scraped data, language model training datasets, or document archives. -
8
paramspider
Mine parameterized URLs from web archives for security testing
...These endpoints are commonly used during reconnaissance because parameters often expose inputs that may be vulnerable to issues like cross-site scripting, SQL injection, or server-side request forgery. ParamSpider automates the process of retrieving archived URLs, cleaning them, and preparing them for fuzzing or further probing. It can process a single domain or multiple domains from a list, making it useful for both targeted testing and large-scale reconnaissance. -
9
funNLP
Resources, corpora, and tools for Chinese natural language processing
...The repository is organized into categories such as sentiment analysis, text classification, named entity recognition, knowledge graphs, and various lexicons (e.g. sensitive words, emotion dictionaries, stopwords). It also includes links to academic papers, open-source model implementations, and practical utilities like word segmentation or text cleaning scripts. The project is highly community-oriented, frequently updated with contributions and new resources, and it’s widely used in both academic and applied NLP research. Its value lies in providing not just tools but also curated, domain-specific data, which can be hard to find elsewhere. -
Save Up to 91% on Cloud Compute With Spot VMsRun batch jobs at 60-91% off with Spot VMs. Long-running workloads get automatic discounts with sustained use.
-
10
SageMaker Experiments Python SDK
Experiment tracking and metric logging for Amazon SageMaker notebooks
...Each step in the workflow is described by a Trial Component. There is no relationship between Trial Components such as ordering. Trial Component: A description of a single step in a machine learning workflow. For example data cleaning, feature extraction, model training, model evaluation, etc. -
11
tidyverse
Easily install and load packages from the tidyverse
tidyverse is a meta‑package that installs and loads a cohesive suite of R packages designed for data science, sharing underlying design principles, grammar, and data structures. Core components include ggplot2, dplyr, tidyr, readr, purrr, tibble, stringr, forcats, and more. It promotes tidy data workflows and consistency across tasks. -
12
Cookie AutoDelete
Firefox and Chrome WebExtension that deletes cookies
Firefox and Chrome WebExtension that deletes cookies and other browsing site data as soon as the tab closes, domain changes, browser restarts, or a combination of those events. Control your cookies! This extension is inspired by Self-Destructing Cookies. When a tab closes, any cookies not being used are automatically deleted. Prevent tracking by other cookies and add only the ones you trust. Easily import and export your cookie whitelist. -
13
CSSO
CSS minifier with structural optimizations
...CSSO is based on CSSTree to parse CSS into AST, AST traversal and to generate AST back to CSS. All CSSTree API is available behind syntax field extended with compress() method. You may minify CSS step by step. CSSO can use data about how CSS is used in the markup for better compression. File with this data (JSON) can be set using the usage option. -
14
WSClean
WSClean is a fast widefield interferometric imager
WSClean (w-stacking clean) is a fast generic widefield imager. It uses the w-stacking algorithm and can make use of the w-snapshot algorithm. As of Feb 2014, it is 2-12 times faster than CASA's w-projection, depending on the array configuration. It supports full-sky imaging and proper beam correction for homogeneous dipole arrays such as the MWA. WSClean allows Hogbom and Cotton-Schwab cleaning and has wideband, multiscale, compressed sensing and joined-polarization deconvolution modes.... -
15
Tidy
The granddaddy of HTML tools, with support for modern standards
The granddaddy of HTML tools. Supports modern standards. Thanks to the efforts of HTACG and prominent contributors, HTML Tidy has a whole new heartbeat and a whole new life. Tidy tidies HTML and XML. It can tidy your documents by itself, and developers can easily integrate its features into even more powerful tools. Tidy is a console application for macOS, Linux, Windows, UNIX, and more. It corrects and cleans up HTML and XML documents by fixing markup errors and upgrading legacy code to... -
16
R4DS (R for Data Science)
R for data science: a book
...Includes many example datasets, diagrams, code samples, and “hands-on” exercises. Comprehensive coverage of data-science workflow: data import, cleaning, transformation, exploration, modelling etc. Includes topics beyond basics: relational data (joins), date/time, strings, working with missing values, visualizing data, etc. -
17
queXC
Web based system for cleaning and classifying open text fields
An Open Source, web based data cleaning and coding system. queXC takes a data file (such as questionnaire data) and cleans the text input fields by spacing and spell checking them. Operators then code text fields using new/existing coding schemes. -
18
Parsr
Transforms PDF, Documents and Images into Enriched Structured Data
Parsr is an open-source document parsing tool that converts PDFs, scanned images, and other structured documents into structured, machine-readable data formats. -
19
Lustre-HPSS copytool
Lustre-HPSS copy agent
Lustre-HPSS copytool makes it possible to use HPSS as a backend storage for one or several Lustre filesystems, including: transparent migration of files data from Lustre to HPSS, automatic recalls on access, orphan cleaning in HPSS... -
20
Tashkeela processed
Tashkeela dataset cleaned and normalized.
A version of the Tashkeela Arabic diacritized text dataset cleaned from the non-Arabic content and the undiacritized text, then divided into training, development, and testing sets. The cleaning process includes removing the XML tags and strange symbols, as well as fixing diacritics errors. After that, the tokenization is performed while focusing on the extraction of the Arabic words. The result is a space-separated tokens file, where the words and the numbers are separated, but not the... -
21
DISTOD
Distributed discovery of bidirectional order dependencies
...They can express that, for example, sorting books by publication date in ascending order also sorts them by age in descending order. The knowledge about order relationships is useful for many data management tasks, such as query optimization, data cleaning, or consistency checking. Because the bODs of a specific dataset are usually not explicitly given, they need to be discovered. The discovery of all minimal bODs (in set-based canonical form) is a task with exponential complexity in the number of attributes. -
22
cocoNLP
A Chinese information extraction tool
cocoNLP is a lightweight natural-language processing toolkit geared toward practical information extraction from raw text, especially for Chinese and mixed Chinese–English content. Instead of requiring a heavy pipeline, it focuses on quick wins such as extracting names, places, organizations, emails, phone numbers, and dates directly from unstructured sentences. The project blends pattern-based methods with NLP heuristics, giving developers dependable results for real-world texts like chats,... -
23
DS-Take-Home
Solution to the book A Collection of Data Science Take-Home Challenge
DS-Take-Home is a repository that provides practical solutions to a series of real-world data science challenges inspired by the book A Collection of Data Science Take-Home Challenges. The project is designed as a learning resource where aspiring data scientists can study how typical industry-style take-home assignments are solved using data analysis and machine learning techniques. Each challenge is implemented in a separate Jupyter notebook that walks through the process of analyzing... -
24
OGLDataScienceTool
Opengl tool for data science visualization
Data visualization tool written in LWJGL Compatible with libgdx and other opengl wrappers The project depends on apache poi, and apache commons, for office files support Planned features for next release: * reading json, and other nosql data structures * jdbc connection for creating dataframes * data heatmaps, and additional plots for questions, contact me kumar.santhi1982@hotmail.com more details: http://www.java-gaming.org/topics/ds/41920/view.html http://datascienceforindia.com/ -
25
fooltrader
Quant framework for stock
Build a standard data schema, and then implement various connectors to import systems you are familiar with for analysis. fooltrader is a quantitative analysis trading system designed using big data technology, including data capture, cleaning, structuring, calculation, display, backtesting and trading. Its goal is to provide a unified framework for the whole market (stock, futures, bonds, foreign exchange, digital currency, macroeconomics, etc.) for research, backtesting, forecasting, and trading. ...
