This project is dedicated to open source data quality and data preparation solutions. Data Quality includes profiling, filtering, governance, similarity check, data enrichment alteration, real time alerting, basket analysis, bubble chart Warehouse validation, single customer view etc. defined by Strategy.

This tool is developing high performance integrated data management platform which will seamlessly do Data Integration, Data Profiling, Data Quality, Data Preparation, Dummy Data Creation, Meta Data Discovery, Anomaly Discovery, Data Cleansing, Reporting and Analytic.

It also had Hadoop ( Big data ) support to move files to/from Hadoop Grid, Create, Load and Profile Hive Tables. This project is also known as "Aggregate Profiler"

Resful API for this project is getting built as (Beta Version) https://sourceforge.net/projects/restful-api-for-osdq/

apache spark based data quality is getting built at https://sourceforge.net/projects/apache-spark-osdq/

Features

  • Teiid, Mysql, Oracle,Postgres,Access,Db2,SQL Server certified Big data support - HIVE
  • Create Hive table, Profile Hive table, Move file to/from Profiler System and Hadoop Grid
  • Fuzzy Logic based similarity check, Cardinailty check between tables and files
  • Export and import from XML, XLS or CSV format, PDF export
  • File Analysis, Regex search, Standardization, DB search
  • Complete DB Scan, SQL interface, Data Dictionary, Schema Comparison
  • Statistical Analysis, Reporting ( dimension and measure based), Ad Hoc reports and Analytics
  • Pattern Matching , DeDuplication, Case matching, Basket Analysis, Distribution Chart
  • Data generation, Data Preparation and Data masking features
  • Meta Data Information, Reverse engineering of Data Model
  • Timeliness analysis , String length analysis, KMean, Prediction, Regression
  • Address Correction, Single View of Customer, Product, Golden merge for records
  • Record Match, Linkage and Merge added based on fuzzy logic
  • Format Creation, Format Matching ( Phone, Date, String and Number), Format standardization
  • Data Preparation: Ordinal,Normalization,Bucketing,Regression
  • data masking, encryption, randomization of data

Project Samples

Project Activity

See All Activity >

Follow Open Source Data Quality and Profiling

Open Source Data Quality and Profiling Web Site

Other Useful Business Software

License This HTML5 Speed Test for Your ISP or Network License This HTML5 Speed Test for Your ISP or Network Icon
License This HTML5 Speed Test for Your ISP or Network Icon

Are you an ISP or network administrator looking for a reliable, accurate, & affordable HTML5 speed test that works on all devices?

The SourceForge Speed Test measures Latency/Ping, Jitter, Download Speed, Upload Speed, Buffer Bloat, and Packet Loss. Upon completion, you can view detailed reports about your connection. This HTML5 speed test does not require Flash or Java, and works on all devices including tablets and smartphones. Host on your own infrastructure or use ours. For licensing, inquire today.

Rate This Project

Login To Rate This Project

User Ratings

★★★★★
★★★★
★★★
★★
7
0
1
0
0
ease 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 4 / 5
features 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 5 / 5
design 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 4 / 5
support 1 of 5 2 of 5 3 of 5 4 of 5 5 of 5 5 / 5

User Reviews

  • can this tool be connected to hive with kerberos authentication?

    1 user found this review helpful.
  • I would like to know if this can be used for client projects or if there is any restriction.

    1 user found this review helpful.
  • REST API version is really very cool !! keep going .

    1 user found this review helpful.
  • Great tool, best DQ and Profiling tool I've used.

    1 user found this review helpful.
  • one of the best tool for data quality & preparation i have ever used.

    1 user found this review helpful.
Read more reviews >

Additional Project Details

Intended Audience

Advanced End Users, Developers, Quality Engineers, Management

User Interface

Java Swing

Programming Language

Java

Database Environment

JDBC, ODBC

Registered

2006-08-18