DataProfiler is an AI-powered tool for automatic data analysis and profiling, designed to detect patterns, anomalies, and schema inconsistencies in structured and unstructured datasets. The DataProfiler is a Python library designed to make data analysis, monitoring, and sensitive data detection easy. Loading Data with a single command, the library automatically formats & loads files into a DataFrame. Profiling the Data, the library identifies the schema, statistics, entities (PII / NPI), and more. Data Profiles can then be used in downstream applications or reports.

Features

  • Automatically detects schema, types, and distributions in datasets
  • Supports structured (CSV, SQL) and unstructured (text, logs) data
  • Identifies Personally Identifiable Information (PII)
  • Provides statistical summaries and data quality metrics
  • Works with large-scale datasets efficiently
  • Open-source with Python API integration

Project Samples

Project Activity

See All Activity >

License

Apache License V2.0

Follow DataProfiler

DataProfiler Web Site

Other Useful Business Software
Save Up to 91% on Cloud Compute With Spot VMs Icon
Save Up to 91% on Cloud Compute With Spot VMs

Automatic sustained-use discounts. One free VM per month. No negotiation needed.

Run batch jobs at 60-91% off with Spot VMs. Long-running workloads get automatic discounts with sustained use.
Start Free
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of DataProfiler!

Additional Project Details

Operating Systems

Linux, Mac, Windows

Programming Language

Python

Related Categories

Python Natural Language Processing (NLP) Tool

Registered

2025-01-23