DataProfiler is an AI-powered tool for automatic data analysis and profiling, designed to detect patterns, anomalies, and schema inconsistencies in structured and unstructured datasets. The DataProfiler is a Python library designed to make data analysis, monitoring, and sensitive data detection easy. Loading Data with a single command, the library automatically formats & loads files into a DataFrame. Profiling the Data, the library identifies the schema, statistics, entities (PII / NPI), and more. Data Profiles can then be used in downstream applications or reports.
Features
- Automatically detects schema, types, and distributions in datasets
- Supports structured (CSV, SQL) and unstructured (text, logs) data
- Identifies Personally Identifiable Information (PII)
- Provides statistical summaries and data quality metrics
- Works with large-scale datasets efficiently
- Open-source with Python API integration
Categories
Natural Language Processing (NLP)License
Apache License V2.0Follow DataProfiler
Other Useful Business Software
Forever Free Full-Stack Observability | Grafana Cloud
Built on open standards like Prometheus and OpenTelemetry, Grafana Cloud includes Kubernetes Monitoring, Application Observability, Incident Response, plus the AI-powered Grafana Assistant. Get started with our generous free tier today.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of DataProfiler!