scrubcsv

Provides a linux/unix command line tool to "scrub" comma delimited files. Removing extra spaces, mr. dr. etc. Also removing duplicate records based on a comparison of columns/fields. It's a bash script using awk, cut, join and nl. Using a little perl

Project Samples

scrubcsv.sh -p13 -c5 -c6 input.csv 5 6 13

Project Activity

See All Activity >

License

GNU General Public License version 2.0 (GPLv2)

Follow scrubcsv

scrubcsv Web Site

Other Useful Business Software

Train ML Models With SQL You Already Know

BigQuery automates data prep, analysis, and predictions with built-in AI assistance.

Build and deploy ML models using familiar SQL. Automate data prep with built-in Gemini. Query 1 TB and store 10 GB free monthly.

Start Free

Rate This Project

User Reviews

Be the first to post a review of scrubcsv!

Additional Project Details

Operating Systems

BSD, Linux

Intended Audience

Information Technology

User Interface

Command-line, Console/Terminal

Programming Language

Unix Shell

Database Environment

Flat-file

Related Categories

Unix Shell Database Software, Unix Shell Command Line Tools

Registered

2006-09-29

Similar Business Software

Apify

Apify is a full-stack web scraping and automation platform helping anyone get value from the web. At its core is Apify Store, a marketplace with over 10,000 Actors where developers build, publish, and monetize automation tools. Actors are serverless cloud programs that extract data, automate...

See Software
Highcharts

Highcharts is a JavaScript charting library that allows developers to create interactive and visually appealing charts for web applications. It offers a wide range of chart types, including line charts, bar charts, pie charts, scatter plots, and more. It also supports different types of data,...

See Software
DbVisualizer

DbVisualizer is a universal database client for anyone who works with data, from solo developers and startups to professional teams managing complex environments, including developers, DBAs, analysts, and data engineers working with relational and NoSQL databases. It offers a graphical interface...

See Software
NetNut

Get ready to experience unmatched control and insights with our user-friendly dashboard tailored to your needs. Monitor and adjust your proxies with just a few clicks. Track your usage and performance with detailed statistics. Our team is devoted to providing customers with proxy solutions...

See Software
Process Street

Process Street is an AI-powered compliance operations platform that automates complex workflows, enforces standards, and tracks audit data in real time. Teams use it to create structured SOPs, assign tasks, collect data, and monitor execution with intelligent oversight. From onboarding and...

See Software
SurveyJS

SurveyJS is an embeddable, self-hosted, white-label form builder for teams building custom forms, surveys, questionnaires, and other data collection tools inside web applications. It runs entirely on the client and is fully compatible with all modern JavaScript frameworks, including React,...

See Software