scrubcsv

Provides a linux/unix command line tool to "scrub" comma delimited files. Removing extra spaces, mr. dr. etc. Also removing duplicate records based on a comparison of columns/fields. It's a bash script using awk, cut, join and nl. Using a little perl

Project Samples

scrubcsv.sh -p13 -c5 -c6 input.csv 5 6 13

Project Activity

See All Activity >

License

GNU General Public License version 2.0 (GPLv2)

Follow scrubcsv

scrubcsv Web Site

Other Useful Business Software

Secure File Transfer for Windows with Cerberus by Redwood

Protect and share files over FTP/S, SFTP, HTTPS and SCP with the #1 rated Windows file transfer server.

Cerberus supports unlimited users and connections on a single IP, with built-in encryption, 2FA, and a browser-based web client — all deployable in under 15 minutes with a 25-day free trial.

Try for Free

Rate This Project

User Reviews

Be the first to post a review of scrubcsv!

Additional Project Details

Operating Systems

BSD, Linux

Intended Audience

Information Technology

User Interface

Command-line, Console/Terminal

Programming Language

Unix Shell

Database Environment

Flat-file

Related Categories

Unix Shell Database Software, Unix Shell Command Line Tools

Registered

2006-09-29

Similar Business Software

Bitrise

Bitrise is a CI/CD platform built for mobile development, helping teams speed up builds, automate testing, and deliver high-quality apps faster. It supports native languages like Swift, Objective-C, Java, and Kotlin, as well as cross-platform frameworks including React Native, Flutter, Xamarin,...

See Software
Apify

Apify is a full-stack web scraping and automation platform helping anyone get value from the web. At its core is Apify Store, a marketplace with over 10,000 Actors where developers build, publish, and monetize automation tools. Actors are serverless cloud programs that extract data, automate...

See Software
Highcharts

Highcharts is a JavaScript charting library that allows developers to create interactive and visually appealing charts for web applications. It offers a wide range of chart types, including line charts, bar charts, pie charts, scatter plots, and more. It also supports different types of data,...

See Software
DbVisualizer

DbVisualizer is a universal database client for anyone who works with data, from solo developers and startups to professional teams managing complex environments, including developers, DBAs, analysts, and data engineers working with relational and NoSQL databases. It offers a graphical interface...

See Software
Process Street

Process Street is an AI-powered compliance operations platform that automates complex workflows, enforces standards, and tracks audit data in real time. Teams use it to create structured SOPs, assign tasks, collect data, and monitor execution with intelligent oversight. From onboarding and...

See Software
NetNut

Get ready to experience unmatched control and insights with our user-friendly dashboard tailored to your needs. Monitor and adjust your proxies with just a few clicks. Track your usage and performance with detailed statistics. Our team is devoted to providing customers with proxy solutions...

See Software