scrubcsv

Provides a linux/unix command line tool to "scrub" comma delimited files. Removing extra spaces, mr. dr. etc. Also removing duplicate records based on a comparison of columns/fields. It's a bash script using awk, cut, join and nl. Using a little perl

Project Samples

scrubcsv.sh -p13 -c5 -c6 input.csv 5 6 13

Project Activity

See All Activity >

License

GNU General Public License version 2.0 (GPLv2)

Follow scrubcsv

scrubcsv Web Site

Other Useful Business Software

MongoDB Atlas runs apps anywhere

Deploy in 115+ regions with the modern database for every enterprise.

MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.

Start Free

Rate This Project

User Reviews

Be the first to post a review of scrubcsv!

Additional Project Details

Operating Systems

BSD, Linux

Intended Audience

Information Technology

User Interface

Command-line, Console/Terminal

Programming Language

Unix Shell

Database Environment

Flat-file

Related Categories

Unix Shell Database Software, Unix Shell Command Line Tools

Registered

2006-09-29

Similar Business Software

LOLCODE

LOLCODE can interpret files from standard input or from a file. Spaces are used to demarcate tokens in the language, although some keyword constructs may include spaces. Multiple spaces and tabs are treated as single spaces and are otherwise irrelevant. Indentation is irrelevant. A command...

See Software
Ninox

Ninox is your solution for organizing and managing complex data in a structured and efficient way. With its highly flexible user interface, you can analyze, process, and evaluate any type of data. Additionally, the Ninox API enables seamless integration with services like Google for enhanced...

See Software
DbVisualizer

DbVisualizer is one of the world's most popular database editors. With almost 7 million downloads and Pro users in 150 countries worldwide, it won't disappoint you. Free and Pro versions are available. Developers, analysts, and DBAs use it to elevate their SQL experience with modern tools to...

See Software
Bitrise

Bitrise is a CI/CD platform built for mobile development, helping teams speed up builds, automate testing, and deliver high-quality apps faster. It supports native languages like Swift, Objective-C, Java, and Kotlin, as well as cross-platform frameworks including React Native, Flutter, Xamarin,...

See Software
Windsurf Editor

The Windsurf Editor is a free AI-powered IDE and AI coding assistant that accelerates development by providing intelligent code generation and agents in over 70 programming languages and more than 40 IDEs, including VSCode, JetBrains, and Jupyter Notebooks. With Windsurf, developers can write...

See Software
TeamDesk

TeamDesk is the leading AI-Powered Low-Code platform for creating powerful and flexible web-based databases with no-coding. AI-Assisted Development streamlines database design, no technical skills required. TechRadar named TeamDesk as the best database platform of the year. TeamDesk...

See Software