Fixed width data files are probably the most annoying data to import into database.
This utility allows user to insert user-defined column separators into user-defided positions of flat file table given in fixed-width format.
I am using this utility to import astronomical catalogs provided as flat tables at CDS ftp-server into postgresql;
Build:
$ make all [cc={icc|gcc}]
Install:
$ make install [prefix=/path/to/your/bin/directory]
Example of usage:
$ gzip -dc table.dat.gz | fw2csv --stops=4,10,11,20,30,36 -d '|' -header 1 | psql wsdb -c "copy mytable from stdin with csv delimiter '|'"
For the list of available options call
$ fw2csv --help
License
Public DomainFollow fw2csv
Other Useful Business Software
Gen AI apps are built with MongoDB Atlas
MongoDB Atlas is the developer-friendly database used to build, scale, and run gen AI and LLM-powered apps—without needing a separate vector database. Atlas offers built-in vector search, global availability across 115+ regions, and flexible document modeling. Start building AI apps faster, all in one place.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of fw2csv!