Menu

#343 pipe delimited data

Backlog
closed
CSV import (39)
1Fatal
2023-08-20
2023-03-07
TomScat
No

Ravel 3.1.0-beta v30; win64; Windows 10Pro.

I'm trying to import a census dataset SIPP2021, which is pipe delimited.

https://www.census.gov/programs-surveys/sipp/data/datasets/2021-data/2021.html

I entered | as Separator.

After Load nothing seems to change.
(It's a huge dataset: 5 GB after unpacking.)

1 Attachments

Discussion

  • High Performance Coder

    Changing the separator should automatically reload the file, and rerun the guessing algorithm. But pressing load does seem to work, albeit it took a lot longer than expected. I didn't go all the way to importing the data, though, as there were a lot of columns, and it is not immediately obvious which columns, if any, contain data.

    But I grabbed a small example csv I had here, and replaced all commas with "pipes", and then successfully went through the import process.

     
  • High Performance Coder

    • assigned_to: High Performance Coder
     
  • High Performance Coder

    Ticket moved from /p/minsky/tickets/1576/

    Can't be converted:

    • _priority: 4normal
     
  • High Performance Coder

    • labels: --> CSV import
    • Priority: 4normal --> 1Fatal
    • Milestone: StuartMill --> Backlog
     
  • High Performance Coder

    • status: open --> closed
     
  • High Performance Coder

    Reload on separator change now implemented.

     

Log in to post a comment.