Menu

broken import of large CSV

Anonymous
2019-08-02
2019-08-02
  • Anonymous

    Anonymous - 2019-08-02

    Hello, imported very large voter database located at https://www.elections.ny.gov/NYSBOE/download/ZipDataFiles/ALL_REPORTS.zip

    At verious times the record breaks incorrectly and splits the records. If you perform the import, see line 230260. This happens at various intervals throughout the import. When looking at the file in a txt viewer there doesn't appear to any issues with the data that would cause these breaks. The records have the following accompanying definitions:

    (RecordSeparator): CR-LF
    (FieldSeparator): ,
    (FieldStartDelimiter): "
    (FieldEndDelimiter): "
    (FieldDelimitStyle): all
    (StripLeadingBlanks): True
    (StripTrailingBlanks): True

    The records are delimited ASCII

     
  • Bruce Martin

    Bruce Martin - 2019-08-02

    Can you show me the relavent lines ???

    Can you try selecting the embedded New Lines option. See attached picture


    Getting the Relavent lines in ReCsvEditor

    In ReCsvEditor you can

    • Select a small range that includes the problem line
    • Select menu item View >>> Table View selected Records
    • Select menu item View >>> Text View or View >>> Text View (highlighted fields)

    That should display a portion of the file as standard text

     

    Last edit: Bruce Martin 2019-08-03

Anonymous
Anonymous

Add attachments
Cancel