#20 scia: adding the fresco table

closed
5
2006-12-27
2006-11-22
No

this is similar to the gome fresco request.
there are small differences, maybe just the fact that the header contains less information.

Discussion

  • Mario Frasca

    Mario Frasca - 2006-11-22
    • assigned_to: nobody --> mfrasca
     
  • Mario Frasca

    Mario Frasca - 2006-11-22
    • assigned_to: mfrasca --> nobody
     
  • Mario Frasca

    Mario Frasca - 2006-11-30
    • assigned_to: nobody --> mfrasca
     
  • Mario Frasca

    Mario Frasca - 2006-12-04

    Logged In: YES
    user_id=512199
    Originator: YES

    I need a sample orbit with matching level 1 data and fresco data.

    I've tried ingesting everything we have about the date 2006-03-12, but I still get these errors:

    nlsciadc.add_entry_fresco WARNING: tile not found at 2006-03-12 02:45:03.555000: not ingesting file /SCIA/share/Fresco/2006/fresco20060312_021041.dat.gz

    I'm going to ingest all states and then experiment more freely.

     
  • Mario Frasca

    Mario Frasca - 2006-12-12
    • status: open --> pending
     
  • Mario Frasca

    Mario Frasca - 2006-12-12

    Logged In: YES
    user_id=512199
    Originator: YES

    375 mariof add_entry_fresco.py

    completely rewritten the ingest routine.

    to minimize communication with database:
    first read the file,
    compute the timeframe,
    query about states and tiles falling in timeframe (TWO queries),
    work only with objects in memory,
    perform ONE query to insert missing tiles,
    perform ONE query to insert fresco readings.

    the time is now around 60 seconds on files describing 12000 tiles (was 3 minutes).
    there is a negligible performance difference if the tiles have to be inserted or not.

     
  • SourceForge Robot

    Logged In: YES
    user_id=1312539
    Originator: NO

    This Tracker item was closed automatically by the system. It was
    previously set to a Pending status, and the original submitter
    did not respond within 14 days (the time period specified by
    the administrator of this Tracker).

     
  • SourceForge Robot

    • status: pending --> closed