[Scratchy-user] Another bug in Scratchy 0.8

[GeckoX <ge...@ke...>]

I was parsing a 6.5 MB log file and Scratchy puked up this hairball:

xxxx@hermes:/scratchy# ./parse.py -c config_old_eocto
>> Parsing log: /test-temp/templeofolympus.org-access_log.6
>> Disabling keys for all tables
.. [ completion time: 0 seconds ]
>>    Parsing date: 9/2004
.. [ completion time: 112 seconds ]
>>    Parsing date: 10/2004
.. [ completion time: 614 seconds ]
>>    Parsing date: 11/2004
.. [ completion time: 545 seconds ]
>>    Parsing date: 12/2004
.. [ completion time: 292 seconds ]
Traceback (most recent call last):
  File "./parse.py", line 1022, in ?
    date_tuples += log.process_log()
  File "./parse.py", line 373, in process_log
    file_tracker.set(first_line, file_size, file_offset)
  File "/usr/local/share/scratchy-0.8/modules/file_tracker.py", line 51, in set
    self.insert(first_line, file_size)
  File "/usr/local/share/scratchy-0.8/modules/file_tracker.py", line 35, in insert
    self.cursor.execute(sql)
  File "/usr/lib/python2.4/site-packages/MySQLdb/cursors.py", line 137, in execute
    self.errorhandler(self, exc, value)
  File "/usr/lib/python2.4/site-packages/MySQLdb/connections.py", line 33, in defaulterrorhandler
    raise errorclass, errorvalue
_mysql_exceptions.IntegrityError: (1062, 'Duplicate entry \'208.42.19.154 - - [26/Sep/2004:14:51:36 -0500] "GET /frameset.php HTTP/1.1" 200 751 "http://www.keller-heikkila.org/bookmarks/index?setFolderIsOpen=0&folder=%2FT...\' for key 1')
xxxx@hermes:/scratchy# ./parse.py -c config_old_eocto
>> Parsing log: /test-temp/templeofolympus.org-access_log.6
Traceback (most recent call last):
  File "./parse.py", line 1022, in ?
    date_tuples += log.process_log()
  File "./parse.py", line 224, in process_log
    file_tracker_id = file_tracker.insert(first_line, file_size)
  File "/usr/local/share/scratchy-0.8/modules/file_tracker.py", line 35, in insert
>    self.cursor.execute(sql)
  File "/usr/lib/python2.4/site-packages/MySQLdb/cursors.py", line 137, in execute
    self.errorhandler(self, exc, value)
  File "/usr/lib/python2.4/site-packages/MySQLdb/connections.py", line 33, in defaulterrorhandler
    raise errorclass, errorvalue
_mysql_exceptions.IntegrityError: (1062, 'Duplicate entry \'208.42.19.154 - - [26/Sep/2004:14:51:36 -0500] "GET /frameset.php HTTP/1.1" 200 751 "http://www.keller-heikkila.org/bookmarks/index?setFolderIsOpen=0&folder=%2FT...\' for key 1')
xxxx@hermes:/scratchy#

-------------------------------

Notice that when I tried to parse the log file again, it puked immediately.

Thanks.
:GeckoX
-- 
--------------------------------
Freedom is slavery.
Ignorance is strength.
War is peace.
                -- George Orwell