Menu

#607 Bad Alloc again

Pascal
dup
None
2Critical
2024-07-08
2024-06-26
Steve Keen
No

This is a cycling database, like the one we used:

https://www.kaggle.com/datasets/liamkolanowski/cyclistic-cleaned-data?resource=download

Maybe the data has invalid entries...

It also appears to be frozen on the Restting function, and clicking on Cancel didn't appear to work.

2 Attachments

Discussion

  • Steve Keen

    Steve Keen - 2024-06-26

    Second JPG. I wasn't able to save the file.

     
  • Steve Keen

    Steve Keen - 2024-06-26
    • Attachments has changed:

    Diff:

    --- old
    +++ new
    @@ -1 +1,2 @@
     BadAlloc20230127Resetting.jpg (42.8 kB; image/jpeg)
    +BadAlloc20230127ResettingB.jpg (179.2 kB; image/jpeg)
    
     
  • Steve Keen

    Steve Keen - 2024-06-26

    I couldn't save the file.

     
  • High Performance Coder

    It is a big file. I set to ignore all those fields you can't do much with, so ended up loading bike type, member type, season, day of week and average trip length, and using average to reduce over the dimensions.

    Eg this is the display of average trip length as a function of season. Not sure why the barwidths are too wide - they never used to be.

    You could also do average trip length by day of week (Wednesdays had highest trip length, which seems surprising, then Fridays).

    Alternative analyses are possible, such as slicing by start or end station.

    Pulling the data in took a long time, however, but it did succeed, with no bad_allocs. Probably can't do much about this until we do database backing - importing the data into the database will still take a long time, but only needs to be done once.

     
  • High Performance Coder

    OTOH, if I include the start and end stations, it gets to construct equations, and cancel doesn't appear to work then. Mysterious. I'll check in a debugger, in case there's some infinite loop.

     
  • High Performance Coder

    OK - this issue is a dup of https://sourceforge.net/p/minsky/ravel/564/. NodeJs does some really funky things with the heap - I do have some ideas about how to hack around this annoying restriction, but that is future work.

     
  • High Performance Coder

    • status: open --> dup
    • assigned_to: High Performance Coder
     

Log in to post a comment.