Name | Modified | Size | Downloads / Week |
---|---|---|---|
scrapemaster.py | 2015-12-05 | 986 Bytes | |
README.txt | 2015-12-05 | 1.1 kB | |
scrape offline.py | 2015-12-05 | 3.7 kB | |
scrape.py | 2015-12-05 | 390 Bytes | |
Totals: 4 Items | 6.2 kB | 0 |
7:53 PM 12/4/2015 scrape master calls the scrape script to download the site html every hour, then runs the scrape offline script to plot data. every pull from the website is saved and used in the plot. the date is not saved, however, so all the different time of day are assigned the same date. I can fix that if I extract the date from the last update of the website. It would cause some error around midnight, when the previous day's cars are assigned to the next day. I could make another fix to check the last update time - wait time of the vehicle... but that's a lot of uninteresting coding that I don't want to spend time on. I don't have access to long-term uninterrupted internet, so I'm not testing the script further. The offline script worked with manually downloaded html files. Losing interest in this project. So I don't expect to update it at this time. 3:40 PM 12/2/2015 Not finished yet. Plot is up. TODO: have the online function pull htmls from the website create a main function to run the online function, then run the offline function.