#12 Use new LUWS format

[AEverett]

The new LUWS directory exports to CSV in a different format than the classic LUWS. The address and name fields are completely different. Attached is a "mostly" modified version of ldscsvreader.py (Still to fix: the couple name in the new CSV export already uses '&' instead of 'and' -- thus will need to make a change to get_name() ).

[AEverett]

New-LUWS modifications

[Jeff Copeland]

Thanks for highlighting the issue and making an effort to fix it yourself. I've taken your input and put am putting together a new release (0.37) to add support for the new LUWS format. I've gone a slightly different direction to maintain compatibility with the old LUWS data since it will still be up and available (atleast thru 2011).

So far as I can tell there is only one problem with supporting the new LUWS format. It doesn't seem to be possible to distinguish the street address from the city in the address format. All component of the address are present in a single field and there is no comma or other delimiter separating them. This short-coming will only effect users who use the "short address" option in the tool. Since the city can not be determined, I'm only able to eliminate state/zip instead of city/state zip for short addresses.

A simplistic fix attempt to circumvent this issue would be to assume that word prior to the comma must be the city name, but this would not work in the general case where a city name could be composed of multiple words.

So I'd say the this update adds the best support of the new format it can, given the current limitations of the data format. Look for it shortly.