Search Results for "python distributed list"

Let's say you've gathered a bunch of lists from across the internet, in various formats and from various sources. Let's say you've cat'ed them together into one giant master list, sorted and unique'd. However, after starting to work with the master list, you realize it is riddled with a bunch of NULL bytes, which chokes your list processor. removeNULLbytes was made to solve this problem. It will read a master list line by line, remove any NULL bytes, and then write the result into a second file. It treats all files as binary. ...