GUI idea. Is this any good?
The idea would be a web page that was a form with javascript (so the logic implemented in the browser.) on the server side, there would be, for previous days, some index files:
YYYYMMDD/ -- directory tree of feeds from that day.
YYYYMMDD.Contents.tgz -- contains tar -tzvf output of that tree.
YYYYMMDD.DirC.tgz -- contains only the directories, listing #files, and #bytes for each one.
these files would likely be downloaded in the background, or a setting could be set ´make estimates?´ if checked, then it does get downloaded...
the web page would provide fields, auto populated by the contents of DirC files.
for instance:
broker: amqp://dd.weather.gc.ca <-- auto populated based on current server.
subtopic: * <- auto populate . based on ´every day´
. <- tab completion based on content of DirC.
flags:
mirror (off) <- checkbox for flags.
skip [ 2 ] <- values for numeric settings.
reject
accept
Download per day ( # files: 352531 # of bytes: 2.141G ) <--- populated from Contents.
Ideally, all of the settings will have links or popups with explanations.
<generate> <-- button to generate configuration file in the Downloads directory.</generate>
Diff:
have had lots of discussion with Daniel. The intial table of contents file for a day on one server was over 1G, so not really downloadable in one shot. Talking about how to make that more
suitable.
It exists: https://github.com/MetPX/sarrasemina
and it is terrific!