#657 Create a cleanup script to find titles not associated with publications

[Ahasuerus]

Create a cleanup script to find titles not associated with publications. As of July 2014, we have 3,706 pub-less titles of the following types:

+--------------+----------+
| title type | count |
+--------------+----------+
| ANTHOLOGY | 37 |
| COLLECTION | 35 |
| COVERART | 60 |
| INTERIORART | 230 |
| EDITOR | 168 |
| ESSAY | 513 |
| NOVEL | 804 |
| NONFICTION | 244 |
| NONGENRE | 93 |
| OMNIBUS | 15 |
| POEM | 156 |
| SERIAL | 35 |
| SHORTFICTION | 1306 |
| CHAPTERBOOK | 10 |
+--------------+----------+

We should start by creating a cleanup script to find pub-less COVERART/INTERIORART titles. Once they have been cleaned up, we can create more scripts.

[Ahasuerus]

First version of the script covering COVERART and INTERIORART implemented in:

mod/cleanup.py 1.34
mod/TARGETS 1.47
mod/titles_without_pubs.py 1.1
nightly/nightly_update.py 1.14

Installed in r2014-247 on 2014-08-19. Keeping the FR open since we will need to add more title types once the first two types have been cleaned up.

[Ahasuerus]

Part 2: Added CHAPTERBOOKs and the ability to ignore titles. Implemented in:

mod/titles_without_pubs.py 1.3
nightly/nightly_update.py 1.31

Installed in r2014-282 on 2014-09-11. Keeping the FR open; it will be used to document the addition of other title types as we work our way through them.

[Ahasuerus]

"Interviews and Reviews not in Pubs" were folded into "Titles without Pubs" as part of FR 695. Also added SERIAL titles to the report logic.

[Ahasuerus]

Added OMNIBUSes without pubs. Implemented in:

mod/titles_without_pubs.py 1.7
nightly/nightly_update.py 1.43

Installed in r2014-307 on 2014-09-20.

[Ahasuerus]

Added COLLECTIONs without pubs. Implemented in:

mod/titles_without_pubs.py 1.8
nightly/nightly_update.py 1.44

Installed in r2014-308 on 2014-09-20.

[Ahasuerus]

Make title records disappear once they have had a publication added to them - implemented in mod/titles_without_pubs.py 1.9, installed in r2014-309 on 2014-09-20.

[Ahasuerus]

Added ANTHOLOGY support in:

mod/titles_without_pubs.py 1.10
nightly/nightly_update.py 1.45

Installed in r2014-312 on 2014-09-21.

[Ahasuerus]

Added EDITORs in:

mod/titles_without_pubs.py 1.11
nightly/nightly_update.py 1.46

Installed in r2014-314 on 2014-09-22.

[Ahasuerus]

Added NONGENRE records in:

mod/titles_without_pubs.py 1.12
nightly/nightly_update.py 1.47

Installed in r2014-315 on 2014-09-23.

[Ahasuerus]

Added NONFICTION in:

mod/titles_without_pubs.py 1.13
nightly/nightly_update.py 1.48

Installed in r2014-317 on 2014-09-23.

[Ahasuerus]

Added support for NOVELs in:

mod/titles_without_pubs.py 1.14
nightly/nightly_update.py 1.51

Installed in r2014-337 on 2014-10-13. Keeping the FR open since there are 3 other title types that will need to be added once all NOVELs have been processed.

[Ahasuerus]

Added ESSAYs in:

edit/cleanup_report.py 1.131
nightly/nightly_update.py 1.230

Installed in r2017-273 on 2017-07-02. Keeping open.

[Ahasuerus]

Added POEMs in:

edit/cleanup_report.py 1.132
nightly/nightly_update.py 1.231

Installed in r2017-274 on 2017-07-03. Keeping open since we still need to add SHORTFICTION.

[Ahasuerus]

Added SHORTFICTION:

edit/cleanup_report.py 1.134
nightly/nightly_update.py 1.233

Installed in r2017-276 on 2017-07-05.