Menu ▾ ▴

#1122 Automate reconciliation with the SFE3 author list

Approved
closed
Ahasuerus
None
5
2019-04-14
2018-01-17
Ahasuerus
No

The "ISFDB-SFE3 Author Mismatches" cleanup report was originally generated by scanning SFE3's list of authors. Our software then created a subset of SFE3 authors who didn't have an ISFDB entry. For example, SFE3 has an entry for Rudolf Brunngraber, the author of the novel "Radium: Roman eines Elements" (1936), but we don't have a record for him. Note that some SFE3 authors may not be eligible on our side, e.g. if their only SF works were in the comics field, which is why this report displays "Resolve" links.

The biggest problem with this report is that the data was generated a few years ago and is out of sync with the SFE3 author list. Once the current data has been sorted out, we'll need to add a button to perform "on demand" list reconciliation.

2018-12-31 edit: A better solution may be updating the nightly job to re-download and re-parse the lists of SFE3 authors linked from http://sf-encyclopedia.com/category/authors

2019-04-13 edit: Updated the title to reflect the solution outlined in the 2018-12-31 edit.

Discussion

  • Ahasuerus

    Ahasuerus - 2018-12-31
    • Description has changed:

    Diff:

    --- old
+++ new
@@ -1,3 +1,5 @@
 The "ISFDB-SFE3 Author Mismatches" cleanup report was originally generated by scanning SFE3's list of authors. Our software then created a subset of SFE3 authors who didn't have an ISFDB entry. For example, SFE3 has an entry for Rudolf Brunngraber, the author of the novel "Radium: Roman eines Elements" (1936), but we don't have a record for him. Note that some SFE3 authors may not be eligible on our side, e.g. if their only SF works were in the comics field, which is why this report displays "Resolve" links. 

 The biggest problem with this report is that the data was generated a few years ago and is out of sync with the SFE3 author list. Once the current data has been sorted out, we'll need to add a button to perform "on demand" list reconciliation.
+
+2018-12-31 edit: A better solution may be updating the nightly job to re-download and re-parse the lists of SFE3 authors linked from http://sf-encyclopedia.com/category/authors
     

  • Ahasuerus

    Ahasuerus - 2019-04-14
    • summary: Allow on-demand reconciliation with the SFE3 author list --> Automate reconciliation with the SFE3 author list
    • Description has changed:

    Diff:

    --- old
+++ new
@@ -3,3 +3,5 @@
 The biggest problem with this report is that the data was generated a few years ago and is out of sync with the SFE3 author list. Once the current data has been sorted out, we'll need to add a button to perform "on demand" list reconciliation.

 2018-12-31 edit: A better solution may be updating the nightly job to re-download and re-parse the lists of SFE3 authors linked from http://sf-encyclopedia.com/category/authors
+
+2019-04-13 edit: Updated the title to reflect the solution outlined in the 2018-12-31 edit.
    • assigned_to: Ahasuerus
     

  • Ahasuerus

    Ahasuerus - 2019-04-14
    • status: open --> closed
     

  • Ahasuerus

    Ahasuerus - 2019-04-14

    Implemented in:

    common/Makefile
common/sfe3.py
edit/TARGETS
edit/cleanup.py
edit/local.mk
edit/sfe3_authors.py
mod/TARGETS
mod/resolve_sfe3_url.py
nightly/local.mk
nightly/nightly_job.py
scripts/create_sfe3_authors.sql

    Installed in SVN 379 on 2019-04-13.

    Part 2 - Bug fixes:

    nightly/nightly_3rd_parties.py
scripts/create_sfe3_authors.sql

    Installed in SVN 380 on 2019-04-13. Closing the FR.

     

Anonymous
Anonymous

Add attachments
Cancel





MongoDB Logo MongoDB