Menu

#857 Add Creative Commons Metadata bot to robots.pm

open
nobody
None
5
2012-10-11
2011-04-09
No

For sites with a Creative Commons badge linking back to a creativecommons.org, the Creative Commons Metadata Scraper may load pages to extract RDFa data such as authorship and original source. The bot identifies itself as:

CC Metadata Scaper http://wiki.creativecommons.org/Metadata_Scraper

(Note that the typo in 'CC Metadata Scaper' is reproduced correctly.)

Please add a matching signature to robots.pm upstream.

Discussion


Log in to post a comment.