Use XBMC's XML scrapers for HTTP scraping

Brought to you by: bro3, mediterranean

#31 Use XBMC's XML scrapers for HTTP scraping

Status: open

Owner: nobody

Labels: None

Priority: 5

Updated: 2013-02-12

Created: 2007-10-05

Creator: Andreas Setterlind

Private: No

XBMC (The XboxMediaCenter Project) uses a very nice API for letting anyone create and/or maintaining XML and RegEx based scrapers, scrapers that scrape HTTP websites for metadata (sites such as IMDb, TheTVDB, TV.com, and many more), metadata for movies, TV-shows and music-videos. It would be great it MeD's Movie Manager could integreat that parser API so that is could use XBMC scraper XML files as is, cross compatible with both applications.

The API will only require that you integrate basic XML parser and RegEx parser into MeD's Movie Manager. Then you will have to convert XBMC's ScraperParser.cpp from C++ to JAVA code.

http://sourceforge.net/projects/xbmc

The existing scapers can be found in the SVN under:
/trunk/XBMC/system/scrapers/

Find the C++ source code for XBMC parser here:
/trunk/XBMC/xbmc/utils/ScraperParser.cpp

If you do not have a SVN tool then download here:
http://xbmc.svn.sourceforge.net/viewvc/xbmc/trunk/XBMC/system/scrapers/video/
http://xbmc.svn.sourceforge.net/viewvc/xbmc/trunk/XBMC/xbmc/utils/ScraperParser.cpp

PS! Find XML parsers and RegEx parsers for JAVA here:
http://java.sun.com/javase/6/docs/api/java/util/regex/package-summary.html
http://www.brics.dk/automaton/
http://en.wikipedia.org/wiki/VTD-XML

Discussion

1 2 3 > >> (Page 1 of 3)

Andreas Setterlind - 2008-02-13

Logged In: YES
user_id=630186
Originator: YES

You can download the XML scraper examples here (IMDb.xml is the best one to use as a reference):
http://xbmc.svn.sourceforge.net/viewvc/xbmc/branches/linuxport/XBMC/system/scrapers/video/

More about the scraper function in XBMC can be found in the XBMC wiki:
http://xbmc.org/wiki/?title=Scraper
http://xbmc.org/wiki/?title=How_To_Write_Media_Info_Scrapers
http://xbmc.org/wiki/?title=Scrap
http://xbmc.org/wiki/?title=How_To_use_Scrapers

PS! A good overview of XBMC can be read in wikipedia:
http://en.wikipedia.org/wiki/XBMC

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Nobody/Anonymous - 2008-05-26

Logged In: NO

I would very much want this feature!

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Nobody/Anonymous - 2012-09-21

best for you, <a href= http://www.twitter.com/webcamsexea >web cam sex</a>, [url= http://www.twitter.com/webcamsexea ]web cam sex[/url], rigdoy,

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Nobody/Anonymous - 2012-09-21

Beautiful site, <a href= http://www.dafont.com/profile.php?user=#1 >amy fisher sex tape</a> [url=http://www.dafont.com/profile.php?user=#1]amy fisher sex tape[/url], =-],

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Nobody/Anonymous - 2012-09-21

I have the same., http://www.twitter.com/webcamsexoi web cam sex, khron,

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Nobody/Anonymous - 2012-09-21

Great, <a href= http://www.dafont.com/profile.php?user=572534#1 >Cheap shemale sex</a> [url=http://www.dafont.com/profile.php?user=572534#1]Cheap shemale sex[/url], 939,

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Nobody/Anonymous - 2012-09-21

Thank You, <a href= http://www.twitter.com/bbwsexia >bbw sex discount</a>, [url= http://www.twitter.com/bbwsexia ]bbw sex discount[/url], lmbt,

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Nobody/Anonymous - 2012-09-21

Thank you, <a href= http://www.dafont.com/profile.php?user=572539#1 >Discount high risk personal loans</a> [url=http://www.dafont.com/profile.php?user=572539#1]Discount high risk personal loans[/url], 8-D,

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Nobody/Anonymous - 2012-09-21

Great site. Keep doing., <a href= http://www.twitter.com/nocreditchecod >no credit check loans here</a>, [url= http://www.twitter.com/nocreditchecod ]no credit check loans here[/url], 63908,

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Nobody/Anonymous - 2012-09-21

Only, <a href= http://www.dafont.com/profile.php?user=572544#1 >Cheapest guaranteed online personal loans</a> [url=http://www.dafont.com/profile.php?user=572544#1]Cheapest guaranteed online personal loans[/url], =(((,

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Nobody/Anonymous - 2012-09-21

Perfect work, <a href= http://www.twitter.com/mortgageratese >mortgage rates predictions</a>, [url= http://www.twitter.com/mortgageratese ]mortgage rates predictions[/url], 177959,

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Nobody/Anonymous - 2012-09-21

Hi, <a href= http://www.dafont.com/profile.php?user=572548 >student loan forgiveness</a>, [url= http://www.dafont.com/profile.php?user=572548 ]student loan forgiveness[/url], :-O,

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Nobody/Anonymous - 2012-09-21

can you do thi for me, <a href= http://www.twitter.com/airlinediscoed#1 >airline discount ticket military information</a> [url=http://www.twitter.com/airlinediscoed#1]airline discount ticket military information[/url], htcx,

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Nobody/Anonymous - 2012-09-21

Is it so important?, <a href= http://www.dafont.com/profile.php?user=572552 >Real super cheap airplane tickets</a>, [url= http://www.dafont.com/profile.php?user=572552 ]Real super cheap airplane tickets[/url], 8-]],

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Nobody/Anonymous - 2012-09-21

I like your work!, <a href= http://www.twitter.com/veryshortskiei >Buy very short skirts</a>, [url= http://www.twitter.com/veryshortskiei ]Buy very short skirts[/url], 949,

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Nobody/Anonymous - 2012-09-21

It is a very good thing, http://www.dafont.com/profile.php?user=572556 Discount indian reservation cigarettes, %-))),

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Nobody/Anonymous - 2012-09-21

Your Site Is Great, http://www.twitter.com/knockoffcoacso Only knock off coach purses, %-],

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Nobody/Anonymous - 2012-09-21

Thank You, http://www.dafont.com/profile.php?user=572560 Cheapest coach handbags, wuo,

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Nobody/Anonymous - 2012-09-21

best for you, http://www.twitter.com/coachpursesei coach purses discount, 673,

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Nobody/Anonymous - 2012-09-21

:-(, http://www.dafont.com/profile.php?user=572567 replica rolex watches price, :[,

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Nobody/Anonymous - 2012-09-21

I want to say thanks!, http://www.twitter.com/gropingtraines groping train online, 6860,

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Nobody/Anonymous - 2012-09-21

Nice, http://www.dafont.com/profile.php?user=572571 debt cures information, %(((,

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Nobody/Anonymous - 2012-09-21

What?, <a href= http://www.twitter.com/paycapitalonaa >pay capital one credit card bill</a>, [url= http://www.twitter.com/paycapitalonaa ]pay capital one credit card bill[/url], 8992,

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Nobody/Anonymous - 2012-09-21

Incredible site!, http://www.dafont.com/profile.php?user=572575 Discount watch my wife, 9384,

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Nobody/Anonymous - 2012-09-21

I bookmarked this guestbook., <a href= http://www.twitter.com/xanaxonlineoie#1 >xanax online overnight shipping discount</a> [url=http://www.twitter.com/xanaxonlineoie#1]xanax online overnight shipping discount[/url], rdsmb,

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

1 2 3 > >> (Page 1 of 3)

Log in to post a comment.