XMLTV

On 11 September 2012 10:26, Neil Bird <neil@...> wrote:
>
>    A quick look at the latest prog_titles_to_process script doesn't seem to
> show a fix-up for this (and it might not easily be able to).  I'm starting
> to see:
>
> title=PROG_TITLE
> subtitle=New PROG_TITLE: REAL_SUBTITLE
>
>    .. in the listings.
>
>    E.g., (at time of writing) in the BBC's Universal listings (180.dat):
>
> Rookie Blue~2/13, series 3~New Rookie Blue: Class Dismissed~...
>
>    That's the only example I can remember, my Myth box is off at the moment,
> but I'm sure I saw it for another program last week as well.  I'll feed back
> more if I find any when I can get it turned back on and look in the history.

Hey Neil,

Thanks for the details. Which version of XMLTV are you running?

Regarding your specific query, the grabber uses "type 7" updates on a
case-by-case basis for similar programme fixups such as for Dispatches
on C4. This fixup can update a programme's subtitle based on a given
title.

I've added a fixup for this Rookie Blue episode (didn't see any more
affected episodes for this title). Let me know if this fixes things
for you.

Cheers,
Nick

I'm sure I've spotted one or two more of these. Warehouse 13 comes
to mind.

After a quick sql run, I can offer the following from my listings,
which are Freeview + Virgin Cable:

select title, xmltvid, subtitle from program p join channel c using
(chanid) where subtitle like 'New%:%' order by title, subtitle;
+-----------------+------------------------------------+----------------------------------+
| title           | xmltvid                            | subtitle   
                     |
+-----------------+------------------------------------+----------------------------------+
Round Nine           |
| Cowboy Builders | channel5.co.uk                     | New Cowboy
Builders: Fleet       |
| Cowboy Builders | channel5.co.uk                     | New Cowboy
Builders: Fleet       |
| Cowboy Builders | channel5.co.uk                     | New Cowboy
Builders: St Albans   |
| Cowboy Builders | channel5.co.uk                     | New Cowboy
Builders: St Albans   |
| Cowboy Builders | channel5.co.uk                     | New Cowboy
Builders: St Albans   |
| Cowboy Builders | channel5.co.uk                     | New Cowboy
Builders: St Albans   |
| Rookie Blue     | tsod.plus-1.universalchannel.co.uk | New Rookie
Blue: Class Dismissed |
| Rookie Blue     | universalchannel.co.uk             | New Rookie
Blue: Class Dismissed |
| Rookie Blue     | tsod.plus-1.universalchannel.co.uk | New Rookie
Blue: Class Dismissed |
| Rookie Blue     | universalchannel.co.uk             | New Rookie
Blue: Class Dismissed |
| Warehouse 13    | uk.syfy.com                        | New
Warehouse 13: An Evil Within |
| Warehouse 13    | tsod.plus-1.uk.syfy.com            | New
Warehouse 13: An Evil Within |
| Warehouse 13    | uk.syfy.com                        | New
Warehouse 13: An Evil Within |
| Warehouse 13    | tsod.plus-1.uk.syfy.com            | New
Warehouse 13: An Evil Within |
| Warehouse 13    | tsod.plus-1.uk.syfy.com            | New
Warehouse 13: An Evil Within |
| Warehouse 13    | tsod.plus-1.uk.syfy.com            | New
Warehouse 13: An Evil Within |
| Warehouse 13    | uk.syfy.com                        | New
Warehouse 13: An Evil Within |
| Warehouse 13    | uk.syfy.com                        | New
Warehouse 13: An Evil Within |
+-----------------+------------------------------------+----------------------------------+



-- 
Mike Holden

http://www.by-ang.com - the place to shop
for all manner of hand crafted items,
including Jewellery, Greetings Cards and Gifts

Nick Morrott wrote:
> On 11 September 2012 10:26, Neil Bird <neil@...> wrote:
>>
>>    A quick look at the latest prog_titles_to_process script
>> doesn't seem to
>> show a fix-up for this (and it might not easily be able to).  I'm
>> starting
>> to see:
>>
>> title=PROG_TITLE
>> subtitle=New PROG_TITLE: REAL_SUBTITLE
>>
>>    .. in the listings.
>>
>>    E.g., (at time of writing) in the BBC's Universal listings
>> (180.dat):
>>
>> Rookie Blue~2/13, series 3~New Rookie Blue: Class Dismissed~...
>>
>>    That's the only example I can remember, my Myth box is off at
>> the moment,
>> but I'm sure I saw it for another program last week as well.  I'll
>> feed back
>> more if I find any when I can get it turned back on and look in
>> the history.
>
> Hey Neil,
>
> Thanks for the details. Which version of XMLTV are you running?
>
> Regarding your specific query, the grabber uses "type 7" updates on
> a
> case-by-case basis for similar programme fixups such as for
> Dispatches
> on C4. This fixup can update a programme's subtitle based on a given
> title.
>
> I've added a fixup for this Rookie Blue episode (didn't see any more
> affected episodes for this title). Let me know if this fixes things
> for you.
>
> Cheers,
> Nick
>
> ------------------------------------------------------------------------------
> Got visibility?
> Most devs has no idea what their production app looks like.
> Find out how fast your code is with AppDynamics Lite.
> http://ad.doubleclick.net/clk;262219671;13503038;y?
> http://info.appdynamics.com/FreeJavaPerformanceDownload.html
> _______________________________________________
> xmltv-users mailing list
> xmltv-users@...
> https://lists.sourceforge.net/lists/listinfo/xmltv-users
>
>

Nick Morrott wrote:
> Thanks for the details. Which version of XMLTV are you running?

   0.5.61;  should that matter?  I thought the guide fioxups were in a 
supplementary download?


> I've added a fixup for this Rookie Blue episode (didn't see any more
> affected episodes for this title). Let me know if this fixes things
> for you.

   Looking back, it was the previous episode that had done it.  Future 
episodes seem to be coming up OK.  But ...


Around about 15/09/12 02:45, Mike Holden typed ...
>  > Nick> I'm sure I've spotted one or two more of these. Warehouse 13 comes
> to mind.

   Yes, Warehouse 13 was the other thing I'd seen that was doing it!  And it 
still is for me.

   From the current 2212.dat:

Warehouse 13~3, series 4~New Warehouse 13: Personal Effects~~
Warehouse 13~3, series 4~New Warehouse 13: Personal Effects~~
Warehouse 13~3, series 4~New Warehouse 13: Personal Effects~~
Warehouse 13~3, series 4~New Warehouse 13: Personal Effects~~


   A quick grep of my ~/.xmltv/cache/* (naturally only showing channels I'm 
personally interested in!) gives the following programmes having the issue:

Rookie Blue
Warehouse 13
Cowboy Builders
Emergency Bikers


   ( using:  grep -P '^([^~]*)~.*~New \1' /home/pvr/.xmltv/cache/* )

-- 
[neil@... ~]# rm -f .signature
[neil@... ~]# ls -l .signature
ls: .signature: No such file or directory
[neil@... ~]# exit

On 17 September 2012 09:31, Neil Bird <neil@...> wrote:
> Nick Morrott wrote:
>> Thanks for the details. Which version of XMLTV are you running?
>
>    0.5.61;  should that matter?  I thought the guide fioxups were in a
> supplementary download?

Fixups are in a supplemental download, but the logic to use them
correctly is in the grabber.

>> I've added a fixup for this Rookie Blue episode (didn't see any more
>> affected episodes for this title). Let me know if this fixes things
>> for you.
>
>    Looking back, it was the previous episode that had done it.  Future
> episodes seem to be coming up OK.  But ...
>
>
> Around about 15/09/12 02:45, Mike Holden typed ...
>>  > Nick> I'm sure I've spotted one or two more of these. Warehouse 13 comes
>> to mind.
>
>    Yes, Warehouse 13 was the other thing I'd seen that was doing it!  And it
> still is for me.
>
>    From the current 2212.dat:
>
> Warehouse 13~3, series 4~New Warehouse 13: Personal Effects~~
> Warehouse 13~3, series 4~New Warehouse 13: Personal Effects~~
> Warehouse 13~3, series 4~New Warehouse 13: Personal Effects~~
> Warehouse 13~3, series 4~New Warehouse 13: Personal Effects~~
>

Fixups added.

>    A quick grep of my ~/.xmltv/cache/* (naturally only showing channels I'm
> personally interested in!) gives the following programmes having the issue:
>
> Rookie Blue
> Warehouse 13
> Cowboy Builders
> Emergency Bikers

Fixups added and new fixup/debug code added to grabber to highlight
such entries and correct them when detected.

Thanks for the nudges!

Cheers,
Nick

Nick Morrott wrote:

>Fixups are in a supplemental download, but the logic to use them
>correctly is in the grabber.

This is probably going to sound rather lame ... but where do I 
download them from, and what do I need to do to install them ?
I'm using Debian Squeeze and 0.24 from Debian-multimedia.

-- 
Simon Hobson

Visit http://www.magpiesnestpublishing.co.uk/ for books by acclaimed
author Gladys Hobson. Novels - poetry - short stories - ideal as
Christmas stocking fillers. Some available as e-books.

On 20 September 2012 21:42, Simon Hobson <linux@...> wrote:
> Nick Morrott wrote:
>
>>Fixups are in a supplemental download, but the logic to use them
>>correctly is in the grabber.
>
> This is probably going to sound rather lame ... but where do I
> download them from, and what do I need to do to install them ?
> I'm using Debian Squeeze and 0.24 from Debian-multimedia.

You don't need to do anything manually with the fixups - the grabber
downloads and applies the fixups automatically if you have the 'Enable
title processing' option enabled in your tv_grab_uk_rt grabber config
file.

Nick

Nick Morrott wrote:

>  >>Fixups are in a supplemental download, but the logic to use them
>>>correctly is in the grabber.
>>
>>  This is probably going to sound rather lame ... but where do I
>>  download them from, and what do I need to do to install them ?
>>  I'm using Debian Squeeze and 0.24 from Debian-multimedia.
>
>You don't need to do anything manually with the fixups - the grabber
>downloads and applies the fixups automatically if you have the 'Enable
>title processing' option enabled in your tv_grab_uk_rt grabber config
>file.

Just to check, that's the line that says "title-processing=enabled" ?

-- 
Simon Hobson

Visit http://www.magpiesnestpublishing.co.uk/ for books by acclaimed
author Gladys Hobson. Novels - poetry - short stories - ideal as
Christmas stocking fillers. Some available as e-books.

On 21 September 2012 09:32, Simon Hobson <linux@...> wrote:
> Nick Morrott wrote:
>
>>  >>Fixups are in a supplemental download, but the logic to use them
>>>>correctly is in the grabber.
>>>
>>>  This is probably going to sound rather lame ... but where do I
>>>  download them from, and what do I need to do to install them ?
>>>  I'm using Debian Squeeze and 0.24 from Debian-multimedia.
>>
>>You don't need to do anything manually with the fixups - the grabber
>>downloads and applies the fixups automatically if you have the 'Enable
>>title processing' option enabled in your tv_grab_uk_rt grabber config
>>file.
>
> Just to check, that's the line that says "title-processing=enabled" ?

Yes - my apologies for not making that clear in my reply. The "Enable
title processing?" text is the question you're asked during
configuration. "title-processing" is the key stored in the
configuration file, which can have the values "enabled" or "disabled"
depending on how you answer the question.

I just checked this morning's grabber run (using the current CVS
version) and the following automated fixups were made (based on my own
channel selection):

  Cowboy Builders / New Cowboy Builders: Fleet
  Rookie Blue / New Rookie Blue: A Good Shoot
  Rookie Blue / New Rookie Blue: Girls' Night Out
  Warehouse 13 / New Warehouse 13: Personal Effects


In the meantime, if anyone running a recent stable release of
XMLTV/tv_grab_uk_rt notices any programmes which are affected in this
manner and are not being corrected, please post details when you
notice them. Providing the required fixup will also make it more
likely they are added. The required format is:

7|TITLE~OLD_SUBTITLE~NEW_SUBTITLE


You can check the prog_titles_to_process file for examples of these
and other fixups I've added.


Cheers,
Nick

Around about 21/09/12 11:04, Nick Morrott typed ...
> In the meantime, if anyone running a recent stable release of
> XMLTV/tv_grab_uk_rt ...

   Which version has got this in?  The latest on the XMLTV page?

   I'll compile up a newer version over the weekend, as my older one is the 
latest available on ATrpms at the moment.

-- 
[neil@... ~]# rm -f .signature
[neil@... ~]# ls -l .signature
ls: .signature: No such file or directory
[neil@... ~]# exit

On 21 September 2012 12:03, Neil Bird <neil@...> wrote:
> Around about 21/09/12 11:04, Nick Morrott typed ...
>> In the meantime, if anyone running a recent stable release of
>> XMLTV/tv_grab_uk_rt ...
>
>    Which version has got this in?  The latest on the XMLTV page?
>
>    I'll compile up a newer version over the weekend, as my older one is the
> latest available on ATrpms at the moment.

The CVS log shows support for the "type 7" fixups was added in the
0.5.57 release which was a few years ago.

Nick

Around about 21/09/12 12:27, Nick Morrott typed ...
> On 21 September 2012 12:03, Neil Bird <neil@...> wrote:
>  >    I'll compile up a newer version over the weekend, as my older one is the
>  > latest available on ATrpms at the moment.
> The CVS log shows support for the "type 7" fixups was added in the
> 0.5.57 release which was a few years ago.

   I installed (a while back now) a newer XMLTV for my Myth box, so I'm now 
running 0.5.63.  I have “title-processing=enabled” in my config. file.

   However, I'm still seeing instances of this “Title/New Title: Subtitle” 
thing happening:

Satellite 	Warehouse 13: New Warehouse 13: Endless Wonder 	114 - SyFy 	Thu 
Oct 18, 2012 (09:00 PM) 	1 hr

   [last night's was the same]


   Any idea what might be wrong?

-- 
[neil@... ~]# rm -f .signature
[neil@... ~]# ls -l .signature
ls: .signature: No such file or directory
[neil@... ~]# exit

On 12 October 2012 08:11, Neil Bird <neil@...> wrote:
> Around about 21/09/12 12:27, Nick Morrott typed ...
>>
>> On 21 September 2012 12:03, Neil Bird <neil@...> wrote:
>>  >    I'll compile up a newer version over the weekend, as my older one is
>> the
>>  > latest available on ATrpms at the moment.
>> The CVS log shows support for the "type 7" fixups was added in the
>> 0.5.57 release which was a few years ago.
>
>
>   I installed (a while back now) a newer XMLTV for my Myth box, so I'm now
> running 0.5.63.  I have “title-processing=enabled” in my config. file.

Great.

>   However, I'm still seeing instances of this “Title/New Title: Subtitle”
> thing happening:
>
> Satellite       Warehouse 13: New Warehouse 13: Endless Wonder  114 - SyFy
> Thu Oct 18, 2012 (09:00 PM)     1 hr
>
>   [last night's was the same]
>
>
>   Any idea what might be wrong?

As mentioned at the start of the thread, these errors are handled on a
case-by-base basis (in versions of XMLTV/uk_rt <= 0.5.63).

If no-one has pointed out such uncorrected errors - and I haven't
noticed them and added fixups - they won't be corrected unless you're
running post-0.5.63 code which attempts to do this automatically.

I've checked the upstream listings for SyFy and all occurences of
Warehouse 13 are clean for the next fortnight (inasmuch as they do not
contain the "New Title" text in the subtitle field). Whether this will
be the case going forward for the rest of the series only time will
tell.

In any case, I've added a fixup for the "Endless Wonder" episode in
case it reappears. Please let me know if you see any other problematic
episodes in the future.

Cheers,
Nick