#64 youtube flash video overmatched by xunlei

[Daniel D.]

We have found out the problem with downloading flash videos from websites as youtube.com or video.google.com. It does not work since I have updated our protocol patterns on the 9th of January 2009.

After some testing I know that new xunlei pattern is the source of pain and the text in pattern file confirms my concern.

xunlei

# This was the pattern until 2008 11 08. It is safer than the above against
# overmatching ordinary HTTP connections
#^[()]...?.?.?(reg|get|query)

We use l7-filter kernel version 2.17
and protocol definitions 2008-12-18.

I tried to rollback protocol definitions to 2008-04-23, but any success. Perhaps google changed something in distribution of theirs videos ?

Our problem is pretty good replicable from router/nat server. See below:

# ./youtube-dl http://www.youtube.com/watch?v=kKO9h-gG4Qg
[youtube] kKO9h-gG4Qg: Downloading video webpage
[youtube] kKO9h-gG4Qg: Extracting video information
[youtube] kKO9h-gG4Qg: URL: http://uk.youtube.com/get_video?video_id=kKO9h-gG4Qg&t=OEgsToPDskIWblHqOyYMv_h0t4RUJQsf
[download] Destination: kKO9h-gG4Qg.flv
ERROR: unable to write video data: <urlopen error timed out>

# ./youtube-dl http://www.youtube.com/watch?v=kKO9h-gG4Qg
[youtube] kKO9h-gG4Qg: Downloading video webpage
[youtube] kKO9h-gG4Qg: Extracting video information
[youtube] kKO9h-gG4Qg: URL: http://uk.youtube.com/get_video?video_id=kKO9h-gG4Qg&t=OEgsToPDskKIRV3QGUT1ULvcSbFw1ek8
[download] Destination: kKO9h-gG4Qg.flv
[download] 100.0% of 4.48M at 104.67k/s ETA 00:00

# ./youtube-dl http://www.youtube.com/watch?v=kKO9h-gG4Qg
[youtube] kKO9h-gG4Qg: Downloading video webpage
[youtube] kKO9h-gG4Qg: Extracting video information
[youtube] kKO9h-gG4Qg: URL: http://uk.youtube.com/get_video?video_id=kKO9h-gG4Qg&t=OEgsToPDskKFE3qYLDGooWUrGRuBDikH
[download] Destination: kKO9h-gG4Qg.flv
ERROR: unable to write video data: <urlopen error timed out>

We have to deactivate xunlei pattern at this time.