www.channel4.com: Using Rtmpdump for downloading 4OD videos

[hyc]

It's really not hard, you guys are all not reading carefully enough.

Originally Posted by WhynotAndy

Hello thanks for the answer
I had a go with the code you suggested and it didn't work
here is the debug info
I used a different video form the site as well as the original i posted a link to

C:\rtmp>rtmpdump -r rtmpe://ll.securestream.channel4.com/a4174/e1/mp4:xcuassets/
CH4_08_02_16_48491005001001_001.mp4 -W http://www.channel4.com/static/programmes
/asset/flash/swf/4odplayer-4.37.swf -a 4oD -y mp4:xcuassets/CH4_08_02_16_4849100
5001001_001 -V -o output.mp4 -p http://www.channel4.com/programmes/embarrassing-
bodies/4od#3039233

The manpage says quite plainly, a valid RTMP URL is of the form
rtmp://server/app/playpath

When the paths are simple, rtmpdump can parse them itself. Otherwise, you have to give them explicitly.

Your RTMP URL is rtmpe://ll.securestream.channel4.com/a4174/e1/blahblahblah.

Obviously the app in this case is a4174/e1, not 4oD.

That's why the server responds with

DEBUG: Property: <Name:               description, STRING:      [ Server.Reject
] : (_defaultRoot_, _defaultVHost_) : Application (4oD) is not defined.>

Pay attention to what's in front of you.

[non77]

Originally Posted by hyc

It's really not hard, you guys are all not reading carefully enough.

Thanks for that hyc. I feel stupid now.

[stumk]

Has anyone successfully downloaded a 4od stream using rtmpdump?

I have been able to by using rtmpsrv and the using the rtmpdump command line that rtmpsrv generates... I am trying to write my own code which parses the xml file and will automatically create the command line for rtmpdump, but I'm having a problem understanding the '&h=' parameter in the following command line:

rtmpdump -r "rtmpe://ll.securestream.channel4.com:1935/a4174/e1/?ovpfv=1.1&e=1270744609&ip=83.170.109.88&h=1eb4f5ac0e052ec07529dc08502c2451" -a "a4174/e1/?ovpfv=1.1&e=1270744609&ip=83.170.109.88&h=1eb4f5a c0e052ec07529dc08502c2451" -f "WIN 10,0,45,2" -W "http://www.channel4.com/static/programmes/asset/flash/swf/4odplayer-4.37.1.swf" -p "http://www.channel4.com/programmes/how-the-other-half-live/4od#3026478" -C Z: -y "mp4:xcuassets/CH4_08_02_16_46004003001001_002.mp4?e=1270744609&i p=83.170.109.88&h=1eb4f5ac0e052ec07529dc08502c2451 " -o CH4_08_02_16_46004003001001_002.mp4

I think it may be generated automatically (by the 4od swf?) as it is not included anywhere in the xml file.

Any help or comment would be appreciated.

Regards,

stumk

[non77]

Looks like an md5 hash to me, 'h' standing for hash and md5 because it's 128 bit

[elch]

You could try to scan all traffic for this hash, e.g. using ngrep or Wireshark. I'm sure the hash is received from their servers. That's what BBC does at least.

[elch]

Originally Posted by elch

You could try to scan all traffic for this hash, e.g. using ngrep or Wireshark. I'm sure the hash is received from their servers. That's what BBC does at least.

This implements 4oD downloading (get-flash-videos / 4od.pm):

http://github.com/monsieurvideo/get-...eo/Site/4od.pm

See
http://www.yuri.org.uk/~murble/rtmpdump/ch4.txt
and
http://www.yuri.org.uk/~murble/rtmpdump/ch4.xml

for an explanation what the parameters represent/how they are composed.

[nonna]

Has anyone got the get-flash-videos program with the 4od.pm and channel4.pm plugins to work as elch has posted above?

I don't think they currently work as the URL scheme has changed. Looking at those two plugins and an copy of get_iplayer that has channel4 functionality they all seem to be looking for a URL that ends with /catch-up# but it seems the new URLs end in /4od# . Also they reference this URL: _http://www.channel4.com/services/catchup-availability/asset-info/

Which as far as I can tell, having no programming knowledge, get_iplayer says should be followed by #(program number), without the parenthesis. Doing that you get an error page not the metadata in XML format for the asset number as mentioned in the previous post.

Does anyone know the URL for the XML metadata? I cannot seem to find where the XML files are located. The fact that both stumk and elch seem to have found them means I must missing something.

Perhaps if it is known then the code can be changed to reflect both where it is located and the 4od# vs catch-up# issue. I am sure that is overly simplified but with no programming knowledge I can not comment knowledgeably about it.

Also I am curious if anyone has been able to use RTMPDUMP successfully with a command similar to that posted by elch here
_http://www.yuri.org.uk/~murble/rtmpdump/ch4.txt

I tried and did not have success.

Also curious if anyone know what the -C Z: in stumk's rtmpdump command refers to. I don't quite understand what null data is being passed and if it is supposed to refer to secure token data, which I have tried using the -T parameter, also with no success.

With the verbose mode I can get it to connect but it seems to fail at the sending play part. And it seems no matter what play path I put it always fails. Does it stop for others at this point also?

Or am I the only one for whom RTMPDUMP does not work with channel4? At this point I wouldn't doubt it.

Any help is appreciated.

Thanks

[stumk]

Hi nonna,

to retrieve XML data for this program:

_http://www.channel4.com/programmes/time-team/4od#2928286

use the following:

_http://www.channel4.com/programmes/time-team/4od/asset/2928286?1598247633

The '-C Z:' parameter in my rtmpdump command was as a result of using rtmpsrv.

I was able to successfully download a programme using the parameters provided by rtmpsrv, but was unable to generate parameters automatically from the xml file. I was unable to generate the '&h' parameter. As elch & non77 indicated, the &h is a hash of some form, but I think it is generated dynamically by the 4od player .swf file. I could not find it anywhere in any of the network activity. I'd be very interested if you are able to do this....

stumk

[nonna]

Thanks Stumk

Good to know you got RTMPDUMP to work but just confirms for me that somehow I am the problem.

After looking at my temporary internet files folder for IE I did find the XML URLs. If having the -C Z: worked for you then I have to rule it out as a potential problem.

Sometimes I get URLs in the format that your command has and that elch posted other times I get one in the format

rtmpdump -r "rtmpe://ak.securestream.channel4.com:1935/4oD/?ovpfv=1.1&auth=da_dDdtdPbUaCaybLcpdrcydcazdpaNb1dz-bl1que-eS-mAV-lSq1s5o6rxpIrrotmWp3pFtwmhoftVtWluq0sXoyrVp6rFoEmxp9p5tXm9pstzt6lmqXsIoCrfpWr3oW&aifp=v002&slist=assets/CH4_08_02_16_25880001001001_001.mp4" -a "4oD/?ovpfv=1.1&auth=da_dDdtdPbUaCaybLcpdrcydcazdpaNb1dz-bl1que-eS-mAV-lSq1s5o6rxpIrrotmWp3pFtwmhoftVtWluq0sXoyrVp6rFoEmxp9p5tXm9pstzt6lmqXsIoCrfpWr3oW&aifp=v002&slist=assets/CH4_08_02_16_25880001001001_001.mp4" -f "WIN 10,0,45,2" -W "http://www.channel4.com/static/programmes/asset/flash/swf/4odplayer-4.49.5.swf" -p "http://www.channel4.com/programmes/the-italian-kitchen/4od" -C Z: -y "mp4:assets/CH4_08_02_16_25880001001001_001.mp4" -o CH4_08_02_16_25880001001001_001.mp4

That one with never works or connects for me.

The ones in the form you posted at least connect but always fail here:

HandleInvoke, server invoking <_result>
DEBUG: HandleInvoke, received result for method call <createStream>
DEBUG: SendPlay, seekTime=0, stopTime=0, sending play: mp4:xcuassets/CH4_08_02_16_25880001001001_001.mp4?e=1272980969&ip=212.100.250.207&h=ff41ce09cfa7a343e43603d5afda915a
DEBUG: Invoking play
DEBUG: sending ctrl. type: 0x0003
DEBUG: RTMP_ClientPacket, received: invoke 16419 bytes
DEBUG: (object begin)
DEBUG: Property: NULL
DEBUG: (object end)
DEBUG: HandleInvoke, server invoking <_onbwcheck>
DEBUG: Invoking _result
DEBUG: RTMP_ClientPacket, received: invoke 133 bytes
DEBUG: (object begin)
DEBUG: Property: NULL
DEBUG: (object begin)
DEBUG: Property: <Name:              level, STRING:	error>
DEBUG: Property: <Name:               code, STRING:	NetStream.Failed>
DEBUG: Property: <Name:        description, STRING:	Failed to play  (stream ID: 1).>
DEBUG: Property: <Name:           clientid, STRING:	iXF4wR^Y>
DEBUG: (object end)
DEBUG: (object end)
DEBUG: HandleInvoke, server invoking <onStatus>
DEBUG: HandleInvoke, onStatus: NetStream.Failed
ERROR: Closing connection: NetStream.Failed
DEBUG: Closing connection.

Any ideas on this aspect?

I am using a proxy to get past the geo-location check. I am starting to think this is causing a problem both with trying to use RTMPDUMP and StreamTransport

I don't think what I have is a Socks4 Proxy so it doesn't work with the -S parameter. Besides I connect and download using RTMPDUMP from other geo-restricted sites without using a proxy just fine.

If I were to guess in regards to generating parameters automatically from the xml file, I would say look at the channel4.pm plugin for get_flash_videos and a get_iplayer version with channel4 capabilities. Looking at them they both seem to be getting info from the XML file. They are out-dated but might give some info, it does not seem as though the &h is mentioned so I don't know if it is new or it was never needed in the old channel4.pm or get_iplayer implimentation.
When using get_flash_videos it never tried to use channel4.pm as it is out-dated. I changed it so now at least it says it is using it but as I have no programming knowledge I am unable to change the rest of it so that it works. Now it just dies and pegs perl.exe at 100% CPU usage and I have to kill the process. Anyway good luck with what your working on.

As for me I just have no idea, it seems everything works for everyone else but me. I can only figure there is some sort of issue using the proxy. I have the same format commands, etc. it just doesn't work. If you could shine any light onto a resolution for my problems that would be great.

Thanks

[noobie]

Please can anyone help me to rip this?

http://www.channel4.com/programmes/bestival/4od#3131875

I honestly haven't got a clue how to do this but really would like this programme. thanks